Jul 27 19:23:58.747327 ip-10-0-134-17 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 19:23:59.125953 ip-10-0-134-17 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:23:59.125953 ip-10-0-134-17 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 19:23:59.125953 ip-10-0-134-17 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:23:59.125953 ip-10-0-134-17 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 19:23:59.125953 ip-10-0-134-17 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:23:59.126625 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.125943    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 19:23:59.130562 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.130531    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:23:59.130705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.130694    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:23:59.130784 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.130766    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:23:59.130846 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.130839    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:23:59.130944 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.130920    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:23:59.130944 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.130945    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:23:59.131028 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.130951    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:23:59.131028 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.130980    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:23:59.131189 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131174    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:23:59.131189 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131188    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131192    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131196    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131199    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131201    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131205    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131207    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131212    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131217    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131220    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131223    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131226    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131229    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131232    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131235    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131237    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131240    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131243    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131245    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:23:59.131273 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131248    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131250    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131253    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131256    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131259    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131261    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131264    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131267    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131269    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131273    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131278    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131281    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131283    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131286    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131289    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131292    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131295    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131297    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131300    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131302    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:23:59.131773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131305    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131307    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131310    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131312    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131314    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131317    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131319    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131323    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131327    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131329    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131332    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131335    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131337    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131340    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131343    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131347    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131350    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131353    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131356    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:23:59.132315 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131358    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131361    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131364    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131366    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131369    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131371    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131374    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131377    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131379    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131382    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131384    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131386    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131389    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131392    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131394    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131397    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131399    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131402    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131404    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131407    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:23:59.132767 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131409    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131412    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131414    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131417    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131419    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131421    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131424    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131428    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131430    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131433    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131436    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.131438    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132181    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132189    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132191    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132194    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132196    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132199    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132202    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132205    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:23:59.133297 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132208    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132211    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132213    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132216    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132218    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132221    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132223    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132226    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132229    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132231    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132233    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132236    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132238    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132241    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132246    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132249    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132252    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132254    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132257    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132261    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:23:59.133811 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132264    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132267    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132270    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132273    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132275    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132278    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132280    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132283    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132285    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132288    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132290    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132293    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132295    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132297    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132300    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132302    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132305    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132307    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132309    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:23:59.134329 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132312    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132316    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132319    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132322    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132325    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132328    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132331    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132333    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132336    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132338    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132341    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132343    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132347    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132349    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132355    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132358    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132362    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132364    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132367    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:23:59.134830 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132369    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132372    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132374    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132377    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132379    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132381    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132385    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132387    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132390    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132392    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132394    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132397    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132399    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132401    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132404    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132406    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132408    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132412    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132415    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132418    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:23:59.135306 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132420    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132423    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132425    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132428    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132430    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132433    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132435    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132439    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132442    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132444    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132448    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132450    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132452    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132829    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132834    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132836    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132839    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132841    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132844    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:23:59.135800 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132847    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132851    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132855    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132858    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132861    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132863    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132866    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132868    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132872    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132875    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132879    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132882    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132885    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132888    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132890    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132892    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132895    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132897    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132900    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:23:59.136320 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132903    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132905    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132908    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132910    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132913    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132915    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132918    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132920    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132923    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132925    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132927    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132930    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132932    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132935    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132937    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132941    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132944    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132947    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132950    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132952    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:23:59.136773 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132955    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132957    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132960    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132963    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132966    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132968    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132971    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132973    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132976    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132978    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132981    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132983    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132986    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132988    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132991    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132993    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132996    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.132998    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133000    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133003    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:23:59.137270 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133005    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133008    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133010    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133013    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133015    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133017    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133020    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133023    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133025    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133028    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133031    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133049    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133052    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133054    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133057    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133060    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133063    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133066    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133068    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:23:59.137778 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133071    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133074    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133076    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133079    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133081    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133083    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133086    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133089    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133091    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133094    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133096    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133098    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133101    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133103    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133105    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133181    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133192    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133198    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133203    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133207    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133210    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 19:23:59.138253 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133214    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133221    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133224    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133227    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133231    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133234    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133237    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133240    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133243    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133245    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133249    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133252    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133256    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133259    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133262    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133265    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133268    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133272    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133275    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133277    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133281    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133284    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133286    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133289    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 19:23:59.138780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133292    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133295    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133299    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133302    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133305    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133308    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133311    2563 flags.go:64] FLAG: --enable-server="true"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133314    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133318    2563 flags.go:64] FLAG: --event-burst="100"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133322    2563 flags.go:64] FLAG: --event-qps="50"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133325    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133328    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133331    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133334    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133337    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133340    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133343    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133346    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133349    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133353    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133356    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133358    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133361    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133364    2563 flags.go:64] FLAG: --feature-gates=""
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133368    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 19:23:59.139366 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133370    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133373    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133376    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133379    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133382    2563 flags.go:64] FLAG: --help="false"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133385    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133388    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133391    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133393    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133397    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133400    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133403    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133405    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133408    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133411    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133414    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133418    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133421    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133424    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133427    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133429    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133433    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133437    2563 flags.go:64] FLAG: --lock-file=""
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133439    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 19:23:59.140060 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133442    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133445    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133451    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133454    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133457    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133460    2563 flags.go:64] FLAG: --logging-format="text"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133462    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133465    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133468    2563 flags.go:64] FLAG: --manifest-url=""
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133471    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133475    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133478    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133482    2563 flags.go:64] FLAG: --max-pods="110"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133484    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133487    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133490    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133493    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133496    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133499    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133501    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133508    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133511    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133514    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 19:23:59.140630 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133516    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133520    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133526    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133528    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133532    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133534    2563 flags.go:64] FLAG: --port="10250"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133539    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133542    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-086675c6f1258be1b"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133545    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133547    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133550    2563 flags.go:64] FLAG: --register-node="true"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133553    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133557    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133560    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133563    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133565    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133569    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133572    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133575    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133578    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133580    2563 flags.go:64] FLAG: --runonce="false"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133583    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133586    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133589    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133592    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 19:23:59.141220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133594    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133597    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133600    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133603    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133606    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133608    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133611    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133614    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133617    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133622    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133625    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133630    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133632    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133636    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133640    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133643    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133646    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133648    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133651    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133654    2563 flags.go:64] FLAG: --v="2"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133658    2563 flags.go:64] FLAG: --version="false"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133663    2563 flags.go:64] FLAG: --vmodule=""
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133666    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.133669    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133787    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:23:59.141823 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133791    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133794    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133796    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133799    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133801    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133803    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133806    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133808    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133811    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133814    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133817    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133820    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133822    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133825    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133827    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133830    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133833    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133836    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133838    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133841    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:23:59.142449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133844    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133847    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133849    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133852    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133854    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133856    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133859    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133861    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133864    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133867    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133869    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133872    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133874    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133876    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133879    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133881    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133884    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133886    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133888    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:23:59.142932 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133891    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133893    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133895    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133898    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133900    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133902    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133905    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133907    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133909    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133912    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133915    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133917    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133921    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133927    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133929    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133932    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133935    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133937    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133940    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133943    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:23:59.143404 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133945    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133947    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133950    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133953    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133955    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133958    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133960    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133963    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133965    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133968    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133970    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133972    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133975    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133977    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133981    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133984    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133987    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133989    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133992    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133994    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:23:59.143925 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.133997    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134000    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134002    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134005    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134007    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134011    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134013    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134017    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134021    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134023    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134026    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134028    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134031    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134047    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134050    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134052    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134055    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134058    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:23:59.144427 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.134060    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.134607    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.141303    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.141316    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.141329    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.141336    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141391    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141396    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141399    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141402    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141405    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141408    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141410    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141413    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141416    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:23:59.144862 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141418    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141421    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141423    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141426    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141430    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141434    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141437    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141441    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141444    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141447    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141450    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141453    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141456    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141459    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141462    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141465    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141467    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141470    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141472    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:23:59.145247 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141475    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141478    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141481    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141483    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141486    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141489    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141491    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141494    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141496    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141498    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141501    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141503    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141505    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141508    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141511    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141514    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141516    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141519    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141521    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141524    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:23:59.145705 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141526    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141529    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141531    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141534    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141536    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141539    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141541    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141543    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141546    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141548    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141550    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141553    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141555    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141558    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141561    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141563    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141565    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141568    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141570    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141573    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:23:59.146211 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141575    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141578    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141580    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141582    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141585    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141587    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141590    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141592    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141595    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141597    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141599    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141602    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141605    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141607    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141609    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141612    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141614    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141617    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141619    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:23:59.146686 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141622    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141624    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141627    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141631    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141634    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141636    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141639    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141641    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141644    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141647    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141649    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141652    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.141657    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141769    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141773    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:23:59.147207 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141776    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141779    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141782    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141784    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141787    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141789    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141792    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141794    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141797    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141799    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141802    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141804    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141807    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141809    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141811    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141814    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141816    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141819    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141821    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141824    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:23:59.147567 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141826    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141829    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141831    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141834    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141836    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141839    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141842    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141844    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141847    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141850    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141852    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141855    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141857    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141860    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141862    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141865    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141867    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141869    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141872    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141875    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:23:59.148166 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141877    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141879    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141882    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141884    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141886    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141889    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141891    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141894    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141896    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141899    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141903    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141905    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141908    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141911    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141914    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141917    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141919    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141922    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141924    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:23:59.148656 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141927    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141930    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141933    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141935    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141937    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141940    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141942    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141944    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141947    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141949    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141951    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141954    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141957    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141959    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141961    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141964    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141966    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141970    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141973    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141977    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:23:59.149128 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141980    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141983    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141985    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141987    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141990    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141992    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141995    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141997    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.141999    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.142002    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.142004    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.142006    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.142009    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.142012    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.142014    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.142017    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.142019    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:23:59.149613 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:23:59.142022    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:23:59.150018 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.142027    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:23:59.150018 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.142156    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 19:23:59.150018 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.144030    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 19:23:59.150018 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.145264    2563 server.go:1019] "Starting client certificate rotation"
Jul 27 19:23:59.150018 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.145364    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:23:59.150018 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.145393    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:23:59.150018 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.148396    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:23:59.150995 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.150981    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:23:59.161513 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.161495    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 27 19:23:59.164090 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.164026    2563 log.go:25] "Validated CRI v1 image API"
Jul 27 19:23:59.164918 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.164904    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 19:23:59.167845 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.167828    2563 fs.go:135] Filesystem UUIDs: map[49ae8e0e-4091-4807-bf3f-a9312bb0c2b5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c7cef54b-9b04-46a8-a69d-89d3bed7a431:/dev/nvme0n1p3]
Jul 27 19:23:59.167904 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.167846    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 19:23:59.173918 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.173783    2563 manager.go:216] Machine: {Timestamp:2026-07-27 19:23:59.172427368 +0000 UTC m=+0.315631735 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098055 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22c2e53af5895e2145142f4b0fbe29 SystemUUID:ec22c2e5-3af5-895e-2145-142f4b0fbe29 BootID:36db192a-40db-453b-a3b8-d4b738ebe4d0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bc:26:7c:c9:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bc:26:7c:c9:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:bc:f4:ad:0b:cd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 19:23:59.173918 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.173918    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 19:23:59.174008 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.173995    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 19:23:59.176789 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.176766    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 19:23:59.176928 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.176794    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-17.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 19:23:59.177498 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.177488    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 19:23:59.177534 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.177500    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 19:23:59.177534 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.177508    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:23:59.178189 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.178179    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:23:59.179066 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.179056    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 19:23:59.180737 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.180724    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:23:59.180885 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.180874    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 19:23:59.181409 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.181397    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 19:23:59.181450 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.181424    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 19:23:59.181450 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.181443    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 19:23:59.181540 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.181455    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 27 19:23:59.181540 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.181467    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 19:23:59.181880 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.181867    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:23:59.181936 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.181887    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:23:59.183969 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.183947    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 19:23:59.185526 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.185514    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 19:23:59.185571 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.185544    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 19:23:59.187138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187030    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 19:23:59.187138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187062    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 19:23:59.187138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187068    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 19:23:59.187138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187073    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 19:23:59.187138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187082    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 19:23:59.187138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187088    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 19:23:59.187138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187096    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 19:23:59.187138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187101    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 19:23:59.187138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187107    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 19:23:59.187138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187112    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 19:23:59.187138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187120    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 19:23:59.187138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187125    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 19:23:59.187878 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187869    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 19:23:59.187878 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.187878    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 19:23:59.191854 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.191836    2563 server.go:1268] "Started kubelet"
Jul 27 19:23:59.191951 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.191930    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:23:59.192022 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.191969    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 19:23:59.192097 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.192067    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 19:23:59.192169 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.192126    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 19:23:59.192754 ip-10-0-134-17 systemd[1]: Started Kubernetes Kubelet.
Jul 27 19:23:59.193777 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.193595    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 19:23:59.194777 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.194756    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 19:23:59.197926 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.197907    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 19:23:59.199421 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.199380    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-17.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:23:59.199493 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.199439    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:23:59.199566 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.199550    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:23:59.200696 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.199509    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-17.ec2.internal.18c63bf821129153  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-17.ec2.internal,UID:ip-10-0-134-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-17.ec2.internal,},FirstTimestamp:2026-07-27 19:23:59.191773523 +0000 UTC m=+0.334977892,LastTimestamp:2026-07-27 19:23:59.191773523 +0000 UTC m=+0.334977892,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-17.ec2.internal,}"
Jul 27 19:23:59.201679 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.201664    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 19:23:59.201743 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.201671    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 19:23:59.201791 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.201760    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:23:59.202481 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.202286    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 19:23:59.202481 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.202309    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 19:23:59.202481 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.202322    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 19:23:59.202481 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.202447    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 19:23:59.202481 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.202454    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 19:23:59.203709 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.203683    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 19:23:59.203709 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.203695    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:23:59.203919 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.203894    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 19:23:59.203919 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.203912    2563 factory.go:55] Registering systemd factory
Jul 27 19:23:59.203919 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.203922    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 27 19:23:59.204310 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.204257    2563 factory.go:153] Registering CRI-O factory
Jul 27 19:23:59.204310 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.204309    2563 factory.go:223] Registration of the crio container factory successfully
Jul 27 19:23:59.204409 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.204337    2563 factory.go:103] Registering Raw factory
Jul 27 19:23:59.204409 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.204349    2563 manager.go:1196] Started watching for new ooms in manager
Jul 27 19:23:59.204962 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.204950    2563 manager.go:349] Starting recovery of all containers
Jul 27 19:23:59.216958 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.216935    2563 manager.go:354] Recovery completed
Jul 27 19:23:59.221324 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.221209    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:59.223272 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.223245    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:59.223344 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.223289    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:59.223344 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.223304    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:59.223869 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.223852    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 19:23:59.223869 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.223867    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 19:23:59.223985 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.223874    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:59.223985 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.223882    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:23:59.224539 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.224523    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:59.224610 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.224550    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:59.224610 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.224560    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:59.225612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.225599    2563 policy_none.go:49] "None policy: Start"
Jul 27 19:23:59.225661 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.225617    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 19:23:59.225661 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.225628    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 19:23:59.226685 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.226675    2563 policy_none.go:47] "Start"
Jul 27 19:23:59.231948 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.231929    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4k7hg"
Jul 27 19:23:59.239081 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.238979    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-17.ec2.internal.18c63bf822f32f4b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-17.ec2.internal,UID:ip-10-0-134-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-17.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-17.ec2.internal,},FirstTimestamp:2026-07-27 19:23:59.223271243 +0000 UTC m=+0.366475610,LastTimestamp:2026-07-27 19:23:59.223271243 +0000 UTC m=+0.366475610,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-17.ec2.internal,}"
Jul 27 19:23:59.242013 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.241954    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-17.ec2.internal.18c63bf822f39028  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-17.ec2.internal,UID:ip-10-0-134-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-17.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-17.ec2.internal,},FirstTimestamp:2026-07-27 19:23:59.22329604 +0000 UTC m=+0.366500599,LastTimestamp:2026-07-27 19:23:59.22329604 +0000 UTC m=+0.366500599,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-17.ec2.internal,}"
Jul 27 19:23:59.251477 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.251457    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4k7hg"
Jul 27 19:23:59.255652 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.255586    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-17.ec2.internal.18c63bf822f3c2dc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-17.ec2.internal,UID:ip-10-0-134-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-17.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-17.ec2.internal,},FirstTimestamp:2026-07-27 19:23:59.22330902 +0000 UTC m=+0.366513387,LastTimestamp:2026-07-27 19:23:59.22330902 +0000 UTC m=+0.366513387,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-17.ec2.internal,}"
Jul 27 19:23:59.259455 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.259443    2563 manager.go:337] "Starting Device Plugin manager"
Jul 27 19:23:59.259533 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.259472    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 19:23:59.259533 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.259481    2563 server.go:87] "Starting device plugin registration server"
Jul 27 19:23:59.259749 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.259738    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 19:23:59.259781 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.259752    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 19:23:59.259849 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.259832    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 19:23:59.259928 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.259908    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 19:23:59.259928 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.259922    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 19:23:59.260445 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.260428    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 19:23:59.260512 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.260480    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:23:59.360612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.360582    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:59.361764 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.361747    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:59.361838 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.361781    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:59.361838 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.361795    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:59.361838 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.361823    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.364297 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.364252    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 19:23:59.365714 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.365689    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 19:23:59.365805 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.365735    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 19:23:59.365805 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.365763    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 19:23:59.365909 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.365805    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 19:23:59.370370 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.370354    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:23:59.380643 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.380594    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.380643 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.380615    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-17.ec2.internal\": node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:23:59.417544 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.417513    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:23:59.466632 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.466582    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal"]
Jul 27 19:23:59.466789 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.466685    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:59.468344 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.468324    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:59.468413 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.468364    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:59.468413 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.468377    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:59.469681 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.469669    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:59.469807 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.469790    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.469847 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.469824    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:59.470430 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.470412    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:59.470500 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.470444    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:59.470500 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.470464    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:59.470500 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.470471    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:59.470500 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.470486    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:59.470500 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.470496    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:59.471701 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.471688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.471754 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.471729    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:59.472392 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.472373    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:59.472481 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.472397    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:59.472481 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.472406    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:59.491720 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.491696    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-17.ec2.internal\" not found" node="ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.496279 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.496263    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-17.ec2.internal\" not found" node="ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.503460 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.503444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb9ebedfe6a8b607452b06b7cd565ebb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal\" (UID: \"fb9ebedfe6a8b607452b06b7cd565ebb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.503524 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.503467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb9ebedfe6a8b607452b06b7cd565ebb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal\" (UID: \"fb9ebedfe6a8b607452b06b7cd565ebb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.503524 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.503489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71d2293077aeb4f0cb21942afdf2229b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-17.ec2.internal\" (UID: \"71d2293077aeb4f0cb21942afdf2229b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.518534 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.518511    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:23:59.604398 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.604368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71d2293077aeb4f0cb21942afdf2229b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-17.ec2.internal\" (UID: \"71d2293077aeb4f0cb21942afdf2229b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.604505 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.604409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb9ebedfe6a8b607452b06b7cd565ebb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal\" (UID: \"fb9ebedfe6a8b607452b06b7cd565ebb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.604505 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.604426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb9ebedfe6a8b607452b06b7cd565ebb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal\" (UID: \"fb9ebedfe6a8b607452b06b7cd565ebb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.604505 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.604450    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb9ebedfe6a8b607452b06b7cd565ebb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal\" (UID: \"fb9ebedfe6a8b607452b06b7cd565ebb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.604505 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.604378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71d2293077aeb4f0cb21942afdf2229b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-17.ec2.internal\" (UID: \"71d2293077aeb4f0cb21942afdf2229b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.604505 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.604495    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb9ebedfe6a8b607452b06b7cd565ebb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal\" (UID: \"fb9ebedfe6a8b607452b06b7cd565ebb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.618833 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.618810    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:23:59.719595 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.719521    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:23:59.794752 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.794715    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.799558 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:23:59.799542    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal"
Jul 27 19:23:59.819728 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.819706    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:23:59.920291 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:23:59.920243    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:24:00.020452 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:00.020382    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:24:00.121263 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:00.121220    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:24:00.144336 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.144306    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 19:24:00.144818 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.144480    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 19:24:00.221415 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:00.221384    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:24:00.255675 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.255619    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 19:18:59 +0000 UTC" deadline="2028-03-05 14:39:08.57735621 +0000 UTC"
Jul 27 19:24:00.255797 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.255672    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14083h15m8.321692693s"
Jul 27 19:24:00.266434 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.266412    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:24:00.267720 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.267702    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:24:00.267802 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.267735    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:24:00.267802 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.267745    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:24:00.321766 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:00.321679    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:24:00.332353 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.332334    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:24:00.422701 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:00.422677    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:24:00.425950 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:24:00.425920    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9ebedfe6a8b607452b06b7cd565ebb.slice/crio-755558c2fcd2fad03e7d4d84584311158c5f0f4acce76d3bf88b21355ba46b3a WatchSource:0}: Error finding container 755558c2fcd2fad03e7d4d84584311158c5f0f4acce76d3bf88b21355ba46b3a: Status 404 returned error can't find the container with id 755558c2fcd2fad03e7d4d84584311158c5f0f4acce76d3bf88b21355ba46b3a
Jul 27 19:24:00.426494 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:24:00.426475    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d2293077aeb4f0cb21942afdf2229b.slice/crio-caf531f385583df5707a94c94250b99c873798737841284540524b9eee29d706 WatchSource:0}: Error finding container caf531f385583df5707a94c94250b99c873798737841284540524b9eee29d706: Status 404 returned error can't find the container with id caf531f385583df5707a94c94250b99c873798737841284540524b9eee29d706
Jul 27 19:24:00.431837 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.431818    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:24:00.523927 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:00.523876    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:24:00.625219 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:00.625140    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:24:00.628849 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.628832    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:24:00.725343 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:00.725312    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found"
Jul 27 19:24:00.749968 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.749946    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:24:00.803893 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.803861    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal"
Jul 27 19:24:00.815349 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.815330    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:24:00.816491 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.816477    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal"
Jul 27 19:24:00.830591 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:00.830572    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:24:01.184516 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.184472    2563 apiserver.go:52] "Watching apiserver"
Jul 27 19:24:01.196713 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.196688    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 19:24:01.197204 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.197170    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-7vb5t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal","openshift-multus/multus-jpcp7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw","openshift-multus/multus-additional-cni-plugins-5qhd8","openshift-multus/network-metrics-daemon-wqcm5","openshift-network-diagnostics/network-check-target-mjn75","openshift-network-operator/iptables-alerter-fwktm","openshift-ovn-kubernetes/ovnkube-node-8nkqw","kube-system/global-pull-secret-syncer-qb6nb","kube-system/konnectivity-agent-snkr9","kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal","openshift-cluster-node-tuning-operator/tuned-dqgq8","openshift-dns/node-resolver-9nvmk"]
Jul 27 19:24:01.198962 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.198942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:01.199094 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.199061    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:01.200153 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.200124    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.202071 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.201552    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.203396 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.202824    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 19:24:01.203396 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.202952    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.205461 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.205438    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 19:24:01.206526 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.206502    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 19:24:01.206826 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.206807    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:01.207070 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.207050    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v5kjc\""
Jul 27 19:24:01.207255 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.206913    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:01.207378 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.207363    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 19:24:01.207603 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.207587    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 19:24:01.207978 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.207958    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kzh8q\""
Jul 27 19:24:01.208328 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.208308    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 19:24:01.208631 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.208606    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:24:01.208631 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.208625    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n6rs8\""
Jul 27 19:24:01.209000 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.208982    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 19:24:01.209362 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.209344    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 19:24:01.210010 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.209984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.211515 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.211285    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.212560 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.212515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-sysctl-d\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.212560 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.212558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-hostroot\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.212707 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.212592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-etc-kubernetes\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.212707 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.212629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-etc-selinux\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.212707 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.212667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8392f991-ec23-4757-a28d-2e42885d4d03-etc-tuned\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.212707 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.212698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv7tb\" (UniqueName: \"kubernetes.io/projected/5dacadb1-e426-447b-ad6c-1a442ef7013a-kube-api-access-sv7tb\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.212921 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.212727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-socket-dir\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.212921 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.212757    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-sysctl-conf\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.212921 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.212807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-lib-modules\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.212921 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.212840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8392f991-ec23-4757-a28d-2e42885d4d03-tmp\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.213165 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.212968    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 19:24:01.213165 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.213024    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7vb5t"
Jul 27 19:24:01.213708 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.213508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-var-lib-cni-multus\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.213708 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.213570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.213708 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.213610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-os-release\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.214519 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5dacadb1-e426-447b-ad6c-1a442ef7013a-multus-daemon-config\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.214635 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-systemd\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.214699 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-sys\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.214699 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-cnibin\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.214849 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-multus-socket-dir-parent\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.214849 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-var-lib-cni-bin\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.214849 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-device-dir\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.214849 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214802    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 19:24:01.214849 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-sys-fs\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.215167 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-run-k8s-cni-cncf-io\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.215167 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t8mv\" (UniqueName: \"kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv\") pod \"network-check-target-mjn75\" (UID: \"815db620-bf60-497a-8626-a1769ac6aba0\") " pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:01.215167 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-modprobe-d\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.215167 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-sysconfig\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.215167 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214969    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jz9n5\""
Jul 27 19:24:01.215167 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.214961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-kubernetes\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.215167 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-var-lib-kubelet\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.215167 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-multus-cni-dir\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.215167 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215052    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-var-lib-kubelet\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.215167 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215088    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 19:24:01.215167 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f4qn\" (UniqueName: \"kubernetes.io/projected/8392f991-ec23-4757-a28d-2e42885d4d03-kube-api-access-4f4qn\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-system-cni-dir\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dacadb1-e426-447b-ad6c-1a442ef7013a-cni-binary-copy\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215251    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-run-netns\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-run-multus-certs\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-registration-dir\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkvgw\" (UniqueName: \"kubernetes.io/projected/e37d0a7e-9b06-466c-b418-260adcf95f6d-kube-api-access-hkvgw\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-run\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-host\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-multus-conf-dir\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215453    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215548    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t8hhx\""
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9nvmk"
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215610    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.215947    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 19:24:01.216132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.216128    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 19:24:01.216936 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.216274    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 19:24:01.216936 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.216648    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:01.216936 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.216718    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:01.217363 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.217322    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 19:24:01.217847 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.217674    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 19:24:01.218408 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.218017    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-snkr9"
Jul 27 19:24:01.218408 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.218113    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-brf6w\""
Jul 27 19:24:01.219370 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.219351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fwktm"
Jul 27 19:24:01.219785 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.219351    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 19:24:01.220124 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.220103    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-whmfv\""
Jul 27 19:24:01.220269 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.220235    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 19:24:01.220721 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.220703    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 19:24:01.222665 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.222645    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 19:24:01.222930 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.222904    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-27w7j\""
Jul 27 19:24:01.223088 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.223070    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 19:24:01.223382 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.223365    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jcnfk\""
Jul 27 19:24:01.223557 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.223541    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:24:01.223760 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.223744    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 19:24:01.224252 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.224159    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 19:24:01.224388 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.224370    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 19:24:01.227683 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.227635    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:24:01.247950 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.247928    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4gq57"
Jul 27 19:24:01.258049 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.258026    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4gq57"
Jul 27 19:24:01.303498 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.303473    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 19:24:01.316373 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-hostroot\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.316504 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e72fd04c-f910-4da6-8016-961a2ffbd03a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.316504 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-var-lib-openvswitch\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.316504 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv7tb\" (UniqueName: \"kubernetes.io/projected/5dacadb1-e426-447b-ad6c-1a442ef7013a-kube-api-access-sv7tb\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.316504 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316464    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-hostroot\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.316726 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b870247-d7eb-4d04-a55a-5ba6e52e4aa6-iptables-alerter-script\") pod \"iptables-alerter-fwktm\" (UID: \"1b870247-d7eb-4d04-a55a-5ba6e52e4aa6\") " pod="openshift-network-operator/iptables-alerter-fwktm"
Jul 27 19:24:01.316726 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316620    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-sysctl-conf\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.316726 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e72fd04c-f910-4da6-8016-961a2ffbd03a-os-release\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.316726 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-run-openvswitch\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.316726 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-cni-bin\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.316726 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c5d2c331-be77-490e-bb57-c78d3e09e21c-ovnkube-script-lib\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316737    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-os-release\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-sysctl-conf\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5dacadb1-e426-447b-ad6c-1a442ef7013a-multus-daemon-config\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e72fd04c-f910-4da6-8016-961a2ffbd03a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316824    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/abaf6ffd-f230-4961-b59a-f91809572149-kubelet-config\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-sys\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-cnibin\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-sys-fs\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-os-release\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-systemd-units\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-run-systemd\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.316991    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-cnibin\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317009    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.317058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317020    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-sys\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-sys-fs\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2wlp\" (UniqueName: \"kubernetes.io/projected/e72fd04c-f910-4da6-8016-961a2ffbd03a-kube-api-access-f2wlp\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6kzv\" (UniqueName: \"kubernetes.io/projected/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-kube-api-access-x6kzv\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-multus-cni-dir\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-var-lib-kubelet\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c5d2c331-be77-490e-bb57-c78d3e09e21c-ovnkube-config\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f4qn\" (UniqueName: \"kubernetes.io/projected/8392f991-ec23-4757-a28d-2e42885d4d03-kube-api-access-4f4qn\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dacadb1-e426-447b-ad6c-1a442ef7013a-cni-binary-copy\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317303    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-multus-cni-dir\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-registration-dir\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317336    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-registration-dir\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkvgw\" (UniqueName: \"kubernetes.io/projected/e37d0a7e-9b06-466c-b418-260adcf95f6d-kube-api-access-hkvgw\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317361    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-var-lib-kubelet\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5dacadb1-e426-447b-ad6c-1a442ef7013a-multus-daemon-config\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-kubelet\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.317900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-log-socket\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.318638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnn8w\" (UniqueName: \"kubernetes.io/projected/4499a910-b91a-4ee7-af77-2e23b18f0d09-kube-api-access-nnn8w\") pod \"node-resolver-9nvmk\" (UID: \"4499a910-b91a-4ee7-af77-2e23b18f0d09\") " pod="openshift-dns/node-resolver-9nvmk"
Jul 27 19:24:01.318638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318175    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dacadb1-e426-447b-ad6c-1a442ef7013a-cni-binary-copy\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.318638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.317465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-run\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.318638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-multus-conf-dir\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.318638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-run\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.318638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e72fd04c-f910-4da6-8016-961a2ffbd03a-cnibin\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.318638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318370    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-multus-conf-dir\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.318638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e72fd04c-f910-4da6-8016-961a2ffbd03a-cni-binary-copy\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.318638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c5d2c331-be77-490e-bb57-c78d3e09e21c-env-overrides\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.318638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c5d2c331-be77-490e-bb57-c78d3e09e21c-ovn-node-metrics-cert\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.318638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxzv8\" (UniqueName: \"kubernetes.io/projected/c5d2c331-be77-490e-bb57-c78d3e09e21c-kube-api-access-gxzv8\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.319080 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-etc-kubernetes\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.319080 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-etc-selinux\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.319080 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8392f991-ec23-4757-a28d-2e42885d4d03-etc-tuned\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.319080 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-socket-dir\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.319080 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-etc-kubernetes\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.319080 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e72fd04c-f910-4da6-8016-961a2ffbd03a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.319080 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.318969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-slash\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.319080 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-cni-netd\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.319080 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddjjn\" (UniqueName: \"kubernetes.io/projected/1b870247-d7eb-4d04-a55a-5ba6e52e4aa6-kube-api-access-ddjjn\") pod \"iptables-alerter-fwktm\" (UID: \"1b870247-d7eb-4d04-a55a-5ba6e52e4aa6\") " pod="openshift-network-operator/iptables-alerter-fwktm"
Jul 27 19:24:01.319377 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-lib-modules\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.319377 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8392f991-ec23-4757-a28d-2e42885d4d03-tmp\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.319377 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-var-lib-cni-multus\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.319377 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319115    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 19:24:01.319377 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.319377 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8660bdd-6abd-4726-adf7-4802172dda7b-host\") pod \"node-ca-7vb5t\" (UID: \"a8660bdd-6abd-4726-adf7-4802172dda7b\") " pod="openshift-image-registry/node-ca-7vb5t"
Jul 27 19:24:01.319377 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9hl4\" (UniqueName: \"kubernetes.io/projected/a8660bdd-6abd-4726-adf7-4802172dda7b-kube-api-access-h9hl4\") pod \"node-ca-7vb5t\" (UID: \"a8660bdd-6abd-4726-adf7-4802172dda7b\") " pod="openshift-image-registry/node-ca-7vb5t"
Jul 27 19:24:01.319377 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-etc-selinux\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.319377 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:01.319377 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-run-netns\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.319377 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-etc-openvswitch\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.319377 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319365    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-var-lib-cni-multus\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.319731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-node-log\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.319731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b870247-d7eb-4d04-a55a-5ba6e52e4aa6-host-slash\") pod \"iptables-alerter-fwktm\" (UID: \"1b870247-d7eb-4d04-a55a-5ba6e52e4aa6\") " pod="openshift-network-operator/iptables-alerter-fwktm"
Jul 27 19:24:01.319731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-systemd\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.319731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-multus-socket-dir-parent\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.319731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-lib-modules\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.319731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-var-lib-cni-bin\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.319731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319550    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-device-dir\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.319731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e72fd04c-f910-4da6-8016-961a2ffbd03a-system-cni-dir\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.319731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319615    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-run-ovn\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.319731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-run-ovn-kubernetes\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.319731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-run-multus-certs\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.320054 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8660bdd-6abd-4726-adf7-4802172dda7b-serviceca\") pod \"node-ca-7vb5t\" (UID: \"a8660bdd-6abd-4726-adf7-4802172dda7b\") " pod="openshift-image-registry/node-ca-7vb5t"
Jul 27 19:24:01.320054 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-run-k8s-cni-cncf-io\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.320054 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t8mv\" (UniqueName: \"kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv\") pod \"network-check-target-mjn75\" (UID: \"815db620-bf60-497a-8626-a1769ac6aba0\") " pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:01.320054 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-modprobe-d\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.320054 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-sysconfig\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.320054 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-kubernetes\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.320054 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-var-lib-kubelet\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.320054 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-system-cni-dir\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.320054 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.319979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-run-netns\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.320054 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4499a910-b91a-4ee7-af77-2e23b18f0d09-hosts-file\") pod \"node-resolver-9nvmk\" (UID: \"4499a910-b91a-4ee7-af77-2e23b18f0d09\") " pod="openshift-dns/node-resolver-9nvmk"
Jul 27 19:24:01.320054 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4499a910-b91a-4ee7-af77-2e23b18f0d09-tmp-dir\") pod \"node-resolver-9nvmk\" (UID: \"4499a910-b91a-4ee7-af77-2e23b18f0d09\") " pod="openshift-dns/node-resolver-9nvmk"
Jul 27 19:24:01.320054 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/abaf6ffd-f230-4961-b59a-f91809572149-dbus\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:01.320620 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a470f90-abba-44f8-a6d4-56f84091326c-konnectivity-ca\") pod \"konnectivity-agent-snkr9\" (UID: \"3a470f90-abba-44f8-a6d4-56f84091326c\") " pod="kube-system/konnectivity-agent-snkr9"
Jul 27 19:24:01.320620 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-host\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.320620 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a470f90-abba-44f8-a6d4-56f84091326c-agent-certs\") pod \"konnectivity-agent-snkr9\" (UID: \"3a470f90-abba-44f8-a6d4-56f84091326c\") " pod="kube-system/konnectivity-agent-snkr9"
Jul 27 19:24:01.320620 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-sysctl-d\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.320620 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-run-multus-certs\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.320620 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320311    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-socket-dir\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.320620 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-run-k8s-cni-cncf-io\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.320620 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.320620 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320415    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-run-netns\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.320620 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320472    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-host\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.321422 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.320687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-host-var-lib-cni-bin\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.321422 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.321011    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-modprobe-d\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.321422 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.321049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-systemd\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.321422 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.321078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-sysconfig\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.321422 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.321169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-kubernetes\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.321422 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.321202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-system-cni-dir\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.321422 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.321271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-var-lib-kubelet\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.321422 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.321279    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5dacadb1-e426-447b-ad6c-1a442ef7013a-multus-socket-dir-parent\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.321422 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.321327    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e37d0a7e-9b06-466c-b418-260adcf95f6d-device-dir\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.321879 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.321455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8392f991-ec23-4757-a28d-2e42885d4d03-etc-sysctl-d\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.323296 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.323269    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8392f991-ec23-4757-a28d-2e42885d4d03-etc-tuned\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.323391 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.323353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8392f991-ec23-4757-a28d-2e42885d4d03-tmp\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.331813 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.331786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkvgw\" (UniqueName: \"kubernetes.io/projected/e37d0a7e-9b06-466c-b418-260adcf95f6d-kube-api-access-hkvgw\") pod \"aws-ebs-csi-driver-node-f9gpw\" (UID: \"e37d0a7e-9b06-466c-b418-260adcf95f6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.332767 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.332747    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:24:01.332886 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.332775    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:24:01.332886 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.332789    2563 projected.go:196] Error preparing data for projected volume kube-api-access-2t8mv for pod openshift-network-diagnostics/network-check-target-mjn75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:01.332886 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.332853    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv podName:815db620-bf60-497a-8626-a1769ac6aba0 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:01.832831272 +0000 UTC m=+2.976035643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2t8mv" (UniqueName: "kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv") pod "network-check-target-mjn75" (UID: "815db620-bf60-497a-8626-a1769ac6aba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:01.336980 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.336953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv7tb\" (UniqueName: \"kubernetes.io/projected/5dacadb1-e426-447b-ad6c-1a442ef7013a-kube-api-access-sv7tb\") pod \"multus-jpcp7\" (UID: \"5dacadb1-e426-447b-ad6c-1a442ef7013a\") " pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.338409 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.338388    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f4qn\" (UniqueName: \"kubernetes.io/projected/8392f991-ec23-4757-a28d-2e42885d4d03-kube-api-access-4f4qn\") pod \"tuned-dqgq8\" (UID: \"8392f991-ec23-4757-a28d-2e42885d4d03\") " pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.372744 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.372644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal" event={"ID":"71d2293077aeb4f0cb21942afdf2229b","Type":"ContainerStarted","Data":"caf531f385583df5707a94c94250b99c873798737841284540524b9eee29d706"}
Jul 27 19:24:01.374398 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.374364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" event={"ID":"fb9ebedfe6a8b607452b06b7cd565ebb","Type":"ContainerStarted","Data":"755558c2fcd2fad03e7d4d84584311158c5f0f4acce76d3bf88b21355ba46b3a"}
Jul 27 19:24:01.421885 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.421855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-etc-openvswitch\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.422076 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.421898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-node-log\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.422076 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.421931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b870247-d7eb-4d04-a55a-5ba6e52e4aa6-host-slash\") pod \"iptables-alerter-fwktm\" (UID: \"1b870247-d7eb-4d04-a55a-5ba6e52e4aa6\") " pod="openshift-network-operator/iptables-alerter-fwktm"
Jul 27 19:24:01.422076 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.421960    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e72fd04c-f910-4da6-8016-961a2ffbd03a-system-cni-dir\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.422076 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.421986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-run-ovn\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.422076 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.421988    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-node-log\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.422076 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-run-ovn-kubernetes\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.422076 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.421987    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-etc-openvswitch\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.422076 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b870247-d7eb-4d04-a55a-5ba6e52e4aa6-host-slash\") pod \"iptables-alerter-fwktm\" (UID: \"1b870247-d7eb-4d04-a55a-5ba6e52e4aa6\") " pod="openshift-network-operator/iptables-alerter-fwktm"
Jul 27 19:24:01.422076 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8660bdd-6abd-4726-adf7-4802172dda7b-serviceca\") pod \"node-ca-7vb5t\" (UID: \"a8660bdd-6abd-4726-adf7-4802172dda7b\") " pod="openshift-image-registry/node-ca-7vb5t"
Jul 27 19:24:01.422076 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e72fd04c-f910-4da6-8016-961a2ffbd03a-system-cni-dir\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4499a910-b91a-4ee7-af77-2e23b18f0d09-hosts-file\") pod \"node-resolver-9nvmk\" (UID: \"4499a910-b91a-4ee7-af77-2e23b18f0d09\") " pod="openshift-dns/node-resolver-9nvmk"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422133    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-run-ovn\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4499a910-b91a-4ee7-af77-2e23b18f0d09-tmp-dir\") pod \"node-resolver-9nvmk\" (UID: \"4499a910-b91a-4ee7-af77-2e23b18f0d09\") " pod="openshift-dns/node-resolver-9nvmk"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/abaf6ffd-f230-4961-b59a-f91809572149-dbus\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-run-ovn-kubernetes\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a470f90-abba-44f8-a6d4-56f84091326c-konnectivity-ca\") pod \"konnectivity-agent-snkr9\" (UID: \"3a470f90-abba-44f8-a6d4-56f84091326c\") " pod="kube-system/konnectivity-agent-snkr9"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a470f90-abba-44f8-a6d4-56f84091326c-agent-certs\") pod \"konnectivity-agent-snkr9\" (UID: \"3a470f90-abba-44f8-a6d4-56f84091326c\") " pod="kube-system/konnectivity-agent-snkr9"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e72fd04c-f910-4da6-8016-961a2ffbd03a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-var-lib-openvswitch\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b870247-d7eb-4d04-a55a-5ba6e52e4aa6-iptables-alerter-script\") pod \"iptables-alerter-fwktm\" (UID: \"1b870247-d7eb-4d04-a55a-5ba6e52e4aa6\") " pod="openshift-network-operator/iptables-alerter-fwktm"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e72fd04c-f910-4da6-8016-961a2ffbd03a-os-release\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-run-openvswitch\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-cni-bin\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c5d2c331-be77-490e-bb57-c78d3e09e21c-ovnkube-script-lib\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e72fd04c-f910-4da6-8016-961a2ffbd03a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/abaf6ffd-f230-4961-b59a-f91809572149-kubelet-config\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:01.422612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-systemd-units\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4499a910-b91a-4ee7-af77-2e23b18f0d09-tmp-dir\") pod \"node-resolver-9nvmk\" (UID: \"4499a910-b91a-4ee7-af77-2e23b18f0d09\") " pod="openshift-dns/node-resolver-9nvmk"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-run-systemd\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422541    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422563    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4499a910-b91a-4ee7-af77-2e23b18f0d09-hosts-file\") pod \"node-resolver-9nvmk\" (UID: \"4499a910-b91a-4ee7-af77-2e23b18f0d09\") " pod="openshift-dns/node-resolver-9nvmk"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2wlp\" (UniqueName: \"kubernetes.io/projected/e72fd04c-f910-4da6-8016-961a2ffbd03a-kube-api-access-f2wlp\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8660bdd-6abd-4726-adf7-4802172dda7b-serviceca\") pod \"node-ca-7vb5t\" (UID: \"a8660bdd-6abd-4726-adf7-4802172dda7b\") " pod="openshift-image-registry/node-ca-7vb5t"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422611    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-run-openvswitch\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6kzv\" (UniqueName: \"kubernetes.io/projected/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-kube-api-access-x6kzv\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c5d2c331-be77-490e-bb57-c78d3e09e21c-ovnkube-config\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-kubelet\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-log-socket\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnn8w\" (UniqueName: \"kubernetes.io/projected/4499a910-b91a-4ee7-af77-2e23b18f0d09-kube-api-access-nnn8w\") pod \"node-resolver-9nvmk\" (UID: \"4499a910-b91a-4ee7-af77-2e23b18f0d09\") " pod="openshift-dns/node-resolver-9nvmk"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e72fd04c-f910-4da6-8016-961a2ffbd03a-cnibin\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e72fd04c-f910-4da6-8016-961a2ffbd03a-cni-binary-copy\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c5d2c331-be77-490e-bb57-c78d3e09e21c-env-overrides\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.423530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c5d2c331-be77-490e-bb57-c78d3e09e21c-ovn-node-metrics-cert\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxzv8\" (UniqueName: \"kubernetes.io/projected/c5d2c331-be77-490e-bb57-c78d3e09e21c-kube-api-access-gxzv8\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e72fd04c-f910-4da6-8016-961a2ffbd03a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-slash\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-cni-netd\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddjjn\" (UniqueName: \"kubernetes.io/projected/1b870247-d7eb-4d04-a55a-5ba6e52e4aa6-kube-api-access-ddjjn\") pod \"iptables-alerter-fwktm\" (UID: \"1b870247-d7eb-4d04-a55a-5ba6e52e4aa6\") " pod="openshift-network-operator/iptables-alerter-fwktm"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8660bdd-6abd-4726-adf7-4802172dda7b-host\") pod \"node-ca-7vb5t\" (UID: \"a8660bdd-6abd-4726-adf7-4802172dda7b\") " pod="openshift-image-registry/node-ca-7vb5t"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9hl4\" (UniqueName: \"kubernetes.io/projected/a8660bdd-6abd-4726-adf7-4802172dda7b-kube-api-access-h9hl4\") pod \"node-ca-7vb5t\" (UID: \"a8660bdd-6abd-4726-adf7-4802172dda7b\") " pod="openshift-image-registry/node-ca-7vb5t"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-run-netns\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423105    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-run-netns\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-cni-bin\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423221    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a470f90-abba-44f8-a6d4-56f84091326c-konnectivity-ca\") pod \"konnectivity-agent-snkr9\" (UID: \"3a470f90-abba-44f8-a6d4-56f84091326c\") " pod="kube-system/konnectivity-agent-snkr9"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c5d2c331-be77-490e-bb57-c78d3e09e21c-ovnkube-script-lib\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423302    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-systemd-units\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423307    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-var-lib-openvswitch\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423386    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/abaf6ffd-f230-4961-b59a-f91809572149-kubelet-config\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:01.424403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423578    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c5d2c331-be77-490e-bb57-c78d3e09e21c-ovnkube-config\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.422664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/abaf6ffd-f230-4961-b59a-f91809572149-dbus\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.423673    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.423737    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret podName:abaf6ffd-f230-4961-b59a-f91809572149 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:01.923715769 +0000 UTC m=+3.066920125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret") pod "global-pull-secret-syncer-qb6nb" (UID: "abaf6ffd-f230-4961-b59a-f91809572149") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e72fd04c-f910-4da6-8016-961a2ffbd03a-os-release\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b870247-d7eb-4d04-a55a-5ba6e52e4aa6-iptables-alerter-script\") pod \"iptables-alerter-fwktm\" (UID: \"1b870247-d7eb-4d04-a55a-5ba6e52e4aa6\") " pod="openshift-network-operator/iptables-alerter-fwktm"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423778    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e72fd04c-f910-4da6-8016-961a2ffbd03a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-run-systemd\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423777    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-kubelet\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423807    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-log-socket\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-slash\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.423960    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e72fd04c-f910-4da6-8016-961a2ffbd03a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.423983    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e72fd04c-f910-4da6-8016-961a2ffbd03a-cnibin\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.424014    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs podName:1ee028dc-ad1f-43c4-9ada-e2ed9807fca6 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:01.923996613 +0000 UTC m=+3.067200973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs") pod "network-metrics-daemon-wqcm5" (UID: "1ee028dc-ad1f-43c4-9ada-e2ed9807fca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.424169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c5d2c331-be77-490e-bb57-c78d3e09e21c-host-cni-netd\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.425078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.424169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8660bdd-6abd-4726-adf7-4802172dda7b-host\") pod \"node-ca-7vb5t\" (UID: \"a8660bdd-6abd-4726-adf7-4802172dda7b\") " pod="openshift-image-registry/node-ca-7vb5t"
Jul 27 19:24:01.425989 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.424407    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e72fd04c-f910-4da6-8016-961a2ffbd03a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.425989 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.424467    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c5d2c331-be77-490e-bb57-c78d3e09e21c-env-overrides\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.425989 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.424531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e72fd04c-f910-4da6-8016-961a2ffbd03a-cni-binary-copy\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.427532 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.427511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c5d2c331-be77-490e-bb57-c78d3e09e21c-ovn-node-metrics-cert\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.429326 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.429261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a470f90-abba-44f8-a6d4-56f84091326c-agent-certs\") pod \"konnectivity-agent-snkr9\" (UID: \"3a470f90-abba-44f8-a6d4-56f84091326c\") " pod="kube-system/konnectivity-agent-snkr9"
Jul 27 19:24:01.436325 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.436224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddjjn\" (UniqueName: \"kubernetes.io/projected/1b870247-d7eb-4d04-a55a-5ba6e52e4aa6-kube-api-access-ddjjn\") pod \"iptables-alerter-fwktm\" (UID: \"1b870247-d7eb-4d04-a55a-5ba6e52e4aa6\") " pod="openshift-network-operator/iptables-alerter-fwktm"
Jul 27 19:24:01.438697 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.438665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnn8w\" (UniqueName: \"kubernetes.io/projected/4499a910-b91a-4ee7-af77-2e23b18f0d09-kube-api-access-nnn8w\") pod \"node-resolver-9nvmk\" (UID: \"4499a910-b91a-4ee7-af77-2e23b18f0d09\") " pod="openshift-dns/node-resolver-9nvmk"
Jul 27 19:24:01.439002 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.438977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxzv8\" (UniqueName: \"kubernetes.io/projected/c5d2c331-be77-490e-bb57-c78d3e09e21c-kube-api-access-gxzv8\") pod \"ovnkube-node-8nkqw\" (UID: \"c5d2c331-be77-490e-bb57-c78d3e09e21c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.439621 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.439594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9hl4\" (UniqueName: \"kubernetes.io/projected/a8660bdd-6abd-4726-adf7-4802172dda7b-kube-api-access-h9hl4\") pod \"node-ca-7vb5t\" (UID: \"a8660bdd-6abd-4726-adf7-4802172dda7b\") " pod="openshift-image-registry/node-ca-7vb5t"
Jul 27 19:24:01.441550 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.441527    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2wlp\" (UniqueName: \"kubernetes.io/projected/e72fd04c-f910-4da6-8016-961a2ffbd03a-kube-api-access-f2wlp\") pod \"multus-additional-cni-plugins-5qhd8\" (UID: \"e72fd04c-f910-4da6-8016-961a2ffbd03a\") " pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.444241 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.444217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6kzv\" (UniqueName: \"kubernetes.io/projected/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-kube-api-access-x6kzv\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:01.516103 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.516061    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dqgq8"
Jul 27 19:24:01.525005 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.524968    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jpcp7"
Jul 27 19:24:01.537261 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.537241    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw"
Jul 27 19:24:01.545006 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.544976    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5qhd8"
Jul 27 19:24:01.552672 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.552653    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:01.561290 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.561271    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7vb5t"
Jul 27 19:24:01.570150 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.570132    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9nvmk"
Jul 27 19:24:01.579876 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.579853    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-snkr9"
Jul 27 19:24:01.585659 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.585639    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fwktm"
Jul 27 19:24:01.611931 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.611905    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:24:01.926875 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.926791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t8mv\" (UniqueName: \"kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv\") pod \"network-check-target-mjn75\" (UID: \"815db620-bf60-497a-8626-a1769ac6aba0\") " pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:01.926875 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.926839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:01.927149 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:01.926888    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:01.927149 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.926975    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:01.927149 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.926999    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:24:01.927149 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.927020    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:01.927149 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.927025    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:24:01.927149 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.927041    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs podName:1ee028dc-ad1f-43c4-9ada-e2ed9807fca6 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:02.927021846 +0000 UTC m=+4.070226203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs") pod "network-metrics-daemon-wqcm5" (UID: "1ee028dc-ad1f-43c4-9ada-e2ed9807fca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:01.927149 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.927045    2563 projected.go:196] Error preparing data for projected volume kube-api-access-2t8mv for pod openshift-network-diagnostics/network-check-target-mjn75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:01.927149 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.927099    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret podName:abaf6ffd-f230-4961-b59a-f91809572149 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:02.927078892 +0000 UTC m=+4.070283264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret") pod "global-pull-secret-syncer-qb6nb" (UID: "abaf6ffd-f230-4961-b59a-f91809572149") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:01.927149 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:01.927122    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv podName:815db620-bf60-497a-8626-a1769ac6aba0 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:02.927110589 +0000 UTC m=+4.070314950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2t8mv" (UniqueName: "kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv") pod "network-check-target-mjn75" (UID: "815db620-bf60-497a-8626-a1769ac6aba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:02.260472 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:02.260415    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:19:01 +0000 UTC" deadline="2028-04-23 20:32:57.042183628 +0000 UTC"
Jul 27 19:24:02.260472 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:02.260465    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15265h8m54.781722371s"
Jul 27 19:24:02.366623 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:02.366590    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:02.366785 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:02.366704    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:02.528589 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:24:02.528563    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d2c331_be77_490e_bb57_c78d3e09e21c.slice/crio-ed950ebbbae010f1b92948f9cc7675dcafab7527afa6f5ec3bc4ac034175254e WatchSource:0}: Error finding container ed950ebbbae010f1b92948f9cc7675dcafab7527afa6f5ec3bc4ac034175254e: Status 404 returned error can't find the container with id ed950ebbbae010f1b92948f9cc7675dcafab7527afa6f5ec3bc4ac034175254e
Jul 27 19:24:02.532275 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:24:02.532246    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a470f90_abba_44f8_a6d4_56f84091326c.slice/crio-c612934226db8eab2bc167e0202d8c384e6a7cf8bb340a4c4887c10dc8b3d8cd WatchSource:0}: Error finding container c612934226db8eab2bc167e0202d8c384e6a7cf8bb340a4c4887c10dc8b3d8cd: Status 404 returned error can't find the container with id c612934226db8eab2bc167e0202d8c384e6a7cf8bb340a4c4887c10dc8b3d8cd
Jul 27 19:24:02.534525 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:24:02.534462    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b870247_d7eb_4d04_a55a_5ba6e52e4aa6.slice/crio-5ad33c7ca107e98559d0a0fec037d19caeba94c72db005b7a38dc8ed68cb8fc9 WatchSource:0}: Error finding container 5ad33c7ca107e98559d0a0fec037d19caeba94c72db005b7a38dc8ed68cb8fc9: Status 404 returned error can't find the container with id 5ad33c7ca107e98559d0a0fec037d19caeba94c72db005b7a38dc8ed68cb8fc9
Jul 27 19:24:02.535486 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:24:02.535446    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8660bdd_6abd_4726_adf7_4802172dda7b.slice/crio-6350da3ef26385eef0d78a900ec5dbc14f8be616a9297eaa857c9be526b4d849 WatchSource:0}: Error finding container 6350da3ef26385eef0d78a900ec5dbc14f8be616a9297eaa857c9be526b4d849: Status 404 returned error can't find the container with id 6350da3ef26385eef0d78a900ec5dbc14f8be616a9297eaa857c9be526b4d849
Jul 27 19:24:02.536091 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:24:02.536044    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode72fd04c_f910_4da6_8016_961a2ffbd03a.slice/crio-3b304fd10167b74b005f811977b74b93342a2deee82a7b25dff7ddf834210e1d WatchSource:0}: Error finding container 3b304fd10167b74b005f811977b74b93342a2deee82a7b25dff7ddf834210e1d: Status 404 returned error can't find the container with id 3b304fd10167b74b005f811977b74b93342a2deee82a7b25dff7ddf834210e1d
Jul 27 19:24:02.536906 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:24:02.536871    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37d0a7e_9b06_466c_b418_260adcf95f6d.slice/crio-486e5f10792f89348d6d4b6112ff15fb72c8dc09f80179e93041b9ea0f83a7a7 WatchSource:0}: Error finding container 486e5f10792f89348d6d4b6112ff15fb72c8dc09f80179e93041b9ea0f83a7a7: Status 404 returned error can't find the container with id 486e5f10792f89348d6d4b6112ff15fb72c8dc09f80179e93041b9ea0f83a7a7
Jul 27 19:24:02.537969 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:24:02.537706    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8392f991_ec23_4757_a28d_2e42885d4d03.slice/crio-be20f52a4fd2e78efe89aa39d83ac9ca5704f726f878ed488b85a878e79656e1 WatchSource:0}: Error finding container be20f52a4fd2e78efe89aa39d83ac9ca5704f726f878ed488b85a878e79656e1: Status 404 returned error can't find the container with id be20f52a4fd2e78efe89aa39d83ac9ca5704f726f878ed488b85a878e79656e1
Jul 27 19:24:02.539454 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:24:02.539414    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dacadb1_e426_447b_ad6c_1a442ef7013a.slice/crio-3b02818aeb4031ac05ac8455d47f3cc45345acb9c32009a91830dfc047337c98 WatchSource:0}: Error finding container 3b02818aeb4031ac05ac8455d47f3cc45345acb9c32009a91830dfc047337c98: Status 404 returned error can't find the container with id 3b02818aeb4031ac05ac8455d47f3cc45345acb9c32009a91830dfc047337c98
Jul 27 19:24:02.934224 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:02.933943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:02.934224 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:02.934183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t8mv\" (UniqueName: \"kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv\") pod \"network-check-target-mjn75\" (UID: \"815db620-bf60-497a-8626-a1769ac6aba0\") " pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:02.934224 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:02.934226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:02.934458 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:02.934123    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:02.934458 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:02.934308    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs podName:1ee028dc-ad1f-43c4-9ada-e2ed9807fca6 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:04.934287432 +0000 UTC m=+6.077491807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs") pod "network-metrics-daemon-wqcm5" (UID: "1ee028dc-ad1f-43c4-9ada-e2ed9807fca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:02.934458 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:02.934310    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:02.934458 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:02.934339    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:24:02.934458 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:02.934353    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret podName:abaf6ffd-f230-4961-b59a-f91809572149 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:04.934341819 +0000 UTC m=+6.077546174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret") pod "global-pull-secret-syncer-qb6nb" (UID: "abaf6ffd-f230-4961-b59a-f91809572149") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:02.934458 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:02.934357    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:24:02.934458 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:02.934371    2563 projected.go:196] Error preparing data for projected volume kube-api-access-2t8mv for pod openshift-network-diagnostics/network-check-target-mjn75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:02.934458 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:02.934421    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv podName:815db620-bf60-497a-8626-a1769ac6aba0 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:04.934406822 +0000 UTC m=+6.077611199 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2t8mv" (UniqueName: "kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv") pod "network-check-target-mjn75" (UID: "815db620-bf60-497a-8626-a1769ac6aba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:03.261332 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.261234    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:19:01 +0000 UTC" deadline="2028-02-29 03:39:35.876236195 +0000 UTC"
Jul 27 19:24:03.261332 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.261280    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13952h15m32.614961231s"
Jul 27 19:24:03.369026 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.368980    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:03.369220 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:03.369154    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:03.369608 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.369588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:03.369718 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:03.369691    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:03.384678 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.384375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw" event={"ID":"c5d2c331-be77-490e-bb57-c78d3e09e21c","Type":"ContainerStarted","Data":"ed950ebbbae010f1b92948f9cc7675dcafab7527afa6f5ec3bc4ac034175254e"}
Jul 27 19:24:03.405144 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.400788    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb9ebedfe6a8b607452b06b7cd565ebb" containerID="d3476d91fa461c100a3ace929ff3ea226f40793cd0e84a568243c6eb6f0b05bc" exitCode=0
Jul 27 19:24:03.405144 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.400942    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" event={"ID":"fb9ebedfe6a8b607452b06b7cd565ebb","Type":"ContainerDied","Data":"d3476d91fa461c100a3ace929ff3ea226f40793cd0e84a568243c6eb6f0b05bc"}
Jul 27 19:24:03.422196 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.422162    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jpcp7" event={"ID":"5dacadb1-e426-447b-ad6c-1a442ef7013a","Type":"ContainerStarted","Data":"3b02818aeb4031ac05ac8455d47f3cc45345acb9c32009a91830dfc047337c98"}
Jul 27 19:24:03.442923 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.442833    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fwktm" event={"ID":"1b870247-d7eb-4d04-a55a-5ba6e52e4aa6","Type":"ContainerStarted","Data":"5ad33c7ca107e98559d0a0fec037d19caeba94c72db005b7a38dc8ed68cb8fc9"}
Jul 27 19:24:03.457394 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.457264    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-snkr9" event={"ID":"3a470f90-abba-44f8-a6d4-56f84091326c","Type":"ContainerStarted","Data":"c612934226db8eab2bc167e0202d8c384e6a7cf8bb340a4c4887c10dc8b3d8cd"}
Jul 27 19:24:03.467685 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.467652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal" event={"ID":"71d2293077aeb4f0cb21942afdf2229b","Type":"ContainerStarted","Data":"03a232d662153629eb33e5ec2c8e094fe2fff8f72b47a48ec02c2626bd6a1063"}
Jul 27 19:24:03.480785 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.480506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dqgq8" event={"ID":"8392f991-ec23-4757-a28d-2e42885d4d03","Type":"ContainerStarted","Data":"be20f52a4fd2e78efe89aa39d83ac9ca5704f726f878ed488b85a878e79656e1"}
Jul 27 19:24:03.493624 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.493463    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal" podStartSLOduration=2.493444422 podStartE2EDuration="2.493444422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:03.49254115 +0000 UTC m=+4.635745530" watchObservedRunningTime="2026-07-27 19:24:03.493444422 +0000 UTC m=+4.636648803"
Jul 27 19:24:03.498288 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.498258    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw" event={"ID":"e37d0a7e-9b06-466c-b418-260adcf95f6d","Type":"ContainerStarted","Data":"486e5f10792f89348d6d4b6112ff15fb72c8dc09f80179e93041b9ea0f83a7a7"}
Jul 27 19:24:03.514165 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.514064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7vb5t" event={"ID":"a8660bdd-6abd-4726-adf7-4802172dda7b","Type":"ContainerStarted","Data":"6350da3ef26385eef0d78a900ec5dbc14f8be616a9297eaa857c9be526b4d849"}
Jul 27 19:24:03.520040 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.520011    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5qhd8" event={"ID":"e72fd04c-f910-4da6-8016-961a2ffbd03a","Type":"ContainerStarted","Data":"3b304fd10167b74b005f811977b74b93342a2deee82a7b25dff7ddf834210e1d"}
Jul 27 19:24:03.533882 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:03.533850    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9nvmk" event={"ID":"4499a910-b91a-4ee7-af77-2e23b18f0d09","Type":"ContainerStarted","Data":"42df4d6545b595ebfb2abf52884f83d19a73217ed6ecec34fd7d631f0897063a"}
Jul 27 19:24:04.366829 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:04.366793    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:04.367413 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:04.366943    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:04.546764 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:04.546681    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" event={"ID":"fb9ebedfe6a8b607452b06b7cd565ebb","Type":"ContainerStarted","Data":"0de4932c14b4b86053e4f2d303eb1c24bc44b542335e87379a18ff385b63a196"}
Jul 27 19:24:04.567433 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:04.567370    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" podStartSLOduration=3.567349252 podStartE2EDuration="3.567349252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:04.566512419 +0000 UTC m=+5.709716801" watchObservedRunningTime="2026-07-27 19:24:04.567349252 +0000 UTC m=+5.710553624"
Jul 27 19:24:04.952491 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:04.951517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:04.952491 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:04.951576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t8mv\" (UniqueName: \"kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv\") pod \"network-check-target-mjn75\" (UID: \"815db620-bf60-497a-8626-a1769ac6aba0\") " pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:04.952491 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:04.951631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:04.952491 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:04.951759    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:04.952491 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:04.951822    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret podName:abaf6ffd-f230-4961-b59a-f91809572149 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:08.951803495 +0000 UTC m=+10.095007852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret") pod "global-pull-secret-syncer-qb6nb" (UID: "abaf6ffd-f230-4961-b59a-f91809572149") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:04.952491 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:04.952242    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:04.952491 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:04.952296    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs podName:1ee028dc-ad1f-43c4-9ada-e2ed9807fca6 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:08.952278196 +0000 UTC m=+10.095482553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs") pod "network-metrics-daemon-wqcm5" (UID: "1ee028dc-ad1f-43c4-9ada-e2ed9807fca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:04.952491 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:04.952375    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:24:04.952491 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:04.952388    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:24:04.952491 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:04.952401    2563 projected.go:196] Error preparing data for projected volume kube-api-access-2t8mv for pod openshift-network-diagnostics/network-check-target-mjn75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:04.952491 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:04.952436    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv podName:815db620-bf60-497a-8626-a1769ac6aba0 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:08.952423634 +0000 UTC m=+10.095627991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2t8mv" (UniqueName: "kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv") pod "network-check-target-mjn75" (UID: "815db620-bf60-497a-8626-a1769ac6aba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:05.369217 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:05.369146    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:05.369638 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:05.369295    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:05.370688 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:05.370664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:05.370811 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:05.370781    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:06.367168 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:06.366664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:06.367168 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:06.366795    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:07.367190 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:07.367156    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:07.367594 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:07.367156    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:07.367594 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:07.367297    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:07.367594 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:07.367353    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:08.366943 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:08.366898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:08.367153 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:08.367020    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:08.985077 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:08.985007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:08.985077 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:08.985071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t8mv\" (UniqueName: \"kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv\") pod \"network-check-target-mjn75\" (UID: \"815db620-bf60-497a-8626-a1769ac6aba0\") " pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:08.985627 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:08.985120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:08.985627 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:08.985189    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:08.985627 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:08.985249    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs podName:1ee028dc-ad1f-43c4-9ada-e2ed9807fca6 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:16.985231825 +0000 UTC m=+18.128436194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs") pod "network-metrics-daemon-wqcm5" (UID: "1ee028dc-ad1f-43c4-9ada-e2ed9807fca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:08.985627 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:08.985257    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:24:08.985627 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:08.985270    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:24:08.985627 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:08.985281    2563 projected.go:196] Error preparing data for projected volume kube-api-access-2t8mv for pod openshift-network-diagnostics/network-check-target-mjn75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:08.985627 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:08.985314    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv podName:815db620-bf60-497a-8626-a1769ac6aba0 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:16.985303399 +0000 UTC m=+18.128507752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2t8mv" (UniqueName: "kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv") pod "network-check-target-mjn75" (UID: "815db620-bf60-497a-8626-a1769ac6aba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:08.985627 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:08.985195    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:08.985627 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:08.985349    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret podName:abaf6ffd-f230-4961-b59a-f91809572149 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:16.985340888 +0000 UTC m=+18.128545243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret") pod "global-pull-secret-syncer-qb6nb" (UID: "abaf6ffd-f230-4961-b59a-f91809572149") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:09.367876 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:09.367840    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:09.368068 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:09.367885    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:09.368068 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:09.367957    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:09.368068 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:09.368011    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:10.366315 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:10.366281    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:10.366770 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:10.366420    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:11.366854 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:11.366151    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:11.366854 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:11.366289    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:11.366854 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:11.366710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:11.366854 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:11.366813    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:12.366181 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:12.366153    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:12.366332 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:12.366251    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:13.366517 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:13.366487    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:13.366912 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:13.366668    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:13.366912 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:13.366687    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:13.366912 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:13.366814    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:14.366463 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:14.366433    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:14.366683 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:14.366542    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:15.366866 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:15.366830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:15.367345 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:15.366960    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:15.367345 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:15.367341    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:15.367519 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:15.367453    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:16.366014 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:16.365972    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:16.366260 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:16.366118    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:17.043384 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:17.043355    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:17.043829 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:17.043410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:17.043829 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:17.043443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t8mv\" (UniqueName: \"kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv\") pod \"network-check-target-mjn75\" (UID: \"815db620-bf60-497a-8626-a1769ac6aba0\") " pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:17.043829 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:17.043528    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:17.043829 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:17.043587    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:17.043829 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:17.043604    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret podName:abaf6ffd-f230-4961-b59a-f91809572149 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:33.043583173 +0000 UTC m=+34.186787543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret") pod "global-pull-secret-syncer-qb6nb" (UID: "abaf6ffd-f230-4961-b59a-f91809572149") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:17.043829 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:17.043638    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs podName:1ee028dc-ad1f-43c4-9ada-e2ed9807fca6 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:33.043619562 +0000 UTC m=+34.186823916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs") pod "network-metrics-daemon-wqcm5" (UID: "1ee028dc-ad1f-43c4-9ada-e2ed9807fca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:17.043829 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:17.043540    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:24:17.043829 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:17.043661    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:24:17.043829 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:17.043675    2563 projected.go:196] Error preparing data for projected volume kube-api-access-2t8mv for pod openshift-network-diagnostics/network-check-target-mjn75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:17.043829 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:17.043703    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv podName:815db620-bf60-497a-8626-a1769ac6aba0 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:33.043695953 +0000 UTC m=+34.186900307 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2t8mv" (UniqueName: "kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv") pod "network-check-target-mjn75" (UID: "815db620-bf60-497a-8626-a1769ac6aba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:17.366528 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:17.366502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:17.366528 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:17.366522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:17.366758 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:17.366647    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:17.366818 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:17.366757    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:18.366224 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:18.366191    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:18.366635 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:18.366298    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:19.367692 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:19.367655    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:19.368171 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:19.367749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:19.368171 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:19.367766    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:19.368171 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:19.367856    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:20.366263 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:20.366228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:20.366452 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:20.366357    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:21.366588 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.366402    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:21.367490 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.366449    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:21.367490 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:21.366666    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:21.367490 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:21.366735    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:21.585698 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.585484    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dqgq8" event={"ID":"8392f991-ec23-4757-a28d-2e42885d4d03","Type":"ContainerStarted","Data":"84cc7b414d97e2fe72f45c242175a3806bee40f33b61384b4eacae8cf925470e"}
Jul 27 19:24:21.588386 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.588360    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw" event={"ID":"e37d0a7e-9b06-466c-b418-260adcf95f6d","Type":"ContainerStarted","Data":"cd3c7a2db192dab4d249e5aab1f4a04a6ea32b6a962b5f0d84032091ee688477"}
Jul 27 19:24:21.589860 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.589834    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7vb5t" event={"ID":"a8660bdd-6abd-4726-adf7-4802172dda7b","Type":"ContainerStarted","Data":"83bbac3ff59efbe6d0ad1c0f5f4487eb9f5dd492af568c13da00562e3950e74b"}
Jul 27 19:24:21.591261 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.591239    2563 generic.go:356] "Generic (PLEG): container finished" podID="e72fd04c-f910-4da6-8016-961a2ffbd03a" containerID="00f6030ebb1cbc0c30d76026fd7f31be6945d7060cbc3ae7c974dd51cf7d159d" exitCode=0
Jul 27 19:24:21.591359 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.591313    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5qhd8" event={"ID":"e72fd04c-f910-4da6-8016-961a2ffbd03a","Type":"ContainerDied","Data":"00f6030ebb1cbc0c30d76026fd7f31be6945d7060cbc3ae7c974dd51cf7d159d"}
Jul 27 19:24:21.592990 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.592965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9nvmk" event={"ID":"4499a910-b91a-4ee7-af77-2e23b18f0d09","Type":"ContainerStarted","Data":"98a9fa0a763228adf34e1f01fd2432f6f708fe6d3d159052fdde642e2d2946cb"}
Jul 27 19:24:21.595218 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.595199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw" event={"ID":"c5d2c331-be77-490e-bb57-c78d3e09e21c","Type":"ContainerStarted","Data":"e03d159207700e4d608cc87e5a42197cb8cad42e5aba0a2f51403772e87028ca"}
Jul 27 19:24:21.595324 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.595273    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw" event={"ID":"c5d2c331-be77-490e-bb57-c78d3e09e21c","Type":"ContainerStarted","Data":"f275a140c2649b37768589c54e334f2d028e4527b41bed3fd3fcb4968a331026"}
Jul 27 19:24:21.595392 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.595338    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw" event={"ID":"c5d2c331-be77-490e-bb57-c78d3e09e21c","Type":"ContainerStarted","Data":"a6ff5ae92cea11b34917b828333718cfa3cc45e2d31cb4d3eab0f271fcb237ae"}
Jul 27 19:24:21.596576 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.596555    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jpcp7" event={"ID":"5dacadb1-e426-447b-ad6c-1a442ef7013a","Type":"ContainerStarted","Data":"c673bcc5d7eab571a6cbe1d353178f36685eb97e024e2b0d897aaeb395927ea6"}
Jul 27 19:24:21.597912 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.597889    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-snkr9" event={"ID":"3a470f90-abba-44f8-a6d4-56f84091326c","Type":"ContainerStarted","Data":"08ef1c46e28b71d054eb14e3e2ffd7c4fa7614e7990bf82c1391fc0d0e6e98c7"}
Jul 27 19:24:21.605390 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.605346    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dqgq8" podStartSLOduration=4.034281736 podStartE2EDuration="22.605330314s" totalImagesPullingTime="18.571048578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:21.604986749 +0000 UTC m=+22.748191124" watchObservedRunningTime="2026-07-27 19:24:21.605330314 +0000 UTC m=+22.748534692"
Jul 27 19:24:21.625053 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.624999    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-snkr9" podStartSLOduration=11.862338041 podStartE2EDuration="22.624980164s" totalImagesPullingTime="10.762642123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:21.62482944 +0000 UTC m=+22.768033820" watchObservedRunningTime="2026-07-27 19:24:21.624980164 +0000 UTC m=+22.768184541"
Jul 27 19:24:21.650461 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.650421    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jpcp7" podStartSLOduration=4.050175764 podStartE2EDuration="22.650409297s" totalImagesPullingTime="18.600233533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:21.650259383 +0000 UTC m=+22.793463761" watchObservedRunningTime="2026-07-27 19:24:21.650409297 +0000 UTC m=+22.793613672"
Jul 27 19:24:21.669186 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.669147    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7vb5t" podStartSLOduration=4.12005914 podStartE2EDuration="22.669134748s" totalImagesPullingTime="18.549075608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:21.668679077 +0000 UTC m=+22.811883453" watchObservedRunningTime="2026-07-27 19:24:21.669134748 +0000 UTC m=+22.812339141"
Jul 27 19:24:21.720215 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:21.720173    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9nvmk" podStartSLOduration=4.164771649 podStartE2EDuration="22.72015767s" totalImagesPullingTime="18.555386021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:21.71958258 +0000 UTC m=+22.862786957" watchObservedRunningTime="2026-07-27 19:24:21.72015767 +0000 UTC m=+22.863362046"
Jul 27 19:24:22.366269 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:22.366214    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:22.366411 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:22.366313    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:22.603750 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:22.603721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw" event={"ID":"c5d2c331-be77-490e-bb57-c78d3e09e21c","Type":"ContainerStarted","Data":"3f046a959a30252a57b3ca3f47a519d013f99e1e736db12e584406322b6eb6ea"}
Jul 27 19:24:22.604272 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:22.603800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw" event={"ID":"c5d2c331-be77-490e-bb57-c78d3e09e21c","Type":"ContainerStarted","Data":"4d97a4a195d8b4d326a531aed5084fe2cf6e759450c591ff74a50fd4147b2e52"}
Jul 27 19:24:22.604272 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:22.603851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw" event={"ID":"c5d2c331-be77-490e-bb57-c78d3e09e21c","Type":"ContainerStarted","Data":"b35bb87f13f3125eec35d19a7ca4c9e877a442be9370bdb32cbbea99a7a84001"}
Jul 27 19:24:22.605269 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:22.605240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fwktm" event={"ID":"1b870247-d7eb-4d04-a55a-5ba6e52e4aa6","Type":"ContainerStarted","Data":"97e24b2885e555a71d63dfddf43a749a1af242b9f61c22143381409e8a42f941"}
Jul 27 19:24:22.761371 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:22.761347    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 19:24:23.271729 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:23.271613    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T19:24:22.761363592Z","UUID":"1df533ce-d84e-4aa1-a87c-4ac025f8d371","Handler":null,"Name":"","Endpoint":""}
Jul 27 19:24:23.273160 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:23.273137    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 19:24:23.273345 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:23.273192    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 19:24:23.366381 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:23.366352    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:23.366559 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:23.366482    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:23.366813 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:23.366793    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:23.366932 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:23.366905    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:23.610398 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:23.610328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw" event={"ID":"e37d0a7e-9b06-466c-b418-260adcf95f6d","Type":"ContainerStarted","Data":"d13ce882ff009de26629a5e935df2fffb64ce502096e2616685aceadb182df05"}
Jul 27 19:24:24.290524 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:24.290486    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-snkr9"
Jul 27 19:24:24.291211 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:24.291158    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-snkr9"
Jul 27 19:24:24.325411 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:24.325366    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fwktm" podStartSLOduration=6.775897631 podStartE2EDuration="25.32534922s" totalImagesPullingTime="18.549451589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:22.623365575 +0000 UTC m=+23.766569951" watchObservedRunningTime="2026-07-27 19:24:24.32534922 +0000 UTC m=+25.468553669"
Jul 27 19:24:24.366943 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:24.366915    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:24.367172 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:24.367051    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:24.615406 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:24.615371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw" event={"ID":"e37d0a7e-9b06-466c-b418-260adcf95f6d","Type":"ContainerStarted","Data":"e6329c9352abe5f312fd9b471ca2a56a1d9539195239ce3bf81f0f5afddd0aee"}
Jul 27 19:24:24.619370 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:24.619338    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw" event={"ID":"c5d2c331-be77-490e-bb57-c78d3e09e21c","Type":"ContainerStarted","Data":"98d52041b2db52fd9bf59a73e13185097f85eff70e1feeff3329d01932a997ce"}
Jul 27 19:24:24.619656 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:24.619634    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-snkr9"
Jul 27 19:24:24.620055 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:24.620017    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-snkr9"
Jul 27 19:24:24.639353 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:24.639310    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f9gpw" podStartSLOduration=4.4111727 podStartE2EDuration="25.639295636s" totalImagesPullingTime="21.228122936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:24.638962925 +0000 UTC m=+25.782167301" watchObservedRunningTime="2026-07-27 19:24:24.639295636 +0000 UTC m=+25.782500012"
Jul 27 19:24:24.732530 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:24.732496    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-snkr9_3a470f90-abba-44f8-a6d4-56f84091326c/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:24.828005 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:24.827951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-snkr9_3a470f90-abba-44f8-a6d4-56f84091326c/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:25.366599 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:25.366400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:25.366879 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:25.366452    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:25.366879 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:25.366730    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:25.366879 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:25.366769    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:26.366720 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:26.366702    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:26.367272 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:26.366820    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:26.628505 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:26.628471    2563 generic.go:356] "Generic (PLEG): container finished" podID="e72fd04c-f910-4da6-8016-961a2ffbd03a" containerID="8c638ee6cef54866bc9913e7ebd4fd38c84f43ecf0500bcb3aee6b9c09d61db3" exitCode=0
Jul 27 19:24:26.628640 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:26.628554    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5qhd8" event={"ID":"e72fd04c-f910-4da6-8016-961a2ffbd03a","Type":"ContainerDied","Data":"8c638ee6cef54866bc9913e7ebd4fd38c84f43ecf0500bcb3aee6b9c09d61db3"}
Jul 27 19:24:26.632362 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:26.632337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw" event={"ID":"c5d2c331-be77-490e-bb57-c78d3e09e21c","Type":"ContainerStarted","Data":"041f4c4349b71a51444994be64957e22e4c0d4a0f7df65856231111a2d950bd1"}
Jul 27 19:24:26.632757 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:26.632716    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:26.648210 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:26.648188    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:26.696445 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:26.696398    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw" podStartSLOduration=9.074281931 podStartE2EDuration="27.6963835s" totalImagesPullingTime="18.622101569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:26.695000822 +0000 UTC m=+27.838205213" watchObservedRunningTime="2026-07-27 19:24:26.6963835 +0000 UTC m=+27.839587876"
Jul 27 19:24:27.366472 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:27.366215    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:27.366472 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:27.366284    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:27.366701 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:27.366466    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:27.366701 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:27.366560    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:27.636156 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:27.636064    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:27.636156 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:27.636155    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:27.654620 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:27.654594    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:24:27.699162 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:27.699133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-snkr9_3a470f90-abba-44f8-a6d4-56f84091326c/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:27.781819 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:27.781792    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-snkr9_3a470f90-abba-44f8-a6d4-56f84091326c/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:28.366470 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:28.366436    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:28.366605 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:28.366535    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:28.639948 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:28.639868    2563 generic.go:356] "Generic (PLEG): container finished" podID="e72fd04c-f910-4da6-8016-961a2ffbd03a" containerID="fe299a4fa588f35579cca127f64418ad9d6759a7b0913ce9ee0f9414fc90e4e0" exitCode=0
Jul 27 19:24:28.640285 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:28.639950    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5qhd8" event={"ID":"e72fd04c-f910-4da6-8016-961a2ffbd03a","Type":"ContainerDied","Data":"fe299a4fa588f35579cca127f64418ad9d6759a7b0913ce9ee0f9414fc90e4e0"}
Jul 27 19:24:28.987707 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:28.987637    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qb6nb"]
Jul 27 19:24:28.987850 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:28.987728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:28.987850 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:28.987813    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:28.991921 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:28.991888    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mjn75"]
Jul 27 19:24:28.992085 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:28.991996    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:28.992155 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:28.992114    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:28.992558 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:28.992530    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wqcm5"]
Jul 27 19:24:28.992659 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:28.992642    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:28.992796 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:28.992745    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:29.076773 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:29.076737    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-snkr9_3a470f90-abba-44f8-a6d4-56f84091326c/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:29.177078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:29.177048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-snkr9_3a470f90-abba-44f8-a6d4-56f84091326c/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:29.907946 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:29.907913    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-snkr9_3a470f90-abba-44f8-a6d4-56f84091326c/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:30.366756 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:30.366540    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:30.366880 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:30.366664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:30.366880 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:30.366795    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:30.366971 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:30.366916    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:30.646303 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:30.646235    2563 generic.go:356] "Generic (PLEG): container finished" podID="e72fd04c-f910-4da6-8016-961a2ffbd03a" containerID="f490832b3d9d9521fbef26a0636a22b72c9282aa39fb621b1448b21c123cdd04" exitCode=0
Jul 27 19:24:30.646303 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:30.646287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5qhd8" event={"ID":"e72fd04c-f910-4da6-8016-961a2ffbd03a","Type":"ContainerDied","Data":"f490832b3d9d9521fbef26a0636a22b72c9282aa39fb621b1448b21c123cdd04"}
Jul 27 19:24:31.366855 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:31.366830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:31.367216 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:31.366922    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:32.366637 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:32.366602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:32.366637 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:32.366616    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:32.366880 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:32.366717    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjn75" podUID="815db620-bf60-497a-8626-a1769ac6aba0"
Jul 27 19:24:32.366880 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:32.366858    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqcm5" podUID="1ee028dc-ad1f-43c4-9ada-e2ed9807fca6"
Jul 27 19:24:33.060014 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.059965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:33.060255 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.060048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t8mv\" (UniqueName: \"kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv\") pod \"network-check-target-mjn75\" (UID: \"815db620-bf60-497a-8626-a1769ac6aba0\") " pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:33.060255 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.060096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:33.060255 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:33.060124    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:33.060255 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:33.060158    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:24:33.060255 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:33.060179    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:24:33.060255 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:33.060185    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs podName:1ee028dc-ad1f-43c4-9ada-e2ed9807fca6 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:05.060163878 +0000 UTC m=+66.203368232 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs") pod "network-metrics-daemon-wqcm5" (UID: "1ee028dc-ad1f-43c4-9ada-e2ed9807fca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:33.060255 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:33.060189    2563 projected.go:196] Error preparing data for projected volume kube-api-access-2t8mv for pod openshift-network-diagnostics/network-check-target-mjn75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:33.060255 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:33.060193    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:33.060255 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:33.060233    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv podName:815db620-bf60-497a-8626-a1769ac6aba0 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:05.060217293 +0000 UTC m=+66.203421647 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2t8mv" (UniqueName: "kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv") pod "network-check-target-mjn75" (UID: "815db620-bf60-497a-8626-a1769ac6aba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:33.060255 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:33.060253    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret podName:abaf6ffd-f230-4961-b59a-f91809572149 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:05.060244464 +0000 UTC m=+66.203448823 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret") pod "global-pull-secret-syncer-qb6nb" (UID: "abaf6ffd-f230-4961-b59a-f91809572149") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:33.366843 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.366764    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:33.366995 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:33.366909    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qb6nb" podUID="abaf6ffd-f230-4961-b59a-f91809572149"
Jul 27 19:24:33.664609 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.664533    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeReady"
Jul 27 19:24:33.664756 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.664668    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 19:24:33.711886 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.711853    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k9hgr"]
Jul 27 19:24:33.714543 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.714523    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:33.717443 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.717398    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-btlr9"]
Jul 27 19:24:33.717929 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.717618    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 19:24:33.717929 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.717702    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 19:24:33.717929 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.717723    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ksszw\""
Jul 27 19:24:33.719540 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.719522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-btlr9"
Jul 27 19:24:33.722368 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.722350    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 19:24:33.722482 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.722436    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ssdbw\""
Jul 27 19:24:33.722733 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.722713    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 19:24:33.722836 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.722744    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 19:24:33.726817 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.726796    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k9hgr"]
Jul 27 19:24:33.731173 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.731152    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-btlr9"]
Jul 27 19:24:33.865663 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.865625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/522704f3-186a-4309-a226-0945f5a689a7-tmp-dir\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:33.865843 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.865732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdwtc\" (UniqueName: \"kubernetes.io/projected/5bf266a9-0698-4a82-ad9f-1ffeaf0581fd-kube-api-access-mdwtc\") pod \"ingress-canary-btlr9\" (UID: \"5bf266a9-0698-4a82-ad9f-1ffeaf0581fd\") " pod="openshift-ingress-canary/ingress-canary-btlr9"
Jul 27 19:24:33.865843 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.865764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp7cr\" (UniqueName: \"kubernetes.io/projected/522704f3-186a-4309-a226-0945f5a689a7-kube-api-access-xp7cr\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:33.865843 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.865808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:33.865973 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.865857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/522704f3-186a-4309-a226-0945f5a689a7-config-volume\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:33.865973 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.865881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bf266a9-0698-4a82-ad9f-1ffeaf0581fd-cert\") pod \"ingress-canary-btlr9\" (UID: \"5bf266a9-0698-4a82-ad9f-1ffeaf0581fd\") " pod="openshift-ingress-canary/ingress-canary-btlr9"
Jul 27 19:24:33.967007 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.966927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/522704f3-186a-4309-a226-0945f5a689a7-config-volume\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:33.967007 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.966980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bf266a9-0698-4a82-ad9f-1ffeaf0581fd-cert\") pod \"ingress-canary-btlr9\" (UID: \"5bf266a9-0698-4a82-ad9f-1ffeaf0581fd\") " pod="openshift-ingress-canary/ingress-canary-btlr9"
Jul 27 19:24:33.967236 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.967116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/522704f3-186a-4309-a226-0945f5a689a7-tmp-dir\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:33.967236 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.967183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdwtc\" (UniqueName: \"kubernetes.io/projected/5bf266a9-0698-4a82-ad9f-1ffeaf0581fd-kube-api-access-mdwtc\") pod \"ingress-canary-btlr9\" (UID: \"5bf266a9-0698-4a82-ad9f-1ffeaf0581fd\") " pod="openshift-ingress-canary/ingress-canary-btlr9"
Jul 27 19:24:33.967236 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.967214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp7cr\" (UniqueName: \"kubernetes.io/projected/522704f3-186a-4309-a226-0945f5a689a7-kube-api-access-xp7cr\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:33.967403 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.967260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:33.967403 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:33.967392    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:33.967505 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.967412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/522704f3-186a-4309-a226-0945f5a689a7-tmp-dir\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:33.967505 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:33.967446    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls podName:522704f3-186a-4309-a226-0945f5a689a7 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:34.467430335 +0000 UTC m=+35.610634705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls") pod "dns-default-k9hgr" (UID: "522704f3-186a-4309-a226-0945f5a689a7") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:33.968212 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.968182    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/522704f3-186a-4309-a226-0945f5a689a7-config-volume\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:33.972029 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.972008    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bf266a9-0698-4a82-ad9f-1ffeaf0581fd-cert\") pod \"ingress-canary-btlr9\" (UID: \"5bf266a9-0698-4a82-ad9f-1ffeaf0581fd\") " pod="openshift-ingress-canary/ingress-canary-btlr9"
Jul 27 19:24:33.980141 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.980106    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp7cr\" (UniqueName: \"kubernetes.io/projected/522704f3-186a-4309-a226-0945f5a689a7-kube-api-access-xp7cr\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:33.980247 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:33.980206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdwtc\" (UniqueName: \"kubernetes.io/projected/5bf266a9-0698-4a82-ad9f-1ffeaf0581fd-kube-api-access-mdwtc\") pod \"ingress-canary-btlr9\" (UID: \"5bf266a9-0698-4a82-ad9f-1ffeaf0581fd\") " pod="openshift-ingress-canary/ingress-canary-btlr9"
Jul 27 19:24:34.035168 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:34.035134    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-btlr9"
Jul 27 19:24:34.366143 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:34.366098    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:24:34.366143 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:34.366138    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:24:34.369472 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:34.369449    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:24:34.369472 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:34.369464    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9nf99\""
Jul 27 19:24:34.370131 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:34.369464    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:24:34.371062 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:34.370772    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:24:34.371062 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:34.370823    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v6qr\""
Jul 27 19:24:34.471147 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:34.471115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:34.471314 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:34.471298    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:34.471398 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:34.471387    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls podName:522704f3-186a-4309-a226-0945f5a689a7 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:35.471364862 +0000 UTC m=+36.614569221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls") pod "dns-default-k9hgr" (UID: "522704f3-186a-4309-a226-0945f5a689a7") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:35.077535 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:35.077352    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-btlr9"]
Jul 27 19:24:35.082681 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:24:35.082652    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf266a9_0698_4a82_ad9f_1ffeaf0581fd.slice/crio-e6aed9b4e4aa4d61f0111e58831e8a5d179073b910dfb22d9d0d9ab6e3caefae WatchSource:0}: Error finding container e6aed9b4e4aa4d61f0111e58831e8a5d179073b910dfb22d9d0d9ab6e3caefae: Status 404 returned error can't find the container with id e6aed9b4e4aa4d61f0111e58831e8a5d179073b910dfb22d9d0d9ab6e3caefae
Jul 27 19:24:35.369595 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:35.369573    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:24:35.373115 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:35.373099    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:24:35.478769 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:35.478740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:35.478925 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:35.478855    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:35.478925 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:35.478914    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls podName:522704f3-186a-4309-a226-0945f5a689a7 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:37.478893497 +0000 UTC m=+38.622097855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls") pod "dns-default-k9hgr" (UID: "522704f3-186a-4309-a226-0945f5a689a7") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:35.664286 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:35.664209    2563 generic.go:356] "Generic (PLEG): container finished" podID="e72fd04c-f910-4da6-8016-961a2ffbd03a" containerID="e3330d13da0363ca4eaa8cba608ac08c629f606678b577be99802a11fd6de542" exitCode=0
Jul 27 19:24:35.664440 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:35.664301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5qhd8" event={"ID":"e72fd04c-f910-4da6-8016-961a2ffbd03a","Type":"ContainerDied","Data":"e3330d13da0363ca4eaa8cba608ac08c629f606678b577be99802a11fd6de542"}
Jul 27 19:24:35.665611 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:35.665583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-btlr9" event={"ID":"5bf266a9-0698-4a82-ad9f-1ffeaf0581fd","Type":"ContainerStarted","Data":"e6aed9b4e4aa4d61f0111e58831e8a5d179073b910dfb22d9d0d9ab6e3caefae"}
Jul 27 19:24:36.671007 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:36.670974    2563 generic.go:356] "Generic (PLEG): container finished" podID="e72fd04c-f910-4da6-8016-961a2ffbd03a" containerID="a52dd6ddbd7f4c242eb25ab2b30dc3214af3e501e11ecf56ff534f07196b47c3" exitCode=0
Jul 27 19:24:36.671532 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:36.671059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5qhd8" event={"ID":"e72fd04c-f910-4da6-8016-961a2ffbd03a","Type":"ContainerDied","Data":"a52dd6ddbd7f4c242eb25ab2b30dc3214af3e501e11ecf56ff534f07196b47c3"}
Jul 27 19:24:37.495101 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:37.495078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:37.495203 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:37.495193    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:37.495254 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:37.495237    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls podName:522704f3-186a-4309-a226-0945f5a689a7 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:41.495225007 +0000 UTC m=+42.638429360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls") pod "dns-default-k9hgr" (UID: "522704f3-186a-4309-a226-0945f5a689a7") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:37.676751 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:37.676722    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5qhd8" event={"ID":"e72fd04c-f910-4da6-8016-961a2ffbd03a","Type":"ContainerStarted","Data":"6fb6c2f665b150625d039ab6730934ed8dc97bee7ab98f98e36f69e0926d6531"}
Jul 27 19:24:37.711252 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:37.711169    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5qhd8" podStartSLOduration=8.982332278 podStartE2EDuration="38.711153912s" totalImagesPullingTime="29.728821634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:37.709243693 +0000 UTC m=+38.852448069" watchObservedRunningTime="2026-07-27 19:24:37.711153912 +0000 UTC m=+38.854358287"
Jul 27 19:24:38.681238 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:38.680994    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-btlr9" event={"ID":"5bf266a9-0698-4a82-ad9f-1ffeaf0581fd","Type":"ContainerStarted","Data":"4385ad793f915720027f84d0ddfa6603ae03d338af32a5237aa51bb8f0ac1d80"}
Jul 27 19:24:38.704233 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:38.704185    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-btlr9" podStartSLOduration=2.969535089 podStartE2EDuration="5.704170638s" totalImagesPullingTime="2.734635549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:38.703256084 +0000 UTC m=+39.846460461" watchObservedRunningTime="2026-07-27 19:24:38.704170638 +0000 UTC m=+39.847374993"
Jul 27 19:24:41.520221 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:41.520181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:41.520570 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:41.520304    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:41.520570 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:41.520357    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls podName:522704f3-186a-4309-a226-0945f5a689a7 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:49.520342567 +0000 UTC m=+50.663546920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls") pod "dns-default-k9hgr" (UID: "522704f3-186a-4309-a226-0945f5a689a7") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:49.568937 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:49.568907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:24:49.569393 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:49.569071    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:49.569393 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:24:49.569148    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls podName:522704f3-186a-4309-a226-0945f5a689a7 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:05.56911741 +0000 UTC m=+66.712321764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls") pod "dns-default-k9hgr" (UID: "522704f3-186a-4309-a226-0945f5a689a7") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:59.664348 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:24:59.664316    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nkqw"
Jul 27 19:25:05.074520 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.074467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:25:05.074520 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.074531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:25:05.075062 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.074558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t8mv\" (UniqueName: \"kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv\") pod \"network-check-target-mjn75\" (UID: \"815db620-bf60-497a-8626-a1769ac6aba0\") " pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:25:05.078293 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.078275    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:25:05.078523 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.078504    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:25:05.078612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.078506    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:25:05.084999 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:05.084980    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 19:25:05.085078 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:05.085066    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs podName:1ee028dc-ad1f-43c4-9ada-e2ed9807fca6 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:09.085032261 +0000 UTC m=+130.228236614 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs") pod "network-metrics-daemon-wqcm5" (UID: "1ee028dc-ad1f-43c4-9ada-e2ed9807fca6") : secret "metrics-daemon-secret" not found
Jul 27 19:25:05.088498 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.088477    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:25:05.089008 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.088991    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abaf6ffd-f230-4961-b59a-f91809572149-original-pull-secret\") pod \"global-pull-secret-syncer-qb6nb\" (UID: \"abaf6ffd-f230-4961-b59a-f91809572149\") " pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:25:05.097501 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.097482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t8mv\" (UniqueName: \"kubernetes.io/projected/815db620-bf60-497a-8626-a1769ac6aba0-kube-api-access-2t8mv\") pod \"network-check-target-mjn75\" (UID: \"815db620-bf60-497a-8626-a1769ac6aba0\") " pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:25:05.281721 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.281689    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9nf99\""
Jul 27 19:25:05.288759 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.288741    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:25:05.377229 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.377206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qb6nb"
Jul 27 19:25:05.418248 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.418172    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mjn75"]
Jul 27 19:25:05.421698 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:25:05.421674    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815db620_bf60_497a_8626_a1769ac6aba0.slice/crio-8cbee3f1596929ef2450c7acaf8381340db1d9ab1c6a0421547a5c654bf1001a WatchSource:0}: Error finding container 8cbee3f1596929ef2450c7acaf8381340db1d9ab1c6a0421547a5c654bf1001a: Status 404 returned error can't find the container with id 8cbee3f1596929ef2450c7acaf8381340db1d9ab1c6a0421547a5c654bf1001a
Jul 27 19:25:05.508942 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.508909    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qb6nb"]
Jul 27 19:25:05.512121 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:25:05.512100    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabaf6ffd_f230_4961_b59a_f91809572149.slice/crio-16b773aab9bacb2dd2c34f4cfa8bae116e3ae3aaae97ad975393085386e17d1a WatchSource:0}: Error finding container 16b773aab9bacb2dd2c34f4cfa8bae116e3ae3aaae97ad975393085386e17d1a: Status 404 returned error can't find the container with id 16b773aab9bacb2dd2c34f4cfa8bae116e3ae3aaae97ad975393085386e17d1a
Jul 27 19:25:05.578466 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.578443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:25:05.578607 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:05.578590    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:25:05.578655 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:05.578647    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls podName:522704f3-186a-4309-a226-0945f5a689a7 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:37.578631616 +0000 UTC m=+98.721835969 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls") pod "dns-default-k9hgr" (UID: "522704f3-186a-4309-a226-0945f5a689a7") : secret "dns-default-metrics-tls" not found
Jul 27 19:25:05.742831 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.742754    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mjn75" event={"ID":"815db620-bf60-497a-8626-a1769ac6aba0","Type":"ContainerStarted","Data":"8cbee3f1596929ef2450c7acaf8381340db1d9ab1c6a0421547a5c654bf1001a"}
Jul 27 19:25:05.743736 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:05.743716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qb6nb" event={"ID":"abaf6ffd-f230-4961-b59a-f91809572149","Type":"ContainerStarted","Data":"16b773aab9bacb2dd2c34f4cfa8bae116e3ae3aaae97ad975393085386e17d1a"}
Jul 27 19:25:10.757624 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:10.757585    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qb6nb" event={"ID":"abaf6ffd-f230-4961-b59a-f91809572149","Type":"ContainerStarted","Data":"dc91eb94be52d80062ed06742eb7388eb96882a6a208f52a160488637f5dbacd"}
Jul 27 19:25:10.758973 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:10.758949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mjn75" event={"ID":"815db620-bf60-497a-8626-a1769ac6aba0","Type":"ContainerStarted","Data":"80b7b671091011a2ba69cc6d18dc7a753b500b559ed50358ff2c668803f11fad"}
Jul 27 19:25:10.759108 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:10.759091    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:25:10.781884 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:10.781841    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qb6nb" podStartSLOduration=67.35396258 podStartE2EDuration="1m11.781829275s" totalImagesPullingTime="4.427866695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:10.781121828 +0000 UTC m=+71.924326205" watchObservedRunningTime="2026-07-27 19:25:10.781829275 +0000 UTC m=+71.925033650"
Jul 27 19:25:10.807487 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:10.807448    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mjn75" podStartSLOduration=67.292946732 podStartE2EDuration="1m11.807434658s" totalImagesPullingTime="4.514487926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:10.806972799 +0000 UTC m=+71.950177176" watchObservedRunningTime="2026-07-27 19:25:10.807434658 +0000 UTC m=+71.950639049"
Jul 27 19:25:36.313107 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.312950    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"]
Jul 27 19:25:36.315494 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.315473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:25:36.319077 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.319056    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 19:25:36.319270 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.319242    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6mz4r\""
Jul 27 19:25:36.319341 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.319254    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:36.320667 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.320650    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:36.320772 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.320687    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 19:25:36.326503 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.326482    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"]
Jul 27 19:25:36.391101 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.391080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlbww\" (UniqueName: \"kubernetes.io/projected/72c7adc9-0ba1-4493-8687-b29a191a82f1-kube-api-access-hlbww\") pod \"service-ca-operator-5d6c75f84f-nftb6\" (UID: \"72c7adc9-0ba1-4493-8687-b29a191a82f1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:25:36.391205 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.391111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/72c7adc9-0ba1-4493-8687-b29a191a82f1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-nftb6\" (UID: \"72c7adc9-0ba1-4493-8687-b29a191a82f1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:25:36.391205 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.391134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72c7adc9-0ba1-4493-8687-b29a191a82f1-config\") pod \"service-ca-operator-5d6c75f84f-nftb6\" (UID: \"72c7adc9-0ba1-4493-8687-b29a191a82f1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:25:36.413695 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.413669    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"]
Jul 27 19:25:36.415323 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.415308    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:25:36.418434 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.418414    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:36.418635 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.418586    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:36.418635 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.418615    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 19:25:36.418870 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.418857    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-k5qsx\""
Jul 27 19:25:36.418925 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.418858    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 19:25:36.429984 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.429963    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"]
Jul 27 19:25:36.491435 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.491411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6968519b-b9ce-4bbd-8c33-64fa0d0b09c8-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\" (UID: \"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:25:36.491577 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.491448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzsql\" (UniqueName: \"kubernetes.io/projected/6968519b-b9ce-4bbd-8c33-64fa0d0b09c8-kube-api-access-gzsql\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\" (UID: \"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:25:36.491577 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.491480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlbww\" (UniqueName: \"kubernetes.io/projected/72c7adc9-0ba1-4493-8687-b29a191a82f1-kube-api-access-hlbww\") pod \"service-ca-operator-5d6c75f84f-nftb6\" (UID: \"72c7adc9-0ba1-4493-8687-b29a191a82f1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:25:36.491577 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.491506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/72c7adc9-0ba1-4493-8687-b29a191a82f1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-nftb6\" (UID: \"72c7adc9-0ba1-4493-8687-b29a191a82f1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:25:36.491577 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.491539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72c7adc9-0ba1-4493-8687-b29a191a82f1-config\") pod \"service-ca-operator-5d6c75f84f-nftb6\" (UID: \"72c7adc9-0ba1-4493-8687-b29a191a82f1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:25:36.491798 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.491594    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6968519b-b9ce-4bbd-8c33-64fa0d0b09c8-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\" (UID: \"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:25:36.492129 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.492111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72c7adc9-0ba1-4493-8687-b29a191a82f1-config\") pod \"service-ca-operator-5d6c75f84f-nftb6\" (UID: \"72c7adc9-0ba1-4493-8687-b29a191a82f1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:25:36.493821 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.493801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/72c7adc9-0ba1-4493-8687-b29a191a82f1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-nftb6\" (UID: \"72c7adc9-0ba1-4493-8687-b29a191a82f1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:25:36.502217 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.502198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlbww\" (UniqueName: \"kubernetes.io/projected/72c7adc9-0ba1-4493-8687-b29a191a82f1-kube-api-access-hlbww\") pod \"service-ca-operator-5d6c75f84f-nftb6\" (UID: \"72c7adc9-0ba1-4493-8687-b29a191a82f1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:25:36.538559 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.538532    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c96857fff-n9ckm"]
Jul 27 19:25:36.540241 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.540227    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.543524 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.543503    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 19:25:36.543636 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.543545    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tgwfd\""
Jul 27 19:25:36.543636 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.543629    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 19:25:36.543975 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.543963    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 19:25:36.544166 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.544151    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 19:25:36.544393 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.544377    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 19:25:36.544607 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.544593    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 19:25:36.559764 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.559745    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c96857fff-n9ckm"]
Jul 27 19:25:36.592106 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.592050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzsql\" (UniqueName: \"kubernetes.io/projected/6968519b-b9ce-4bbd-8c33-64fa0d0b09c8-kube-api-access-gzsql\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\" (UID: \"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:25:36.592106 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.592088    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-stats-auth\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.592252 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.592110    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-default-certificate\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.592252 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.592142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6968519b-b9ce-4bbd-8c33-64fa0d0b09c8-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\" (UID: \"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:25:36.592252 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.592167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.592252 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.592191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.592252 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.592236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6968519b-b9ce-4bbd-8c33-64fa0d0b09c8-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\" (UID: \"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:25:36.592442 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.592283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn6kz\" (UniqueName: \"kubernetes.io/projected/868e3d69-1d18-4be9-abf2-4a844fb46b8a-kube-api-access-fn6kz\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.592675 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.592656    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6968519b-b9ce-4bbd-8c33-64fa0d0b09c8-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\" (UID: \"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:25:36.594541 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.594523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6968519b-b9ce-4bbd-8c33-64fa0d0b09c8-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\" (UID: \"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:25:36.609477 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.609457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzsql\" (UniqueName: \"kubernetes.io/projected/6968519b-b9ce-4bbd-8c33-64fa0d0b09c8-kube-api-access-gzsql\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\" (UID: \"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:25:36.623775 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.623752    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:25:36.692619 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.692587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.692754 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.692625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.692754 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.692656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn6kz\" (UniqueName: \"kubernetes.io/projected/868e3d69-1d18-4be9-abf2-4a844fb46b8a-kube-api-access-fn6kz\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.692754 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.692684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-stats-auth\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.692754 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.692706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-default-certificate\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.693179 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:36.693152    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:25:36.693309 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:36.693221    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs podName:868e3d69-1d18-4be9-abf2-4a844fb46b8a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:37.193199364 +0000 UTC m=+98.336403719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs") pod "router-default-5c96857fff-n9ckm" (UID: "868e3d69-1d18-4be9-abf2-4a844fb46b8a") : secret "router-metrics-certs-default" not found
Jul 27 19:25:36.693309 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:36.693249    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle podName:868e3d69-1d18-4be9-abf2-4a844fb46b8a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:37.193239086 +0000 UTC m=+98.336443453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle") pod "router-default-5c96857fff-n9ckm" (UID: "868e3d69-1d18-4be9-abf2-4a844fb46b8a") : configmap references non-existent config key: service-ca.crt
Jul 27 19:25:36.694982 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.694962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-default-certificate\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.695595 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.695571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-stats-auth\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.710336 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.710311    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn6kz\" (UniqueName: \"kubernetes.io/projected/868e3d69-1d18-4be9-abf2-4a844fb46b8a-kube-api-access-fn6kz\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:36.723375 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.723353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:25:36.744904 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.744869    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"]
Jul 27 19:25:36.748249 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:25:36.748225    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c7adc9_0ba1_4493_8687_b29a191a82f1.slice/crio-4d6879a43fe0055acb24e67cb4348306a29c5bbbaeffec9d49123699285675fe WatchSource:0}: Error finding container 4d6879a43fe0055acb24e67cb4348306a29c5bbbaeffec9d49123699285675fe: Status 404 returned error can't find the container with id 4d6879a43fe0055acb24e67cb4348306a29c5bbbaeffec9d49123699285675fe
Jul 27 19:25:36.819866 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.819793    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6" event={"ID":"72c7adc9-0ba1-4493-8687-b29a191a82f1","Type":"ContainerStarted","Data":"4d6879a43fe0055acb24e67cb4348306a29c5bbbaeffec9d49123699285675fe"}
Jul 27 19:25:36.850283 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:36.850217    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"]
Jul 27 19:25:36.853148 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:25:36.853123    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6968519b_b9ce_4bbd_8c33_64fa0d0b09c8.slice/crio-dbf2b63349b44ee98239278cc3d25f54a316a9af1754697bd5efe814c9586e17 WatchSource:0}: Error finding container dbf2b63349b44ee98239278cc3d25f54a316a9af1754697bd5efe814c9586e17: Status 404 returned error can't find the container with id dbf2b63349b44ee98239278cc3d25f54a316a9af1754697bd5efe814c9586e17
Jul 27 19:25:37.196390 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:37.196303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:37.196390 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:37.196346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:37.196586 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:37.196453    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:25:37.196586 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:37.196476    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle podName:868e3d69-1d18-4be9-abf2-4a844fb46b8a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:38.196454975 +0000 UTC m=+99.339659334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle") pod "router-default-5c96857fff-n9ckm" (UID: "868e3d69-1d18-4be9-abf2-4a844fb46b8a") : configmap references non-existent config key: service-ca.crt
Jul 27 19:25:37.196586 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:37.196504    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs podName:868e3d69-1d18-4be9-abf2-4a844fb46b8a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:38.196495248 +0000 UTC m=+99.339699602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs") pod "router-default-5c96857fff-n9ckm" (UID: "868e3d69-1d18-4be9-abf2-4a844fb46b8a") : secret "router-metrics-certs-default" not found
Jul 27 19:25:37.599393 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:37.599357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:25:37.599837 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:37.599508    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:25:37.599837 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:37.599568    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls podName:522704f3-186a-4309-a226-0945f5a689a7 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:41.599549534 +0000 UTC m=+162.742753890 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls") pod "dns-default-k9hgr" (UID: "522704f3-186a-4309-a226-0945f5a689a7") : secret "dns-default-metrics-tls" not found
Jul 27 19:25:37.824117 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:37.824075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl" event={"ID":"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8","Type":"ContainerStarted","Data":"dbf2b63349b44ee98239278cc3d25f54a316a9af1754697bd5efe814c9586e17"}
Jul 27 19:25:38.204513 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:38.204477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:38.204513 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:38.204518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:38.204843 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:38.204687    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle podName:868e3d69-1d18-4be9-abf2-4a844fb46b8a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:40.204662821 +0000 UTC m=+101.347867180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle") pod "router-default-5c96857fff-n9ckm" (UID: "868e3d69-1d18-4be9-abf2-4a844fb46b8a") : configmap references non-existent config key: service-ca.crt
Jul 27 19:25:38.204843 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:38.204707    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:25:38.204843 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:38.204762    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs podName:868e3d69-1d18-4be9-abf2-4a844fb46b8a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:40.204746526 +0000 UTC m=+101.347950880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs") pod "router-default-5c96857fff-n9ckm" (UID: "868e3d69-1d18-4be9-abf2-4a844fb46b8a") : secret "router-metrics-certs-default" not found
Jul 27 19:25:39.831318 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:39.831267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl" event={"ID":"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8","Type":"ContainerStarted","Data":"a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210"}
Jul 27 19:25:39.833101 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:39.833072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6" event={"ID":"72c7adc9-0ba1-4493-8687-b29a191a82f1","Type":"ContainerStarted","Data":"3b918c03ab3a2f9672c17506090bce2f72373112b8796f4ee21b85a044b2493d"}
Jul 27 19:25:39.852134 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:39.852077    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl" podStartSLOduration=1.520621035 podStartE2EDuration="3.852060543s" totalImagesPullingTime="2.331439508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:39.850318673 +0000 UTC m=+100.993523060" watchObservedRunningTime="2026-07-27 19:25:39.852060543 +0000 UTC m=+100.995264914"
Jul 27 19:25:39.872903 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:39.868868    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6" podStartSLOduration=1.431435446 podStartE2EDuration="3.868851518s" totalImagesPullingTime="2.437416072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:39.867760593 +0000 UTC m=+101.010964972" watchObservedRunningTime="2026-07-27 19:25:39.868851518 +0000 UTC m=+101.012055899"
Jul 27 19:25:40.222113 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.222016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:40.222113 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.222072    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:40.222285 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:40.222188    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:25:40.222285 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:40.222199    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle podName:868e3d69-1d18-4be9-abf2-4a844fb46b8a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:44.222176396 +0000 UTC m=+105.365380755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle") pod "router-default-5c96857fff-n9ckm" (UID: "868e3d69-1d18-4be9-abf2-4a844fb46b8a") : configmap references non-existent config key: service-ca.crt
Jul 27 19:25:40.222285 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:40.222232    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs podName:868e3d69-1d18-4be9-abf2-4a844fb46b8a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:44.222220783 +0000 UTC m=+105.365425138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs") pod "router-default-5c96857fff-n9ckm" (UID: "868e3d69-1d18-4be9-abf2-4a844fb46b8a") : secret "router-metrics-certs-default" not found
Jul 27 19:25:40.443973 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.443940    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gctvv"]
Jul 27 19:25:40.473897 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.473825    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gctvv"]
Jul 27 19:25:40.474018 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.473924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.476939 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.476914    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kpwnj\""
Jul 27 19:25:40.476939 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.476932    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 19:25:40.478320 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.478302    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 19:25:40.478384 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.478337    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 19:25:40.478432 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.478411    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 19:25:40.524315 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.524291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.524449 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.524341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h44df\" (UniqueName: \"kubernetes.io/projected/8da3480e-14a7-4d08-968f-c12973de8f26-kube-api-access-h44df\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.524494 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.524447    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8da3480e-14a7-4d08-968f-c12973de8f26-crio-socket\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.524494 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.524480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.524568 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.524557    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8da3480e-14a7-4d08-968f-c12973de8f26-data-volume\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.625244 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.625211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8da3480e-14a7-4d08-968f-c12973de8f26-crio-socket\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.625409 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.625248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.625409 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.625283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8da3480e-14a7-4d08-968f-c12973de8f26-data-volume\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.625409 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.625317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.625409 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.625360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44df\" (UniqueName: \"kubernetes.io/projected/8da3480e-14a7-4d08-968f-c12973de8f26-kube-api-access-h44df\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.625409 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.625359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8da3480e-14a7-4d08-968f-c12973de8f26-crio-socket\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.625770 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:40.625420    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:40.625770 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:40.625447    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:25:40.625770 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:40.625536    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm podName:8da3480e-14a7-4d08-968f-c12973de8f26 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:41.125508683 +0000 UTC m=+102.268713051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gctvv" (UID: "8da3480e-14a7-4d08-968f-c12973de8f26") : configmap "kube-rbac-proxy" not found
Jul 27 19:25:40.625770 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:40.625555    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls podName:8da3480e-14a7-4d08-968f-c12973de8f26 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:41.12554551 +0000 UTC m=+102.268749865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gctvv" (UID: "8da3480e-14a7-4d08-968f-c12973de8f26") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:40.625946 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.625923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8da3480e-14a7-4d08-968f-c12973de8f26-data-volume\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:40.639729 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:40.639699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h44df\" (UniqueName: \"kubernetes.io/projected/8da3480e-14a7-4d08-968f-c12973de8f26-kube-api-access-h44df\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:41.130259 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.130224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:41.130616 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:41.130298    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:25:41.130616 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.130323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:41.130616 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:41.130372    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm podName:8da3480e-14a7-4d08-968f-c12973de8f26 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:42.130353464 +0000 UTC m=+103.273557824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gctvv" (UID: "8da3480e-14a7-4d08-968f-c12973de8f26") : configmap "kube-rbac-proxy" not found
Jul 27 19:25:41.130616 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:41.130419    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:41.130616 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:41.130462    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls podName:8da3480e-14a7-4d08-968f-c12973de8f26 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:42.130450386 +0000 UTC m=+103.273654742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gctvv" (UID: "8da3480e-14a7-4d08-968f-c12973de8f26") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:41.405910 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.405829    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-prcmt"]
Jul 27 19:25:41.421790 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.421758    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-prcmt"]
Jul 27 19:25:41.421933 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.421865    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-prcmt"
Jul 27 19:25:41.425071 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.425029    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:41.425196 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.425030    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2d4nb\""
Jul 27 19:25:41.426487 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.426466    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 27 19:25:41.532806 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.532781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxhcm\" (UniqueName: \"kubernetes.io/projected/9b56d365-2abc-4ce5-807b-fdd6c152e48f-kube-api-access-zxhcm\") pod \"migrator-6865c9967-prcmt\" (UID: \"9b56d365-2abc-4ce5-807b-fdd6c152e48f\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-prcmt"
Jul 27 19:25:41.633372 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.633340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhcm\" (UniqueName: \"kubernetes.io/projected/9b56d365-2abc-4ce5-807b-fdd6c152e48f-kube-api-access-zxhcm\") pod \"migrator-6865c9967-prcmt\" (UID: \"9b56d365-2abc-4ce5-807b-fdd6c152e48f\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-prcmt"
Jul 27 19:25:41.644801 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.644773    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxhcm\" (UniqueName: \"kubernetes.io/projected/9b56d365-2abc-4ce5-807b-fdd6c152e48f-kube-api-access-zxhcm\") pod \"migrator-6865c9967-prcmt\" (UID: \"9b56d365-2abc-4ce5-807b-fdd6c152e48f\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-prcmt"
Jul 27 19:25:41.731563 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.731481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-prcmt"
Jul 27 19:25:41.764542 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.764520    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mjn75"
Jul 27 19:25:41.878555 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:41.878528    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-prcmt"]
Jul 27 19:25:41.882260 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:25:41.882239    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b56d365_2abc_4ce5_807b_fdd6c152e48f.slice/crio-a8905591d8351776fa11937e410c01079bace0c2bc83a21c88121a25067c4bc5 WatchSource:0}: Error finding container a8905591d8351776fa11937e410c01079bace0c2bc83a21c88121a25067c4bc5: Status 404 returned error can't find the container with id a8905591d8351776fa11937e410c01079bace0c2bc83a21c88121a25067c4bc5
Jul 27 19:25:42.138020 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:42.137989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:42.138435 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:42.138058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:42.138435 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:42.138195    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:25:42.138435 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:42.138207    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:42.138435 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:42.138252    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm podName:8da3480e-14a7-4d08-968f-c12973de8f26 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:44.138234638 +0000 UTC m=+105.281438995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gctvv" (UID: "8da3480e-14a7-4d08-968f-c12973de8f26") : configmap "kube-rbac-proxy" not found
Jul 27 19:25:42.138435 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:42.138266    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls podName:8da3480e-14a7-4d08-968f-c12973de8f26 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:44.13826022 +0000 UTC m=+105.281464574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gctvv" (UID: "8da3480e-14a7-4d08-968f-c12973de8f26") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:42.418186 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:42.418111    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9nvmk_4499a910-b91a-4ee7-af77-2e23b18f0d09/dns-node-resolver/0.log"
Jul 27 19:25:42.842283 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:42.842247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-prcmt" event={"ID":"9b56d365-2abc-4ce5-807b-fdd6c152e48f","Type":"ContainerStarted","Data":"a8905591d8351776fa11937e410c01079bace0c2bc83a21c88121a25067c4bc5"}
Jul 27 19:25:43.219176 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:43.219106    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7vb5t_a8660bdd-6abd-4726-adf7-4802172dda7b/node-ca/0.log"
Jul 27 19:25:43.847315 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:43.847280    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-prcmt" event={"ID":"9b56d365-2abc-4ce5-807b-fdd6c152e48f","Type":"ContainerStarted","Data":"afb083f584ef2842689aef2612d1f6bee300b45e6fdc40a64dd8862e2b262880"}
Jul 27 19:25:43.847493 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:43.847373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-prcmt" event={"ID":"9b56d365-2abc-4ce5-807b-fdd6c152e48f","Type":"ContainerStarted","Data":"b82b805aa171579bc6744403025c92dbd24bd583709cec5ef6a7aa3ba1c03a42"}
Jul 27 19:25:43.874573 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:43.874524    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-prcmt" podStartSLOduration=1.424342939 podStartE2EDuration="2.874511192s" totalImagesPullingTime="1.450168253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:43.87412841 +0000 UTC m=+105.017332785" watchObservedRunningTime="2026-07-27 19:25:43.874511192 +0000 UTC m=+105.017715568"
Jul 27 19:25:44.018884 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:44.018860    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-btlr9_5bf266a9-0698-4a82-ad9f-1ffeaf0581fd/serve-healthcheck-canary/0.log"
Jul 27 19:25:44.153004 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:44.152935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:44.153004 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:44.152988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:44.153209 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:44.153061    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:25:44.153209 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:44.153095    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:44.153209 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:44.153110    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm podName:8da3480e-14a7-4d08-968f-c12973de8f26 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:48.153097547 +0000 UTC m=+109.296301901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gctvv" (UID: "8da3480e-14a7-4d08-968f-c12973de8f26") : configmap "kube-rbac-proxy" not found
Jul 27 19:25:44.153209 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:44.153149    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls podName:8da3480e-14a7-4d08-968f-c12973de8f26 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:48.15313584 +0000 UTC m=+109.296340194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gctvv" (UID: "8da3480e-14a7-4d08-968f-c12973de8f26") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:44.253282 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:44.253255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:44.253282 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:44.253282    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:44.253675 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:44.253397    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:25:44.253675 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:44.253430    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle podName:868e3d69-1d18-4be9-abf2-4a844fb46b8a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:52.253412034 +0000 UTC m=+113.396616404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle") pod "router-default-5c96857fff-n9ckm" (UID: "868e3d69-1d18-4be9-abf2-4a844fb46b8a") : configmap references non-existent config key: service-ca.crt
Jul 27 19:25:44.253675 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:44.253455    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs podName:868e3d69-1d18-4be9-abf2-4a844fb46b8a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:52.253445813 +0000 UTC m=+113.396650168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs") pod "router-default-5c96857fff-n9ckm" (UID: "868e3d69-1d18-4be9-abf2-4a844fb46b8a") : secret "router-metrics-certs-default" not found
Jul 27 19:25:48.181704 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:48.181673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:48.182188 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:48.181741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:48.182188 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:48.181806    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:25:48.182188 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:48.181873    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm podName:8da3480e-14a7-4d08-968f-c12973de8f26 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:56.181856937 +0000 UTC m=+117.325061292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gctvv" (UID: "8da3480e-14a7-4d08-968f-c12973de8f26") : configmap "kube-rbac-proxy" not found
Jul 27 19:25:48.182188 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:48.181812    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:48.182188 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:48.181949    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls podName:8da3480e-14a7-4d08-968f-c12973de8f26 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:56.181936547 +0000 UTC m=+117.325140901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gctvv" (UID: "8da3480e-14a7-4d08-968f-c12973de8f26") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:52.319279 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:52.319249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:52.319279 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:52.319281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:52.319679 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:52.319410    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle podName:868e3d69-1d18-4be9-abf2-4a844fb46b8a nodeName:}" failed. No retries permitted until 2026-07-27 19:26:08.319392407 +0000 UTC m=+129.462596764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle") pod "router-default-5c96857fff-n9ckm" (UID: "868e3d69-1d18-4be9-abf2-4a844fb46b8a") : configmap references non-existent config key: service-ca.crt
Jul 27 19:25:52.321898 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:52.321876    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868e3d69-1d18-4be9-abf2-4a844fb46b8a-metrics-certs\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:25:56.245105 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:56.245072    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:56.245496 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:56.245128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:25:56.245496 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:56.245211    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:56.245496 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:25:56.245282    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls podName:8da3480e-14a7-4d08-968f-c12973de8f26 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:12.245267578 +0000 UTC m=+133.388471931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gctvv" (UID: "8da3480e-14a7-4d08-968f-c12973de8f26") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:56.245629 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:25:56.245611    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8da3480e-14a7-4d08-968f-c12973de8f26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:26:06.907464 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:06.907422    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"]
Jul 27 19:26:06.909955 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:06.909933    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:06.913207 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:06.912965    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 27 19:26:06.916264 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:06.913554    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 19:26:06.916264 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:06.914287    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 27 19:26:06.916264 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:06.914532    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 19:26:06.916264 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:06.914562    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 27 19:26:06.916264 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:06.914743    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 19:26:06.916264 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:06.914790    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 27 19:26:06.930299 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:06.930276    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"]
Jul 27 19:26:07.020212 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.020166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.020212 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.020210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.020402 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.020241    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.020402 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.020305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pt4h\" (UniqueName: \"kubernetes.io/projected/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-kube-api-access-2pt4h\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.020402 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.020347    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-hub\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.020402 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.020371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-ca\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.121108 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.121071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-ca\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.121281 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.121134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.121281 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.121153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.121281 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.121172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.121281 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.121195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pt4h\" (UniqueName: \"kubernetes.io/projected/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-kube-api-access-2pt4h\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.121281 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.121230    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-hub\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.121983 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.121957    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.124011 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.123981    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-hub\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.124150 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.124021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.124150 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.123992    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-ca\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.124150 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.124136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.134062 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.134018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pt4h\" (UniqueName: \"kubernetes.io/projected/f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f-kube-api-access-2pt4h\") pod \"cluster-proxy-proxy-agent-84ff99c445-ctj2n\" (UID: \"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.237163 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.237111    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"
Jul 27 19:26:07.370139 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.370113    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n"]
Jul 27 19:26:07.370258 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:26:07.370161    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2bb8d7f_240d_4a2d_8e9f_c92ea979b10f.slice/crio-2665c2c99af28d980bea3889e904519c9e92e932e5b6eb59d2b9f39f17b0bcbe WatchSource:0}: Error finding container 2665c2c99af28d980bea3889e904519c9e92e932e5b6eb59d2b9f39f17b0bcbe: Status 404 returned error can't find the container with id 2665c2c99af28d980bea3889e904519c9e92e932e5b6eb59d2b9f39f17b0bcbe
Jul 27 19:26:07.923433 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:07.923397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n" event={"ID":"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f","Type":"ContainerStarted","Data":"2665c2c99af28d980bea3889e904519c9e92e932e5b6eb59d2b9f39f17b0bcbe"}
Jul 27 19:26:08.328951 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:08.328894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:26:08.329618 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:08.329594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868e3d69-1d18-4be9-abf2-4a844fb46b8a-service-ca-bundle\") pod \"router-default-5c96857fff-n9ckm\" (UID: \"868e3d69-1d18-4be9-abf2-4a844fb46b8a\") " pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:26:08.351357 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:08.351329    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tgwfd\""
Jul 27 19:26:08.358979 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:08.358908    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:26:08.523784 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:08.523711    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c96857fff-n9ckm"]
Jul 27 19:26:08.528564 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:26:08.528493    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868e3d69_1d18_4be9_abf2_4a844fb46b8a.slice/crio-8c9750040570de74c4dbe0dcf0f9c234fff87be20e6855b7ed133c339485acfe WatchSource:0}: Error finding container 8c9750040570de74c4dbe0dcf0f9c234fff87be20e6855b7ed133c339485acfe: Status 404 returned error can't find the container with id 8c9750040570de74c4dbe0dcf0f9c234fff87be20e6855b7ed133c339485acfe
Jul 27 19:26:08.930370 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:08.930285    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c96857fff-n9ckm" event={"ID":"868e3d69-1d18-4be9-abf2-4a844fb46b8a","Type":"ContainerStarted","Data":"e6ef237a4c293dac0a1bd01f1ed84bd8713bb0fa5bad32889b74b705d6b768fd"}
Jul 27 19:26:08.930370 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:08.930353    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c96857fff-n9ckm" event={"ID":"868e3d69-1d18-4be9-abf2-4a844fb46b8a","Type":"ContainerStarted","Data":"8c9750040570de74c4dbe0dcf0f9c234fff87be20e6855b7ed133c339485acfe"}
Jul 27 19:26:08.954967 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:08.954907    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5c96857fff-n9ckm" podStartSLOduration=32.954885687 podStartE2EDuration="32.954885687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:08.953438147 +0000 UTC m=+130.096642546" watchObservedRunningTime="2026-07-27 19:26:08.954885687 +0000 UTC m=+130.098090064"
Jul 27 19:26:09.136226 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:09.136193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:26:09.139457 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:09.139402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ee028dc-ad1f-43c4-9ada-e2ed9807fca6-metrics-certs\") pod \"network-metrics-daemon-wqcm5\" (UID: \"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6\") " pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:26:09.187326 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:09.187262    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v6qr\""
Jul 27 19:26:09.194950 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:09.194928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqcm5"
Jul 27 19:26:09.359404 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:09.359378    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:26:09.363951 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:09.363921    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:26:09.889203 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:09.887619    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wqcm5"]
Jul 27 19:26:09.935065 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:09.935011    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wqcm5" event={"ID":"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6","Type":"ContainerStarted","Data":"2140cbdbbeba603ab274a059b4f0c55e16265c149f0443fd50c083b0e935bc2d"}
Jul 27 19:26:09.935471 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:09.935311    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:26:09.936780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:09.936763    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c96857fff-n9ckm"
Jul 27 19:26:11.943370 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:11.943287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wqcm5" event={"ID":"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6","Type":"ContainerStarted","Data":"02cb25d117f1da65bc5e8817cbd3d7fefc1028f6b0cf410a60dc65d2f1f0df5a"}
Jul 27 19:26:11.943370 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:11.943351    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wqcm5" event={"ID":"1ee028dc-ad1f-43c4-9ada-e2ed9807fca6","Type":"ContainerStarted","Data":"cdfe0cd7df096666cbcd11936b3e48e611b8fe9b440b885feb7b9efe1bed17d8"}
Jul 27 19:26:11.945424 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:11.945403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n" event={"ID":"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f","Type":"ContainerStarted","Data":"413dd4168f28958936548aa0a1f92b583d6a38d8ac54f2ff2df2183b459f6e6c"}
Jul 27 19:26:11.945519 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:11.945436    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n" event={"ID":"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f","Type":"ContainerStarted","Data":"91fc4d75b180493729f6834473aa6850449e28e7a4e2f6f1199a73198deed5af"}
Jul 27 19:26:11.945519 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:11.945450    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n" event={"ID":"f2bb8d7f-240d-4a2d-8e9f-c92ea979b10f","Type":"ContainerStarted","Data":"d93f227c3214f8ee4bbf1d0bc22b16b7a10d4994fab397e563b90790bc1ba642"}
Jul 27 19:26:11.969304 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:11.969261    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wqcm5" podStartSLOduration=131.205971689 podStartE2EDuration="2m12.969246607s" totalImagesPullingTime="1.763274918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:11.968386034 +0000 UTC m=+133.111590410" watchObservedRunningTime="2026-07-27 19:26:11.969246607 +0000 UTC m=+133.112450982"
Jul 27 19:26:11.997515 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:11.997414    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ff99c445-ctj2n" podStartSLOduration=2.197225022 podStartE2EDuration="5.997396281s" totalImagesPullingTime="3.800171259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:11.997207061 +0000 UTC m=+133.140411442" watchObservedRunningTime="2026-07-27 19:26:11.997396281 +0000 UTC m=+133.140600658"
Jul 27 19:26:12.263013 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:12.262938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:26:12.265299 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:12.265280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8da3480e-14a7-4d08-968f-c12973de8f26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gctvv\" (UID: \"8da3480e-14a7-4d08-968f-c12973de8f26\") " pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:26:12.285943 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:12.285916    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kpwnj\""
Jul 27 19:26:12.292808 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:12.292792    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:26:12.420213 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:12.420186    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gctvv"]
Jul 27 19:26:12.423301 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:26:12.423273    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da3480e_14a7_4d08_968f_c12973de8f26.slice/crio-50c40abed4b046ae3b08dc92489b54c15cd4adb19008210ed626e9b3ee1aad10 WatchSource:0}: Error finding container 50c40abed4b046ae3b08dc92489b54c15cd4adb19008210ed626e9b3ee1aad10: Status 404 returned error can't find the container with id 50c40abed4b046ae3b08dc92489b54c15cd4adb19008210ed626e9b3ee1aad10
Jul 27 19:26:12.951837 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:12.951789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gctvv" event={"ID":"8da3480e-14a7-4d08-968f-c12973de8f26","Type":"ContainerStarted","Data":"50c40abed4b046ae3b08dc92489b54c15cd4adb19008210ed626e9b3ee1aad10"}
Jul 27 19:26:17.971018 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:17.970978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gctvv" event={"ID":"8da3480e-14a7-4d08-968f-c12973de8f26","Type":"ContainerStarted","Data":"cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911"}
Jul 27 19:26:20.984092 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:20.983995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gctvv" event={"ID":"8da3480e-14a7-4d08-968f-c12973de8f26","Type":"ContainerStarted","Data":"db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b"}
Jul 27 19:26:22.944873 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:22.944826    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:22.963938 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:22.963891    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:22.982107 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:22.982063    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:23.000140 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:23.000104    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:23.017917 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:23.017878    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:23Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:23Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:23Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:23Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:23.017917 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:23.017914    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:26:25.004232 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:25.004194    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gctvv" event={"ID":"8da3480e-14a7-4d08-968f-c12973de8f26","Type":"ContainerStarted","Data":"384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd"}
Jul 27 19:26:25.020983 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:25.020920    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da3480e-14a7-4d08-968f-c12973de8f26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.133.0.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.133.0.11\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-gctvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:26:29.386791 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:29.386723    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da3480e-14a7-4d08-968f-c12973de8f26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.133.0.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.133.0.11\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-gctvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:26:33.101560 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:33.101425    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:33.124253 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:33.124146    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:33.150666 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:33.150554    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:33.172495 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:33.172391    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:33.194483 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:33.194381    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:33Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:33.194483 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:33.194478    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:26:36.728158 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:36.728116    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-k9hgr" podUID="522704f3-186a-4309-a226-0945f5a689a7"
Jul 27 19:26:37.039601 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:37.039524    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:26:39.383383 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:39.383316    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da3480e-14a7-4d08-968f-c12973de8f26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.133.0.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.133.0.11\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-gctvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:26:41.676425 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:41.676393    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:26:41.678750 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:41.678721    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/522704f3-186a-4309-a226-0945f5a689a7-metrics-tls\") pod \"dns-default-k9hgr\" (UID: \"522704f3-186a-4309-a226-0945f5a689a7\") " pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:26:41.844006 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:41.843980    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ksszw\""
Jul 27 19:26:41.850611 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:41.850585    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:26:42.135982 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:42.135948    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:42.135982 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(ee306eb1b1ad9d208c785d6db9d2037aac81fd60e57515da4f3e924d03c754fe): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ee306eb1b1ad9d208c785d6db9d2037aac81fd60e57515da4f3e924d03c754fe" Netns:"/var/run/netns/1bc04b0c-7126-4fe0-92b4-6209583edef2" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=ee306eb1b1ad9d208c785d6db9d2037aac81fd60e57515da4f3e924d03c754fe;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:42.135982 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:42.135982 ip-10-0-134-17 kubenswrapper[2563]:  >
Jul 27 19:26:42.136181 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:42.136013    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:42.136181 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(ee306eb1b1ad9d208c785d6db9d2037aac81fd60e57515da4f3e924d03c754fe): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ee306eb1b1ad9d208c785d6db9d2037aac81fd60e57515da4f3e924d03c754fe" Netns:"/var/run/netns/1bc04b0c-7126-4fe0-92b4-6209583edef2" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=ee306eb1b1ad9d208c785d6db9d2037aac81fd60e57515da4f3e924d03c754fe;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:42.136181 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:42.136181 ip-10-0-134-17 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:26:42.136181 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:42.136090    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:42.136181 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(ee306eb1b1ad9d208c785d6db9d2037aac81fd60e57515da4f3e924d03c754fe): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ee306eb1b1ad9d208c785d6db9d2037aac81fd60e57515da4f3e924d03c754fe" Netns:"/var/run/netns/1bc04b0c-7126-4fe0-92b4-6209583edef2" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=ee306eb1b1ad9d208c785d6db9d2037aac81fd60e57515da4f3e924d03c754fe;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:42.136181 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:42.136181 ip-10-0-134-17 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:26:42.136533 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:42.136172    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"dns-default-k9hgr_openshift-dns(522704f3-186a-4309-a226-0945f5a689a7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"dns-default-k9hgr_openshift-dns(522704f3-186a-4309-a226-0945f5a689a7)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(ee306eb1b1ad9d208c785d6db9d2037aac81fd60e57515da4f3e924d03c754fe): error adding pod openshift-dns_dns-default-k9hgr to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"ee306eb1b1ad9d208c785d6db9d2037aac81fd60e57515da4f3e924d03c754fe\\\" Netns:\\\"/var/run/netns/1bc04b0c-7126-4fe0-92b4-6209583edef2\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=ee306eb1b1ad9d208c785d6db9d2037aac81fd60e57515da4f3e924d03c754fe;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-dns/dns-default-k9hgr" podUID="522704f3-186a-4309-a226-0945f5a689a7"
Jul 27 19:26:43.358436 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:43.358330    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:43.377332 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:43.377225    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:43.394382 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:43.394267    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:43.411145 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:43.411012    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:43.427157 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:43.427057    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:43.427157 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:43.427151    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:26:49.383763 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:49.383695    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da3480e-14a7-4d08-968f-c12973de8f26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.133.0.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.133.0.11\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-gctvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:26:53.773909 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:53.773800    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:53.801750 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:53.801649    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:53.829269 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:53.829171    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:53.850314 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:53.850214    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:53.870780 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:53.870676    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:53.870780 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:53.870775    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:26:55.097702 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:55.097669    2563 generic.go:356] "Generic (PLEG): container finished" podID="6968519b-b9ce-4bbd-8c33-64fa0d0b09c8" containerID="a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210" exitCode=0
Jul 27 19:26:55.098097 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:55.097741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl" event={"ID":"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8","Type":"ContainerDied","Data":"a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210"}
Jul 27 19:26:55.098097 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:55.098092    2563 scope.go:117] "RemoveContainer" containerID="a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210"
Jul 27 19:26:55.115501 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:55.115456    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:55Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:55Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gzsql\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:26:55.142485 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:55.142427    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da3480e-14a7-4d08-968f-c12973de8f26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.133.0.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.133.0.11\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-gctvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:26:55.366819 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:55.366746    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:26:55.367025 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:55.367013    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:26:55.615993 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:55.615666    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:55.615993 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(0ffd9c0d3dc6bcd8510e684799d1ea022d24a7290b6bdba511350ee429f6f1ff): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0ffd9c0d3dc6bcd8510e684799d1ea022d24a7290b6bdba511350ee429f6f1ff" Netns:"/var/run/netns/17539537-4598-455e-8a59-9977a6daf58f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=0ffd9c0d3dc6bcd8510e684799d1ea022d24a7290b6bdba511350ee429f6f1ff;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:55.615993 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:55.615993 ip-10-0-134-17 kubenswrapper[2563]:  >
Jul 27 19:26:55.615993 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:55.615752    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:55.615993 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(0ffd9c0d3dc6bcd8510e684799d1ea022d24a7290b6bdba511350ee429f6f1ff): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0ffd9c0d3dc6bcd8510e684799d1ea022d24a7290b6bdba511350ee429f6f1ff" Netns:"/var/run/netns/17539537-4598-455e-8a59-9977a6daf58f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=0ffd9c0d3dc6bcd8510e684799d1ea022d24a7290b6bdba511350ee429f6f1ff;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:55.615993 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:55.615993 ip-10-0-134-17 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:26:55.615993 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:55.615777    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:55.615993 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(0ffd9c0d3dc6bcd8510e684799d1ea022d24a7290b6bdba511350ee429f6f1ff): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0ffd9c0d3dc6bcd8510e684799d1ea022d24a7290b6bdba511350ee429f6f1ff" Netns:"/var/run/netns/17539537-4598-455e-8a59-9977a6daf58f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=0ffd9c0d3dc6bcd8510e684799d1ea022d24a7290b6bdba511350ee429f6f1ff;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:55.615993 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:55.615993 ip-10-0-134-17 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:26:55.616561 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:55.615933    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"dns-default-k9hgr_openshift-dns(522704f3-186a-4309-a226-0945f5a689a7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"dns-default-k9hgr_openshift-dns(522704f3-186a-4309-a226-0945f5a689a7)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(0ffd9c0d3dc6bcd8510e684799d1ea022d24a7290b6bdba511350ee429f6f1ff): error adding pod openshift-dns_dns-default-k9hgr to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"0ffd9c0d3dc6bcd8510e684799d1ea022d24a7290b6bdba511350ee429f6f1ff\\\" Netns:\\\"/var/run/netns/17539537-4598-455e-8a59-9977a6daf58f\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=0ffd9c0d3dc6bcd8510e684799d1ea022d24a7290b6bdba511350ee429f6f1ff;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-dns/dns-default-k9hgr" podUID="522704f3-186a-4309-a226-0945f5a689a7"
Jul 27 19:26:56.102491 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:26:56.102461    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl" event={"ID":"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8","Type":"ContainerStarted","Data":"c203df6547d2c310e7d09763017cce1903bdc968e33b773f0b8c9ea2e997b10b"}
Jul 27 19:26:56.120745 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:56.120698    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c203df6547d2c310e7d09763017cce1903bdc968e33b773f0b8c9ea2e997b10b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:55Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gzsql\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:26:56.137429 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:56.137365    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da3480e-14a7-4d08-968f-c12973de8f26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.133.0.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.133.0.11\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-gctvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:26:59.384495 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:59.384444    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c203df6547d2c310e7d09763017cce1903bdc968e33b773f0b8c9ea2e997b10b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:55Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gzsql\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:26:59.403647 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:26:59.403588    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da3480e-14a7-4d08-968f-c12973de8f26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.133.0.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.133.0.11\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-gctvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:27:03.970850 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:03.970741    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:03.992113 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:03.991997    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:04.012577 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:04.012467    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:04.032339 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:04.032242    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:04.050942 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:04.050845    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:04.050942 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:04.050939    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:27:05.134842 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:05.134804    2563 generic.go:356] "Generic (PLEG): container finished" podID="72c7adc9-0ba1-4493-8687-b29a191a82f1" containerID="3b918c03ab3a2f9672c17506090bce2f72373112b8796f4ee21b85a044b2493d" exitCode=0
Jul 27 19:27:05.135234 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:05.134871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6" event={"ID":"72c7adc9-0ba1-4493-8687-b29a191a82f1","Type":"ContainerDied","Data":"3b918c03ab3a2f9672c17506090bce2f72373112b8796f4ee21b85a044b2493d"}
Jul 27 19:27:05.135234 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:05.135173    2563 scope.go:117] "RemoveContainer" containerID="3b918c03ab3a2f9672c17506090bce2f72373112b8796f4ee21b85a044b2493d"
Jul 27 19:27:05.155532 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:05.155486    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"72c7adc9-0ba1-4493-8687-b29a191a82f1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"message\\\":\\\"containers with unready status: [service-ca-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"message\\\":\\\"containers with unready status: [service-ca-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"80Mi\\\"},\\\"containerID\\\":\\\"cri-o://3b918c03ab3a2f9672c17506090bce2f72373112b8796f4ee21b85a044b2493d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"service-ca-operator\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"80Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3b918c03ab3a2f9672c17506090bce2f72373112b8796f4ee21b85a044b2493d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":1001,\\\"supplementalGroups\\\":[1001],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hlbww\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-service-ca-operator\"/\"service-ca-operator-5d6c75f84f-nftb6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:27:05.171012 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:05.170949    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c203df6547d2c310e7d09763017cce1903bdc968e33b773f0b8c9ea2e997b10b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:55Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gzsql\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:27:05.189793 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:05.189734    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da3480e-14a7-4d08-968f-c12973de8f26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.133.0.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.133.0.11\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-gctvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:27:06.140461 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:06.140427    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6" event={"ID":"72c7adc9-0ba1-4493-8687-b29a191a82f1","Type":"ContainerStarted","Data":"e4a327e1e9fd85370d1a7fced598a877ca3f24d1137510cdc61bf54360ddb390"}
Jul 27 19:27:06.161119 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:06.161059    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da3480e-14a7-4d08-968f-c12973de8f26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.133.0.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.133.0.11\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-gctvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:27:06.176590 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:06.176549    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"72c7adc9-0ba1-4493-8687-b29a191a82f1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"80Mi\\\"},\\\"containerID\\\":\\\"cri-o://e4a327e1e9fd85370d1a7fced598a877ca3f24d1137510cdc61bf54360ddb390\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3b918c03ab3a2f9672c17506090bce2f72373112b8796f4ee21b85a044b2493d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"name\\\":\\\"service-ca-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"80Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:27:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":1001,\\\"supplementalGroups\\\":[1001],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hlbww\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-service-ca-operator\"/\"service-ca-operator-5d6c75f84f-nftb6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:27:06.191721 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:06.191680    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c203df6547d2c310e7d09763017cce1903bdc968e33b773f0b8c9ea2e997b10b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:55Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gzsql\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:27:07.366487 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:07.366456    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:07.366961 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:07.366688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:07.599573 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:07.599537    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:07.599573 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(ab09c61731de9ed0ad3b0f8ed6c96a0274ca8da08165a8c6e30036b8cc1b906e): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ab09c61731de9ed0ad3b0f8ed6c96a0274ca8da08165a8c6e30036b8cc1b906e" Netns:"/var/run/netns/0b5fa340-fdcf-4178-89ab-4d5fa6d87be8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=ab09c61731de9ed0ad3b0f8ed6c96a0274ca8da08165a8c6e30036b8cc1b906e;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:07.599573 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:07.599573 ip-10-0-134-17 kubenswrapper[2563]:  >
Jul 27 19:27:07.599730 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:07.599595    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:07.599730 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(ab09c61731de9ed0ad3b0f8ed6c96a0274ca8da08165a8c6e30036b8cc1b906e): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ab09c61731de9ed0ad3b0f8ed6c96a0274ca8da08165a8c6e30036b8cc1b906e" Netns:"/var/run/netns/0b5fa340-fdcf-4178-89ab-4d5fa6d87be8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=ab09c61731de9ed0ad3b0f8ed6c96a0274ca8da08165a8c6e30036b8cc1b906e;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:07.599730 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:07.599730 ip-10-0-134-17 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:07.599730 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:07.599616    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:07.599730 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(ab09c61731de9ed0ad3b0f8ed6c96a0274ca8da08165a8c6e30036b8cc1b906e): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ab09c61731de9ed0ad3b0f8ed6c96a0274ca8da08165a8c6e30036b8cc1b906e" Netns:"/var/run/netns/0b5fa340-fdcf-4178-89ab-4d5fa6d87be8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=ab09c61731de9ed0ad3b0f8ed6c96a0274ca8da08165a8c6e30036b8cc1b906e;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:07.599730 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:07.599730 ip-10-0-134-17 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:07.599730 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:07.599683    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"dns-default-k9hgr_openshift-dns(522704f3-186a-4309-a226-0945f5a689a7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"dns-default-k9hgr_openshift-dns(522704f3-186a-4309-a226-0945f5a689a7)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(ab09c61731de9ed0ad3b0f8ed6c96a0274ca8da08165a8c6e30036b8cc1b906e): error adding pod openshift-dns_dns-default-k9hgr to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"ab09c61731de9ed0ad3b0f8ed6c96a0274ca8da08165a8c6e30036b8cc1b906e\\\" Netns:\\\"/var/run/netns/0b5fa340-fdcf-4178-89ab-4d5fa6d87be8\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=ab09c61731de9ed0ad3b0f8ed6c96a0274ca8da08165a8c6e30036b8cc1b906e;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-dns/dns-default-k9hgr" podUID="522704f3-186a-4309-a226-0945f5a689a7"
Jul 27 19:27:09.382738 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:09.382690    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"72c7adc9-0ba1-4493-8687-b29a191a82f1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"80Mi\\\"},\\\"containerID\\\":\\\"cri-o://e4a327e1e9fd85370d1a7fced598a877ca3f24d1137510cdc61bf54360ddb390\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3b918c03ab3a2f9672c17506090bce2f72373112b8796f4ee21b85a044b2493d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"name\\\":\\\"service-ca-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"80Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:27:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":1001,\\\"supplementalGroups\\\":[1001],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hlbww\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-service-ca-operator\"/\"service-ca-operator-5d6c75f84f-nftb6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:27:09.407924 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:09.407879    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c203df6547d2c310e7d09763017cce1903bdc968e33b773f0b8c9ea2e997b10b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:55Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gzsql\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:27:09.425237 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:09.425179    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da3480e-14a7-4d08-968f-c12973de8f26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.133.0.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.133.0.11\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-gctvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:27:09.923362 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:09.923332    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9nvmk_4499a910-b91a-4ee7-af77-2e23b18f0d09/dns-node-resolver/0.log"
Jul 27 19:27:10.923938 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:10.923904    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7vb5t_a8660bdd-6abd-4726-adf7-4802172dda7b/node-ca/0.log"
Jul 27 19:27:12.324213 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:12.324181    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-f9gpw_e37d0a7e-9b06-466c-b418-260adcf95f6d/csi-driver/0.log"
Jul 27 19:27:12.525565 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:12.525538    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-f9gpw_e37d0a7e-9b06-466c-b418-260adcf95f6d/csi-node-driver-registrar/0.log"
Jul 27 19:27:12.724680 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:12.724605    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-f9gpw_e37d0a7e-9b06-466c-b418-260adcf95f6d/csi-liveness-probe/0.log"
Jul 27 19:27:14.273312 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:14.273201    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:14.929025 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:14.928900    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:15.016988 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:15.016871    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:15.039239 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:15.039127    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:15.057734 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:15.057620    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:15.057734 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:15.057729    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:27:18.366331 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:18.366302    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:18.366797 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:18.366604    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:18.600164 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:18.599936    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:18.600164 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(8291ecb368c3efe06ecca3b1e749ca034174d8526df649a75b10cc74a7d55727): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"8291ecb368c3efe06ecca3b1e749ca034174d8526df649a75b10cc74a7d55727" Netns:"/var/run/netns/e371fd24-8cec-46e7-b421-97b004c9ea03" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=8291ecb368c3efe06ecca3b1e749ca034174d8526df649a75b10cc74a7d55727;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:18.600164 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:18.600164 ip-10-0-134-17 kubenswrapper[2563]:  >
Jul 27 19:27:18.600164 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:18.600000    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:18.600164 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(8291ecb368c3efe06ecca3b1e749ca034174d8526df649a75b10cc74a7d55727): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"8291ecb368c3efe06ecca3b1e749ca034174d8526df649a75b10cc74a7d55727" Netns:"/var/run/netns/e371fd24-8cec-46e7-b421-97b004c9ea03" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=8291ecb368c3efe06ecca3b1e749ca034174d8526df649a75b10cc74a7d55727;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:18.600164 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:18.600164 ip-10-0-134-17 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:18.600164 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:18.600066    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:18.600164 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(8291ecb368c3efe06ecca3b1e749ca034174d8526df649a75b10cc74a7d55727): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"8291ecb368c3efe06ecca3b1e749ca034174d8526df649a75b10cc74a7d55727" Netns:"/var/run/netns/e371fd24-8cec-46e7-b421-97b004c9ea03" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=8291ecb368c3efe06ecca3b1e749ca034174d8526df649a75b10cc74a7d55727;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:18.600164 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:18.600164 ip-10-0-134-17 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:18.600592 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:18.600156    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"dns-default-k9hgr_openshift-dns(522704f3-186a-4309-a226-0945f5a689a7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"dns-default-k9hgr_openshift-dns(522704f3-186a-4309-a226-0945f5a689a7)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(8291ecb368c3efe06ecca3b1e749ca034174d8526df649a75b10cc74a7d55727): error adding pod openshift-dns_dns-default-k9hgr to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"8291ecb368c3efe06ecca3b1e749ca034174d8526df649a75b10cc74a7d55727\\\" Netns:\\\"/var/run/netns/e371fd24-8cec-46e7-b421-97b004c9ea03\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=8291ecb368c3efe06ecca3b1e749ca034174d8526df649a75b10cc74a7d55727;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-dns/dns-default-k9hgr" podUID="522704f3-186a-4309-a226-0945f5a689a7"
Jul 27 19:27:19.384394 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:19.384319    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c203df6547d2c310e7d09763017cce1903bdc968e33b773f0b8c9ea2e997b10b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:55Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gzsql\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:27:19.405511 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:19.405446    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da3480e-14a7-4d08-968f-c12973de8f26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.133.0.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.133.0.11\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-gctvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:27:19.420964 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:19.420924    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"72c7adc9-0ba1-4493-8687-b29a191a82f1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"80Mi\\\"},\\\"containerID\\\":\\\"cri-o://e4a327e1e9fd85370d1a7fced598a877ca3f24d1137510cdc61bf54360ddb390\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3b918c03ab3a2f9672c17506090bce2f72373112b8796f4ee21b85a044b2493d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"name\\\":\\\"service-ca-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"80Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:27:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":1001,\\\"supplementalGroups\\\":[1001],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hlbww\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-service-ca-operator\"/\"service-ca-operator-5d6c75f84f-nftb6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:27:25.121078 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:25.120949    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:25.139014 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:25.138911    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:25.157211 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:25.157112    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:25.175777 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:25.175686    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:25.195554 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:25.195458    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:1f295a4a045a3e92c21da694fa0b412c665dc8f89b2f88037b584d3c9a0c5f74\\\",\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\"],\\\"sizeBytes\\\":390869826},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\"],\\\"sizeBytes\\\":329056793},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:640d891ffb66482c963e4fe24040c2a61cfeb8abdfc13c000508ce0c70229c80\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f66c9d36775ea3755ef2d8ebb1b11f68abdeb087fbb85f2fd5a991e7a283f09f\\\"],\\\"sizeBytes\\\":254832882},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-134-17.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:25.195554 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:25.195554    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:27:29.393046 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:29.392980    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da3480e-14a7-4d08-968f-c12973de8f26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://db7c8aef268918f819ccaf102137075303595b70bbc8eb65b1452b018b7ee36b\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://384af9606180ae49d4571d146d4e988c69653d357232ed9e165622a45c7605cd\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc0dea3db56922a287f4ee2f11238d0d4c41f70d6cc967c8769f1eb43c1c9911\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h44df\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.133.0.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.133.0.11\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-gctvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-gctvv"
Jul 27 19:27:29.409779 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:29.409734    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"72c7adc9-0ba1-4493-8687-b29a191a82f1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"80Mi\\\"},\\\"containerID\\\":\\\"cri-o://e4a327e1e9fd85370d1a7fced598a877ca3f24d1137510cdc61bf54360ddb390\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3b918c03ab3a2f9672c17506090bce2f72373112b8796f4ee21b85a044b2493d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"name\\\":\\\"service-ca-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"80Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:27:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":1001,\\\"supplementalGroups\\\":[1001],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hlbww\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-service-ca-operator\"/\"service-ca-operator-5d6c75f84f-nftb6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nftb6"
Jul 27 19:27:29.424568 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:29.424522    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6968519b-b9ce-4bbd-8c33-64fa0d0b09c8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:56Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c203df6547d2c310e7d09763017cce1903bdc968e33b773f0b8c9ea2e997b10b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:686720f57c6312514920bfd1f55dc734decc5ca8a96ba4a2459d279b99953af3\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://a133a69c001fb1049f7ba5a766a26fce137e6bb7799c23e65a49f760218af210\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:39Z\\\"}},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:55Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":1001}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gzsql\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl"
Jul 27 19:27:31.366567 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:31.366534    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:31.367031 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:31.366777    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:31.600145 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:31.600087    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:31.600145 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(47bac292e0201bae11a6f664655428b751602c6338a5f9b487c0bd8bb1b91167): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"47bac292e0201bae11a6f664655428b751602c6338a5f9b487c0bd8bb1b91167" Netns:"/var/run/netns/b8517a39-6906-485e-b474-842f2ffb317f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=47bac292e0201bae11a6f664655428b751602c6338a5f9b487c0bd8bb1b91167;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:31.600145 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:31.600145 ip-10-0-134-17 kubenswrapper[2563]:  >
Jul 27 19:27:31.600350 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:31.600167    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:31.600350 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(47bac292e0201bae11a6f664655428b751602c6338a5f9b487c0bd8bb1b91167): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"47bac292e0201bae11a6f664655428b751602c6338a5f9b487c0bd8bb1b91167" Netns:"/var/run/netns/b8517a39-6906-485e-b474-842f2ffb317f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=47bac292e0201bae11a6f664655428b751602c6338a5f9b487c0bd8bb1b91167;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:31.600350 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:31.600350 ip-10-0-134-17 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:31.600350 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:31.600186    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:31.600350 ip-10-0-134-17 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(47bac292e0201bae11a6f664655428b751602c6338a5f9b487c0bd8bb1b91167): error adding pod openshift-dns_dns-default-k9hgr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"47bac292e0201bae11a6f664655428b751602c6338a5f9b487c0bd8bb1b91167" Netns:"/var/run/netns/b8517a39-6906-485e-b474-842f2ffb317f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=47bac292e0201bae11a6f664655428b751602c6338a5f9b487c0bd8bb1b91167;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:31.600350 ip-10-0-134-17 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:31.600350 ip-10-0-134-17 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:31.600350 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:31.600249    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"dns-default-k9hgr_openshift-dns(522704f3-186a-4309-a226-0945f5a689a7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"dns-default-k9hgr_openshift-dns(522704f3-186a-4309-a226-0945f5a689a7)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-k9hgr_openshift-dns_522704f3-186a-4309-a226-0945f5a689a7_0(47bac292e0201bae11a6f664655428b751602c6338a5f9b487c0bd8bb1b91167): error adding pod openshift-dns_dns-default-k9hgr to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"47bac292e0201bae11a6f664655428b751602c6338a5f9b487c0bd8bb1b91167\\\" Netns:\\\"/var/run/netns/b8517a39-6906-485e-b474-842f2ffb317f\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-k9hgr;K8S_POD_INFRA_CONTAINER_ID=47bac292e0201bae11a6f664655428b751602c6338a5f9b487c0bd8bb1b91167;K8S_POD_UID=522704f3-186a-4309-a226-0945f5a689a7\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-dns/dns-default-k9hgr] networking: Multus: [openshift-dns/dns-default-k9hgr/522704f3-186a-4309-a226-0945f5a689a7]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-k9hgr in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-k9hgr in out of cluster comm: status update failed for pod openshift-dns/dns-default-k9hgr: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-dns/dns-default-k9hgr" podUID="522704f3-186a-4309-a226-0945f5a689a7"
Jul 27 19:27:39.434893 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:39.434843    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gctvv" podStartSLOduration=107.933382814 podStartE2EDuration="1m59.434827854s" totalImagesPullingTime="11.50144504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:39.434516769 +0000 UTC m=+220.577721146" watchObservedRunningTime="2026-07-27 19:27:39.434827854 +0000 UTC m=+220.578032230"
Jul 27 19:27:44.205955 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.205925    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-clb9r"]
Jul 27 19:27:44.208719 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.208703    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.212874 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.212855    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 19:27:44.213030 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.213016    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 19:27:44.213380 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.213367    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 19:27:44.213771 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.213750    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 19:27:44.214192 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.214167    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 19:27:44.214297 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.214223    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 19:27:44.224833 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.224813    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6nkqs\""
Jul 27 19:27:44.273825 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.273798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/572a364e-b7c2-4c6e-9210-bc07929c218c-sys\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.273929 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.273845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-textfile\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.273929 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.273874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6cr2\" (UniqueName: \"kubernetes.io/projected/572a364e-b7c2-4c6e-9210-bc07929c218c-kube-api-access-c6cr2\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.274003 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.273938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-accelerators-collector-config\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.274003 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.273964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-tls\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.274003 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.273984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.274118 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.274002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/572a364e-b7c2-4c6e-9210-bc07929c218c-root\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.274118 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.274061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572a364e-b7c2-4c6e-9210-bc07929c218c-metrics-client-ca\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.274118 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.274093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-wtmp\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.366538 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.366517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:44.366761 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.366741    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:44.374650 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.374620    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/572a364e-b7c2-4c6e-9210-bc07929c218c-sys\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.374733 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.374695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-textfile\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.374733 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.374725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/572a364e-b7c2-4c6e-9210-bc07929c218c-sys\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.374815 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.374727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6cr2\" (UniqueName: \"kubernetes.io/projected/572a364e-b7c2-4c6e-9210-bc07929c218c-kube-api-access-c6cr2\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.374815 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.374779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-accelerators-collector-config\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.374815 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.374800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-tls\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.375112 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.374818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.375112 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.374834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/572a364e-b7c2-4c6e-9210-bc07929c218c-root\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.375112 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.374851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572a364e-b7c2-4c6e-9210-bc07929c218c-metrics-client-ca\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.375112 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.374880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-wtmp\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.375112 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.374907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/572a364e-b7c2-4c6e-9210-bc07929c218c-root\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.375112 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.375001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-wtmp\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.375112 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.375066    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-textfile\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.375112 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:44.375085    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 19:27:44.375497 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:27:44.375144    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-tls podName:572a364e-b7c2-4c6e-9210-bc07929c218c nodeName:}" failed. No retries permitted until 2026-07-27 19:27:44.875125203 +0000 UTC m=+226.018329556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-tls") pod "node-exporter-clb9r" (UID: "572a364e-b7c2-4c6e-9210-bc07929c218c") : secret "node-exporter-tls" not found
Jul 27 19:27:44.375497 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.375431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-accelerators-collector-config\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.375575 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.375543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572a364e-b7c2-4c6e-9210-bc07929c218c-metrics-client-ca\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.377647 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.377620    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.388109 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.388079    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6cr2\" (UniqueName: \"kubernetes.io/projected/572a364e-b7c2-4c6e-9210-bc07929c218c-kube-api-access-c6cr2\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.525729 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.525658    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k9hgr"]
Jul 27 19:27:44.529115 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:27:44.529079    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522704f3_186a_4309_a226_0945f5a689a7.slice/crio-d4e52dc9303c0bc21eee0ebd5a92fb7fa3f1a351a5387a6245e6f5ed7872636a WatchSource:0}: Error finding container d4e52dc9303c0bc21eee0ebd5a92fb7fa3f1a351a5387a6245e6f5ed7872636a: Status 404 returned error can't find the container with id d4e52dc9303c0bc21eee0ebd5a92fb7fa3f1a351a5387a6245e6f5ed7872636a
Jul 27 19:27:44.878502 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.878465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-tls\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:44.880852 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:44.880822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/572a364e-b7c2-4c6e-9210-bc07929c218c-node-exporter-tls\") pod \"node-exporter-clb9r\" (UID: \"572a364e-b7c2-4c6e-9210-bc07929c218c\") " pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:45.118008 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:45.117976    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-clb9r"
Jul 27 19:27:45.127438 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:27:45.127415    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572a364e_b7c2_4c6e_9210_bc07929c218c.slice/crio-09077ae173483c4b1af4c19012044f8ced03f1a781416c3af2a8e515db6d228d WatchSource:0}: Error finding container 09077ae173483c4b1af4c19012044f8ced03f1a781416c3af2a8e515db6d228d: Status 404 returned error can't find the container with id 09077ae173483c4b1af4c19012044f8ced03f1a781416c3af2a8e515db6d228d
Jul 27 19:27:45.271218 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:45.271186    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-clb9r" event={"ID":"572a364e-b7c2-4c6e-9210-bc07929c218c","Type":"ContainerStarted","Data":"09077ae173483c4b1af4c19012044f8ced03f1a781416c3af2a8e515db6d228d"}
Jul 27 19:27:45.272117 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:45.272098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k9hgr" event={"ID":"522704f3-186a-4309-a226-0945f5a689a7","Type":"ContainerStarted","Data":"d4e52dc9303c0bc21eee0ebd5a92fb7fa3f1a351a5387a6245e6f5ed7872636a"}
Jul 27 19:27:46.276561 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:46.276526    2563 generic.go:356] "Generic (PLEG): container finished" podID="572a364e-b7c2-4c6e-9210-bc07929c218c" containerID="55025fceffbbbfc8dbc4c92c88b71964aed34eff01d817d80e528dc31d3285f1" exitCode=0
Jul 27 19:27:46.276901 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:46.276618    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-clb9r" event={"ID":"572a364e-b7c2-4c6e-9210-bc07929c218c","Type":"ContainerDied","Data":"55025fceffbbbfc8dbc4c92c88b71964aed34eff01d817d80e528dc31d3285f1"}
Jul 27 19:27:47.281495 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:47.281401    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k9hgr" event={"ID":"522704f3-186a-4309-a226-0945f5a689a7","Type":"ContainerStarted","Data":"6966d41d8f9a3405370f8bbc61277b62a0195bcc96e30b358c8e387d39d823c0"}
Jul 27 19:27:47.281495 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:47.281458    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k9hgr" event={"ID":"522704f3-186a-4309-a226-0945f5a689a7","Type":"ContainerStarted","Data":"2ab6cfcdf2c9effbdf7089132579727f3de17ec42636b1a9ebac7114090b0119"}
Jul 27 19:27:47.281495 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:47.281488    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:27:47.283440 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:47.283417    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-clb9r" event={"ID":"572a364e-b7c2-4c6e-9210-bc07929c218c","Type":"ContainerStarted","Data":"b888f731d6fca399eab8d22e69747b4624d3b7541fbc9a0abfc4beef2eec02bf"}
Jul 27 19:27:47.283547 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:47.283459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-clb9r" event={"ID":"572a364e-b7c2-4c6e-9210-bc07929c218c","Type":"ContainerStarted","Data":"8c3b0b166ccd3e9d5b4f52e222d5a278be5770c0300b367de050288c0067d864"}
Jul 27 19:27:47.310147 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:47.310109    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k9hgr" podStartSLOduration=191.992640381 podStartE2EDuration="3m14.310094761s" totalImagesPullingTime="2.31745438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:47.307787568 +0000 UTC m=+228.450991944" watchObservedRunningTime="2026-07-27 19:27:47.310094761 +0000 UTC m=+228.453299136"
Jul 27 19:27:47.333522 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:47.333479    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-clb9r" podStartSLOduration=2.344317066 podStartE2EDuration="3.333465984s" totalImagesPullingTime="914.718694ms" totalInitContainerRuntime="74.430224ms" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:47.332677572 +0000 UTC m=+228.475881961" watchObservedRunningTime="2026-07-27 19:27:47.333465984 +0000 UTC m=+228.476670359"
Jul 27 19:27:57.290598 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:27:57.290569    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k9hgr"
Jul 27 19:28:59.219889 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:28:59.219838    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 19:31:03.164783 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.164746    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r"]
Jul 27 19:31:03.167638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.167623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r"
Jul 27 19:31:03.171068 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.171022    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:31:03.171761 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.171744    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 19:31:03.172538 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.172520    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hc7vg\""
Jul 27 19:31:03.178652 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.178633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r"]
Jul 27 19:31:03.260880 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.260852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkmcq\" (UniqueName: \"kubernetes.io/projected/62a843ef-6f32-4aa3-bb8d-5840a37c2d17-kube-api-access-tkmcq\") pod \"openshift-lws-operator-fd8ccff4c-h4g4r\" (UID: \"62a843ef-6f32-4aa3-bb8d-5840a37c2d17\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r"
Jul 27 19:31:03.261007 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.260908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62a843ef-6f32-4aa3-bb8d-5840a37c2d17-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4g4r\" (UID: \"62a843ef-6f32-4aa3-bb8d-5840a37c2d17\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r"
Jul 27 19:31:03.361951 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.361930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmcq\" (UniqueName: \"kubernetes.io/projected/62a843ef-6f32-4aa3-bb8d-5840a37c2d17-kube-api-access-tkmcq\") pod \"openshift-lws-operator-fd8ccff4c-h4g4r\" (UID: \"62a843ef-6f32-4aa3-bb8d-5840a37c2d17\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r"
Jul 27 19:31:03.362108 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.361990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62a843ef-6f32-4aa3-bb8d-5840a37c2d17-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4g4r\" (UID: \"62a843ef-6f32-4aa3-bb8d-5840a37c2d17\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r"
Jul 27 19:31:03.362296 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.362280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62a843ef-6f32-4aa3-bb8d-5840a37c2d17-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4g4r\" (UID: \"62a843ef-6f32-4aa3-bb8d-5840a37c2d17\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r"
Jul 27 19:31:03.373460 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.373436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkmcq\" (UniqueName: \"kubernetes.io/projected/62a843ef-6f32-4aa3-bb8d-5840a37c2d17-kube-api-access-tkmcq\") pod \"openshift-lws-operator-fd8ccff4c-h4g4r\" (UID: \"62a843ef-6f32-4aa3-bb8d-5840a37c2d17\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r"
Jul 27 19:31:03.476147 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.476075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r"
Jul 27 19:31:03.604605 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.604571    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r"]
Jul 27 19:31:03.607729 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:31:03.607701    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62a843ef_6f32_4aa3_bb8d_5840a37c2d17.slice/crio-2c229980759ae926ccac94b9461688b5bbf2ed99956a830c090ef868289d53a5 WatchSource:0}: Error finding container 2c229980759ae926ccac94b9461688b5bbf2ed99956a830c090ef868289d53a5: Status 404 returned error can't find the container with id 2c229980759ae926ccac94b9461688b5bbf2ed99956a830c090ef868289d53a5
Jul 27 19:31:03.609218 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.609201    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:31:03.921743 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:03.921709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r" event={"ID":"62a843ef-6f32-4aa3-bb8d-5840a37c2d17","Type":"ContainerStarted","Data":"2c229980759ae926ccac94b9461688b5bbf2ed99956a830c090ef868289d53a5"}
Jul 27 19:31:06.934978 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:06.934947    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r" event={"ID":"62a843ef-6f32-4aa3-bb8d-5840a37c2d17","Type":"ContainerStarted","Data":"d828977590998103a24e7cf2f9e96095c2204185e7ba037fae811a87019893e2"}
Jul 27 19:31:06.956814 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:06.956757    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4g4r" podStartSLOduration=1.31763569 podStartE2EDuration="3.956738078s" totalImagesPullingTime="2.639102388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:06.955875538 +0000 UTC m=+428.099079915" watchObservedRunningTime="2026-07-27 19:31:06.956738078 +0000 UTC m=+428.099942457"
Jul 27 19:31:26.445674 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.445595    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"]
Jul 27 19:31:26.448575 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.448559    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.452472 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.452449    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 19:31:26.452604 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.452472    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 19:31:26.452604 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.452478    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 19:31:26.452604 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.452592    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tw2cw\""
Jul 27 19:31:26.452827 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.452813    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 19:31:26.464798 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.464776    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"]
Jul 27 19:31:26.629710 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.629673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-manifests\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.629710 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.629722    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-tmp\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.629900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.629746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.629900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.629827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npvd7\" (UniqueName: \"kubernetes.io/projected/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-kube-api-access-npvd7\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.629900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.629858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.730895 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.730826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-manifests\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.730895 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.730862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-tmp\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.730895 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.730880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.731123 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.730908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npvd7\" (UniqueName: \"kubernetes.io/projected/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-kube-api-access-npvd7\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.731123 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.730933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.731308 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.731287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-manifests\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.733265 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.733235    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-tmp\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.733392 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.733351    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.733463 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.733447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.744278 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.744258    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npvd7\" (UniqueName: \"kubernetes.io/projected/54ee2a04-8e0a-4398-8ee9-63550f4b9bdb-kube-api-access-npvd7\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-bkjjf\" (UID: \"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.758770 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.758751    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:26.893659 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:26.893620    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"]
Jul 27 19:31:26.897580 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:31:26.897551    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ee2a04_8e0a_4398_8ee9_63550f4b9bdb.slice/crio-4119b65d5a5e785af219c5e35ce6270a3c03ba486c372e1326eaacceddb7d6de WatchSource:0}: Error finding container 4119b65d5a5e785af219c5e35ce6270a3c03ba486c372e1326eaacceddb7d6de: Status 404 returned error can't find the container with id 4119b65d5a5e785af219c5e35ce6270a3c03ba486c372e1326eaacceddb7d6de
Jul 27 19:31:27.002344 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:27.002273    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf" event={"ID":"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb","Type":"ContainerStarted","Data":"4119b65d5a5e785af219c5e35ce6270a3c03ba486c372e1326eaacceddb7d6de"}
Jul 27 19:31:30.016764 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:30.016734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf" event={"ID":"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb","Type":"ContainerStarted","Data":"732d5cb3a51c037a3f5e22fb62ef7f1edcfb215df190949fcf23f855844d7039"}
Jul 27 19:31:32.025742 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:32.025706    2563 generic.go:356] "Generic (PLEG): container finished" podID="54ee2a04-8e0a-4398-8ee9-63550f4b9bdb" containerID="732d5cb3a51c037a3f5e22fb62ef7f1edcfb215df190949fcf23f855844d7039" exitCode=0
Jul 27 19:31:32.026235 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:32.025746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf" event={"ID":"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb","Type":"ContainerDied","Data":"732d5cb3a51c037a3f5e22fb62ef7f1edcfb215df190949fcf23f855844d7039"}
Jul 27 19:31:33.031513 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:33.031481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf" event={"ID":"54ee2a04-8e0a-4398-8ee9-63550f4b9bdb","Type":"ContainerStarted","Data":"4ad38a91f5760623de9b9a681f2f66957f20503b4630ce3ed670876a2d02a994"}
Jul 27 19:31:33.031874 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:33.031689    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:33.060167 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:33.060124    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf" podStartSLOduration=2.555113054 podStartE2EDuration="7.060109678s" totalImagesPullingTime="3.436887614s" totalInitContainerRuntime="1.06810901s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:33.058160836 +0000 UTC m=+454.201365212" watchObservedRunningTime="2026-07-27 19:31:33.060109678 +0000 UTC m=+454.203314054"
Jul 27 19:31:44.037585 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:44.037557    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-bkjjf"
Jul 27 19:31:46.754004 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.753977    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"]
Jul 27 19:31:46.760717 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.760693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"
Jul 27 19:31:46.765307 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.765285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 19:31:46.765467 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.765321    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-k85j9\""
Jul 27 19:31:46.765467 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.765321    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 19:31:46.769840 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.769818    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"]
Jul 27 19:31:46.778698 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.778678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb4fa31f-27b7-43cb-9b28-39015195df03-tmp\") pod \"kube-auth-proxy-6bbdd9d5dd-559sf\" (UID: \"cb4fa31f-27b7-43cb-9b28-39015195df03\") " pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"
Jul 27 19:31:46.778780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.778705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb4fa31f-27b7-43cb-9b28-39015195df03-tls-certs\") pod \"kube-auth-proxy-6bbdd9d5dd-559sf\" (UID: \"cb4fa31f-27b7-43cb-9b28-39015195df03\") " pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"
Jul 27 19:31:46.778780 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.778723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pbb5\" (UniqueName: \"kubernetes.io/projected/cb4fa31f-27b7-43cb-9b28-39015195df03-kube-api-access-6pbb5\") pod \"kube-auth-proxy-6bbdd9d5dd-559sf\" (UID: \"cb4fa31f-27b7-43cb-9b28-39015195df03\") " pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"
Jul 27 19:31:46.861824 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.861798    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xjj5p"]
Jul 27 19:31:46.863815 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.863798    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p"
Jul 27 19:31:46.868367 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.868343    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 19:31:46.868473 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.868346    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cnbj7\""
Jul 27 19:31:46.879598 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.879577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16994ff5-ea9c-44af-8039-606d3e3c9273-cert\") pod \"odh-model-controller-7998c67dc4-xjj5p\" (UID: \"16994ff5-ea9c-44af-8039-606d3e3c9273\") " pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p"
Jul 27 19:31:46.879681 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.879619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb4fa31f-27b7-43cb-9b28-39015195df03-tmp\") pod \"kube-auth-proxy-6bbdd9d5dd-559sf\" (UID: \"cb4fa31f-27b7-43cb-9b28-39015195df03\") " pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"
Jul 27 19:31:46.879681 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.879647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb4fa31f-27b7-43cb-9b28-39015195df03-tls-certs\") pod \"kube-auth-proxy-6bbdd9d5dd-559sf\" (UID: \"cb4fa31f-27b7-43cb-9b28-39015195df03\") " pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"
Jul 27 19:31:46.879681 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.879669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pbb5\" (UniqueName: \"kubernetes.io/projected/cb4fa31f-27b7-43cb-9b28-39015195df03-kube-api-access-6pbb5\") pod \"kube-auth-proxy-6bbdd9d5dd-559sf\" (UID: \"cb4fa31f-27b7-43cb-9b28-39015195df03\") " pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"
Jul 27 19:31:46.879821 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.879688    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29cvf\" (UniqueName: \"kubernetes.io/projected/16994ff5-ea9c-44af-8039-606d3e3c9273-kube-api-access-29cvf\") pod \"odh-model-controller-7998c67dc4-xjj5p\" (UID: \"16994ff5-ea9c-44af-8039-606d3e3c9273\") " pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p"
Jul 27 19:31:46.882216 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.882194    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb4fa31f-27b7-43cb-9b28-39015195df03-tmp\") pod \"kube-auth-proxy-6bbdd9d5dd-559sf\" (UID: \"cb4fa31f-27b7-43cb-9b28-39015195df03\") " pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"
Jul 27 19:31:46.882536 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.882512    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb4fa31f-27b7-43cb-9b28-39015195df03-tls-certs\") pod \"kube-auth-proxy-6bbdd9d5dd-559sf\" (UID: \"cb4fa31f-27b7-43cb-9b28-39015195df03\") " pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"
Jul 27 19:31:46.883522 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.883502    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xjj5p"]
Jul 27 19:31:46.898993 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.898975    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pbb5\" (UniqueName: \"kubernetes.io/projected/cb4fa31f-27b7-43cb-9b28-39015195df03-kube-api-access-6pbb5\") pod \"kube-auth-proxy-6bbdd9d5dd-559sf\" (UID: \"cb4fa31f-27b7-43cb-9b28-39015195df03\") " pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"
Jul 27 19:31:46.980634 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.980585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16994ff5-ea9c-44af-8039-606d3e3c9273-cert\") pod \"odh-model-controller-7998c67dc4-xjj5p\" (UID: \"16994ff5-ea9c-44af-8039-606d3e3c9273\") " pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p"
Jul 27 19:31:46.980815 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.980665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29cvf\" (UniqueName: \"kubernetes.io/projected/16994ff5-ea9c-44af-8039-606d3e3c9273-kube-api-access-29cvf\") pod \"odh-model-controller-7998c67dc4-xjj5p\" (UID: \"16994ff5-ea9c-44af-8039-606d3e3c9273\") " pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p"
Jul 27 19:31:46.980815 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:31:46.980750    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 27 19:31:46.980937 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:31:46.980836    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16994ff5-ea9c-44af-8039-606d3e3c9273-cert podName:16994ff5-ea9c-44af-8039-606d3e3c9273 nodeName:}" failed. No retries permitted until 2026-07-27 19:31:47.480814571 +0000 UTC m=+468.624018925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/16994ff5-ea9c-44af-8039-606d3e3c9273-cert") pod "odh-model-controller-7998c67dc4-xjj5p" (UID: "16994ff5-ea9c-44af-8039-606d3e3c9273") : secret "odh-model-controller-webhook-cert" not found
Jul 27 19:31:46.991683 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:46.991660    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29cvf\" (UniqueName: \"kubernetes.io/projected/16994ff5-ea9c-44af-8039-606d3e3c9273-kube-api-access-29cvf\") pod \"odh-model-controller-7998c67dc4-xjj5p\" (UID: \"16994ff5-ea9c-44af-8039-606d3e3c9273\") " pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p"
Jul 27 19:31:47.070614 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.070591    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"
Jul 27 19:31:47.211599 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.211558    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf"]
Jul 27 19:31:47.215287 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:31:47.215248    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4fa31f_27b7_43cb_9b28_39015195df03.slice/crio-e621161edbd13aff2a6a5583a35b54945c803112742cc09cc3b25926aabd74b6 WatchSource:0}: Error finding container e621161edbd13aff2a6a5583a35b54945c803112742cc09cc3b25926aabd74b6: Status 404 returned error can't find the container with id e621161edbd13aff2a6a5583a35b54945c803112742cc09cc3b25926aabd74b6
Jul 27 19:31:47.485356 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.485284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16994ff5-ea9c-44af-8039-606d3e3c9273-cert\") pod \"odh-model-controller-7998c67dc4-xjj5p\" (UID: \"16994ff5-ea9c-44af-8039-606d3e3c9273\") " pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p"
Jul 27 19:31:47.487779 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.487757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16994ff5-ea9c-44af-8039-606d3e3c9273-cert\") pod \"odh-model-controller-7998c67dc4-xjj5p\" (UID: \"16994ff5-ea9c-44af-8039-606d3e3c9273\") " pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p"
Jul 27 19:31:47.772789 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.772706    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p"
Jul 27 19:31:47.801408 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.801378    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"]
Jul 27 19:31:47.804401 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.804373    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.807457 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.807437    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 19:31:47.807579 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.807502    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 19:31:47.807651 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.807590    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-slprz\""
Jul 27 19:31:47.807651 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.807440    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 19:31:47.807853 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.807824    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 19:31:47.823406 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.823380    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"]
Jul 27 19:31:47.889009 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.888675    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.889009 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.888725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.889009 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.888761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gnjn\" (UniqueName: \"kubernetes.io/projected/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-kube-api-access-7gnjn\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.889009 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.888791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.889009 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.888820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.889009 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.888847    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.889009 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.888891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.929751 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.929729    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xjj5p"]
Jul 27 19:31:47.931927 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:31:47.931902    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16994ff5_ea9c_44af_8039_606d3e3c9273.slice/crio-d36c44e2d9de1b553dfdf01990150fef0c4c6160f5f3af5f70bcebb0bfa6a63e WatchSource:0}: Error finding container d36c44e2d9de1b553dfdf01990150fef0c4c6160f5f3af5f70bcebb0bfa6a63e: Status 404 returned error can't find the container with id d36c44e2d9de1b553dfdf01990150fef0c4c6160f5f3af5f70bcebb0bfa6a63e
Jul 27 19:31:47.990094 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.990025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.990265 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.990109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.990265 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.990139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.990265 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.990204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.990429 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.990266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.990429 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.990305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.990724 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.990656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnjn\" (UniqueName: \"kubernetes.io/projected/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-kube-api-access-7gnjn\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.991059 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.990993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.993245 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.993222    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.993346 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.993227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.993346 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.993280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:47.993346 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:47.993289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:48.000391 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:48.000369    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:48.000599 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:48.000579    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gnjn\" (UniqueName: \"kubernetes.io/projected/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-kube-api-access-7gnjn\") pod \"istiod-openshift-gateway-7b7995d5cd-f9zw2\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:48.085631 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:48.085596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf" event={"ID":"cb4fa31f-27b7-43cb-9b28-39015195df03","Type":"ContainerStarted","Data":"e621161edbd13aff2a6a5583a35b54945c803112742cc09cc3b25926aabd74b6"}
Jul 27 19:31:48.086691 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:48.086673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p" event={"ID":"16994ff5-ea9c-44af-8039-606d3e3c9273","Type":"ContainerStarted","Data":"d36c44e2d9de1b553dfdf01990150fef0c4c6160f5f3af5f70bcebb0bfa6a63e"}
Jul 27 19:31:48.117506 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:48.117486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:48.260668 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:48.260638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"]
Jul 27 19:31:48.263188 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:31:48.263160    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0dcfaa6_0bc2_45d5_ae73_25d94fec5198.slice/crio-5238b9838751f1e777ebead1db750fc92ef1f62434336f3c2e2c292e67ee4c5b WatchSource:0}: Error finding container 5238b9838751f1e777ebead1db750fc92ef1f62434336f3c2e2c292e67ee4c5b: Status 404 returned error can't find the container with id 5238b9838751f1e777ebead1db750fc92ef1f62434336f3c2e2c292e67ee4c5b
Jul 27 19:31:49.093695 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:49.093649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2" event={"ID":"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198","Type":"ContainerStarted","Data":"5238b9838751f1e777ebead1db750fc92ef1f62434336f3c2e2c292e67ee4c5b"}
Jul 27 19:31:52.734150 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:52.734102    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:31:52.734537 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:52.734192    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:31:53.116699 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:53.116656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p" event={"ID":"16994ff5-ea9c-44af-8039-606d3e3c9273","Type":"ContainerStarted","Data":"3955820e70cb8330461005ef319e67e4d41f3cbc2ab1698324cac6e66396ba20"}
Jul 27 19:31:53.116895 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:53.116764    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p"
Jul 27 19:31:53.118340 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:53.118312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf" event={"ID":"cb4fa31f-27b7-43cb-9b28-39015195df03","Type":"ContainerStarted","Data":"6efbf9de519fdfaca1862db1bec036d2f58b7d0b418347baa51ae94de8af5f22"}
Jul 27 19:31:53.119975 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:53.119953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2" event={"ID":"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198","Type":"ContainerStarted","Data":"85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270"}
Jul 27 19:31:53.120153 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:53.120139    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:53.121772 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:53.121748    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-f9zw2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 19:31:53.121858 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:53.121802    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2" podUID="d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 19:31:53.145434 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:53.145394    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p" podStartSLOduration=2.344238929 podStartE2EDuration="7.145382482s" totalImagesPullingTime="4.801143553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:53.144223111 +0000 UTC m=+474.287427490" watchObservedRunningTime="2026-07-27 19:31:53.145382482 +0000 UTC m=+474.288586836"
Jul 27 19:31:53.174485 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:53.174444    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6bbdd9d5dd-559sf" podStartSLOduration=1.669767803 podStartE2EDuration="7.174429604s" totalImagesPullingTime="5.504661801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:53.172521208 +0000 UTC m=+474.315725584" watchObservedRunningTime="2026-07-27 19:31:53.174429604 +0000 UTC m=+474.317633980"
Jul 27 19:31:53.222858 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:53.222805    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2" podStartSLOduration=1.754397032 podStartE2EDuration="6.222782819s" totalImagesPullingTime="4.468385787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:53.222208238 +0000 UTC m=+474.365412616" watchObservedRunningTime="2026-07-27 19:31:53.222782819 +0000 UTC m=+474.365987196"
Jul 27 19:31:54.124714 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.124682    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-f9zw2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 19:31:54.125170 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.124737    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2" podUID="d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 19:31:54.526146 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.526068    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"]
Jul 27 19:31:54.529478 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.529458    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.532949 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.532929    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mbnzw\""
Jul 27 19:31:54.552546 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.552523    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"]
Jul 27 19:31:54.644861 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.644826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.645020 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.644875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.645020 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.644981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8651fe8c-f499-4067-8ff2-6073a1f61943-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.645124 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.645022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.645124 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.645076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6fp7\" (UniqueName: \"kubernetes.io/projected/8651fe8c-f499-4067-8ff2-6073a1f61943-kube-api-access-x6fp7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.645124 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.645108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.645217 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.645158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.645253 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.645227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8651fe8c-f499-4067-8ff2-6073a1f61943-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.645292 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.645258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8651fe8c-f499-4067-8ff2-6073a1f61943-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.746441 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.746398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6fp7\" (UniqueName: \"kubernetes.io/projected/8651fe8c-f499-4067-8ff2-6073a1f61943-kube-api-access-x6fp7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.746441 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.746440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.746635 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.746462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.746635 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.746488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8651fe8c-f499-4067-8ff2-6073a1f61943-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.746635 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.746555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8651fe8c-f499-4067-8ff2-6073a1f61943-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.746635 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.746597    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.746834 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.746639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.746834 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.746708    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8651fe8c-f499-4067-8ff2-6073a1f61943-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.746834 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.746756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.746963 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.746870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.746963 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.746911    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.747097 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.747033    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.747153 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.747124    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.747356 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.747293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8651fe8c-f499-4067-8ff2-6073a1f61943-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.749008 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.748986    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8651fe8c-f499-4067-8ff2-6073a1f61943-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.749221 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.749202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8651fe8c-f499-4067-8ff2-6073a1f61943-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.760149 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.759426    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6fp7\" (UniqueName: \"kubernetes.io/projected/8651fe8c-f499-4067-8ff2-6073a1f61943-kube-api-access-x6fp7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.760916 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.760895    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8651fe8c-f499-4067-8ff2-6073a1f61943-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf\" (UID: \"8651fe8c-f499-4067-8ff2-6073a1f61943\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.838848 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.838819    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:54.982972 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:54.982936    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"]
Jul 27 19:31:54.986685 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:31:54.986654    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8651fe8c_f499_4067_8ff2_6073a1f61943.slice/crio-147e4dbc5a522c963e7a2cf27e1b2b3ebd7d9ef5036b22c042c6853de8075f02 WatchSource:0}: Error finding container 147e4dbc5a522c963e7a2cf27e1b2b3ebd7d9ef5036b22c042c6853de8075f02: Status 404 returned error can't find the container with id 147e4dbc5a522c963e7a2cf27e1b2b3ebd7d9ef5036b22c042c6853de8075f02
Jul 27 19:31:55.130376 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:55.130303    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf" event={"ID":"8651fe8c-f499-4067-8ff2-6073a1f61943","Type":"ContainerStarted","Data":"147e4dbc5a522c963e7a2cf27e1b2b3ebd7d9ef5036b22c042c6853de8075f02"}
Jul 27 19:31:57.125912 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.125875    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:31:57.663886 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.659842    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"]
Jul 27 19:31:57.667644 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.667619    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"]
Jul 27 19:31:57.667777 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.667735    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"
Jul 27 19:31:57.670894 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.670825    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"
Jul 27 19:31:57.671952 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.671924    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kkg4v\""
Jul 27 19:31:57.672143 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.672014    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 27 19:31:57.673773 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.673743    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 27 19:31:57.674492 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.673914    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"]
Jul 27 19:31:57.674492 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.673954    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bxfxm\""
Jul 27 19:31:57.698788 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.698761    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"]
Jul 27 19:31:57.768346 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.768313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s9l5\" (UniqueName: \"kubernetes.io/projected/2d451838-3c69-45da-a7d3-8e133a81860d-kube-api-access-7s9l5\") pod \"llmisvc-controller-manager-777c6bd7d5-pkz56\" (UID: \"2d451838-3c69-45da-a7d3-8e133a81860d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"
Jul 27 19:31:57.768518 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.768404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7fvx\" (UniqueName: \"kubernetes.io/projected/85f9dc34-465d-4b46-8357-796fbd58e609-kube-api-access-m7fvx\") pod \"kserve-controller-manager-d6f4b65b8-x5ztz\" (UID: \"85f9dc34-465d-4b46-8357-796fbd58e609\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"
Jul 27 19:31:57.768518 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.768433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85f9dc34-465d-4b46-8357-796fbd58e609-cert\") pod \"kserve-controller-manager-d6f4b65b8-x5ztz\" (UID: \"85f9dc34-465d-4b46-8357-796fbd58e609\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"
Jul 27 19:31:57.768518 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.768467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d451838-3c69-45da-a7d3-8e133a81860d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pkz56\" (UID: \"2d451838-3c69-45da-a7d3-8e133a81860d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"
Jul 27 19:31:57.869638 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.869604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d451838-3c69-45da-a7d3-8e133a81860d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pkz56\" (UID: \"2d451838-3c69-45da-a7d3-8e133a81860d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"
Jul 27 19:31:57.869838 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.869657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s9l5\" (UniqueName: \"kubernetes.io/projected/2d451838-3c69-45da-a7d3-8e133a81860d-kube-api-access-7s9l5\") pod \"llmisvc-controller-manager-777c6bd7d5-pkz56\" (UID: \"2d451838-3c69-45da-a7d3-8e133a81860d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"
Jul 27 19:31:57.869838 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.869712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7fvx\" (UniqueName: \"kubernetes.io/projected/85f9dc34-465d-4b46-8357-796fbd58e609-kube-api-access-m7fvx\") pod \"kserve-controller-manager-d6f4b65b8-x5ztz\" (UID: \"85f9dc34-465d-4b46-8357-796fbd58e609\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"
Jul 27 19:31:57.869838 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.869730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85f9dc34-465d-4b46-8357-796fbd58e609-cert\") pod \"kserve-controller-manager-d6f4b65b8-x5ztz\" (UID: \"85f9dc34-465d-4b46-8357-796fbd58e609\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"
Jul 27 19:31:57.869838 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:31:57.869774    2563 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 27 19:31:57.869838 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:31:57.869836    2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 27 19:31:57.870021 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:31:57.869857    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d451838-3c69-45da-a7d3-8e133a81860d-cert podName:2d451838-3c69-45da-a7d3-8e133a81860d nodeName:}" failed. No retries permitted until 2026-07-27 19:31:58.369833401 +0000 UTC m=+479.513037771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2d451838-3c69-45da-a7d3-8e133a81860d-cert") pod "llmisvc-controller-manager-777c6bd7d5-pkz56" (UID: "2d451838-3c69-45da-a7d3-8e133a81860d") : secret "llmisvc-webhook-server-cert" not found
Jul 27 19:31:57.870021 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:31:57.869883    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85f9dc34-465d-4b46-8357-796fbd58e609-cert podName:85f9dc34-465d-4b46-8357-796fbd58e609 nodeName:}" failed. No retries permitted until 2026-07-27 19:31:58.369867525 +0000 UTC m=+479.513071879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/85f9dc34-465d-4b46-8357-796fbd58e609-cert") pod "kserve-controller-manager-d6f4b65b8-x5ztz" (UID: "85f9dc34-465d-4b46-8357-796fbd58e609") : secret "kserve-webhook-server-cert" not found
Jul 27 19:31:57.882417 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.882386    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s9l5\" (UniqueName: \"kubernetes.io/projected/2d451838-3c69-45da-a7d3-8e133a81860d-kube-api-access-7s9l5\") pod \"llmisvc-controller-manager-777c6bd7d5-pkz56\" (UID: \"2d451838-3c69-45da-a7d3-8e133a81860d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"
Jul 27 19:31:57.882417 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:57.882428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7fvx\" (UniqueName: \"kubernetes.io/projected/85f9dc34-465d-4b46-8357-796fbd58e609-kube-api-access-m7fvx\") pod \"kserve-controller-manager-d6f4b65b8-x5ztz\" (UID: \"85f9dc34-465d-4b46-8357-796fbd58e609\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"
Jul 27 19:31:58.003131 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.003090    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:31:58.003250 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.003201    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:31:58.003315 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.003245    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:31:58.144761 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.144723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf" event={"ID":"8651fe8c-f499-4067-8ff2-6073a1f61943","Type":"ContainerStarted","Data":"8894c314fa7ec7852280c72f7db37c93b6beda20caa17f7bba5482dcdbb304f8"}
Jul 27 19:31:58.172240 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.172184    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf" podStartSLOduration=1.157965447 podStartE2EDuration="4.172166359s" totalImagesPullingTime="3.014200912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:58.17013148 +0000 UTC m=+479.313335856" watchObservedRunningTime="2026-07-27 19:31:58.172166359 +0000 UTC m=+479.315370735"
Jul 27 19:31:58.374618 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.374586    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85f9dc34-465d-4b46-8357-796fbd58e609-cert\") pod \"kserve-controller-manager-d6f4b65b8-x5ztz\" (UID: \"85f9dc34-465d-4b46-8357-796fbd58e609\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"
Jul 27 19:31:58.374785 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.374633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d451838-3c69-45da-a7d3-8e133a81860d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pkz56\" (UID: \"2d451838-3c69-45da-a7d3-8e133a81860d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"
Jul 27 19:31:58.377409 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.377384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85f9dc34-465d-4b46-8357-796fbd58e609-cert\") pod \"kserve-controller-manager-d6f4b65b8-x5ztz\" (UID: \"85f9dc34-465d-4b46-8357-796fbd58e609\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"
Jul 27 19:31:58.377523 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.377429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d451838-3c69-45da-a7d3-8e133a81860d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pkz56\" (UID: \"2d451838-3c69-45da-a7d3-8e133a81860d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"
Jul 27 19:31:58.599790 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.599749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"
Jul 27 19:31:58.609071 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.609029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"
Jul 27 19:31:58.753917 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.753841    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"]
Jul 27 19:31:58.756171 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:31:58.756146    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f9dc34_465d_4b46_8357_796fbd58e609.slice/crio-e5b14c0c998786b2a2e4bf47838cfefc4c1cdc66ce2d464d70e504675d62e602 WatchSource:0}: Error finding container e5b14c0c998786b2a2e4bf47838cfefc4c1cdc66ce2d464d70e504675d62e602: Status 404 returned error can't find the container with id e5b14c0c998786b2a2e4bf47838cfefc4c1cdc66ce2d464d70e504675d62e602
Jul 27 19:31:58.770497 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.770475    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"]
Jul 27 19:31:58.770972 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:31:58.770948    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2d451838_3c69_45da_a7d3_8e133a81860d.slice/crio-9418b7d6568cfab1b4b7d90bfe16bc7cc6babcf3b2da57679d280a9fc12faa5e WatchSource:0}: Error finding container 9418b7d6568cfab1b4b7d90bfe16bc7cc6babcf3b2da57679d280a9fc12faa5e: Status 404 returned error can't find the container with id 9418b7d6568cfab1b4b7d90bfe16bc7cc6babcf3b2da57679d280a9fc12faa5e
Jul 27 19:31:58.839457 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:58.839428    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:31:59.149422 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:59.149385    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz" event={"ID":"85f9dc34-465d-4b46-8357-796fbd58e609","Type":"ContainerStarted","Data":"e5b14c0c998786b2a2e4bf47838cfefc4c1cdc66ce2d464d70e504675d62e602"}
Jul 27 19:31:59.150497 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:59.150477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56" event={"ID":"2d451838-3c69-45da-a7d3-8e133a81860d","Type":"ContainerStarted","Data":"9418b7d6568cfab1b4b7d90bfe16bc7cc6babcf3b2da57679d280a9fc12faa5e"}
Jul 27 19:31:59.795307 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:59.795272    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"]
Jul 27 19:31:59.795484 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:59.795445    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2" podUID="d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" containerName="discovery" containerID="cri-o://85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270" gracePeriod=30
Jul 27 19:31:59.844273 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:31:59.844246    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:32:00.159626 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.159598    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:32:00.160058 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.160016    2563 generic.go:356] "Generic (PLEG): container finished" podID="d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" containerID="85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270" exitCode=0
Jul 27 19:32:00.160127 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.160076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2" event={"ID":"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198","Type":"ContainerDied","Data":"85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270"}
Jul 27 19:32:00.160185 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.160164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2" event={"ID":"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198","Type":"ContainerDied","Data":"5238b9838751f1e777ebead1db750fc92ef1f62434336f3c2e2c292e67ee4c5b"}
Jul 27 19:32:00.160236 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.160196    2563 scope.go:117] "RemoveContainer" containerID="85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270"
Jul 27 19:32:00.160337 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.160318    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:32:00.161418 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.161400    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf"
Jul 27 19:32:00.190316 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.190282    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-csr-dns-cert\") pod \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") "
Jul 27 19:32:00.190477 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.190335    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-csr-ca-configmap\") pod \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") "
Jul 27 19:32:00.190477 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.190364    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-kubeconfig\") pod \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") "
Jul 27 19:32:00.190477 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.190422    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-local-certs\") pod \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") "
Jul 27 19:32:00.190477 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.190459    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-cacerts\") pod \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") "
Jul 27 19:32:00.190682 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.190499    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gnjn\" (UniqueName: \"kubernetes.io/projected/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-kube-api-access-7gnjn\") pod \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") "
Jul 27 19:32:00.190682 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.190537    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-token\") pod \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\" (UID: \"d0dcfaa6-0bc2-45d5-ae73-25d94fec5198\") "
Jul 27 19:32:00.190968 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.190782    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" (UID: "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:32:00.193983 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.193953    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" (UID: "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:32:00.194261 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.194230    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" (UID: "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:32:00.194473 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.194427    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-local-certs" (OuterVolumeSpecName: "local-certs") pod "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" (UID: "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:32:00.194830 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.194805    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" (UID: "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:32:00.195059 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.195016    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-kube-api-access-7gnjn" (OuterVolumeSpecName: "kube-api-access-7gnjn") pod "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" (UID: "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198"). InnerVolumeSpecName "kube-api-access-7gnjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:32:00.195730 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.195710    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-cacerts" (OuterVolumeSpecName: "cacerts") pod "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" (UID: "d0dcfaa6-0bc2-45d5-ae73-25d94fec5198"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:32:00.229229 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.229182    2563 scope.go:117] "RemoveContainer" containerID="85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270"
Jul 27 19:32:00.229734 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:32:00.229699    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270\": container with ID starting with 85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270 not found: ID does not exist" containerID="85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270"
Jul 27 19:32:00.229894 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.229746    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270"} err="failed to get container status \"85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270\": rpc error: code = NotFound desc = could not find container \"85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270\": container with ID starting with 85072de41e5c824aa519d0583a28e36897f080dd30827d39a33b59e3f7ac2270 not found: ID does not exist"
Jul 27 19:32:00.291522 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.291491    2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-local-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:32:00.291522 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.291521    2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-cacerts\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:32:00.291847 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.291536    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gnjn\" (UniqueName: \"kubernetes.io/projected/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-kube-api-access-7gnjn\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:32:00.291847 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.291551    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:32:00.291847 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.291566    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-csr-dns-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:32:00.291847 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.291578    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-csr-ca-configmap\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:32:00.291847 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:00.291592    2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198-istio-kubeconfig\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:32:01.169555 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:01.168644    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"
Jul 27 19:32:01.202574 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:01.202531    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"]
Jul 27 19:32:01.222424 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:01.222384    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2"]
Jul 27 19:32:01.370745 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:01.370723    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" path="/var/lib/kubelet/pods/d0dcfaa6-0bc2-45d5-ae73-25d94fec5198/volumes"
Jul 27 19:32:02.173820 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:02.173782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz" event={"ID":"85f9dc34-465d-4b46-8357-796fbd58e609","Type":"ContainerStarted","Data":"547cccbfa9c01523271e764869b9be35c4f75a217ecc4703c8f471da3599f4eb"}
Jul 27 19:32:02.174235 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:02.173851    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"
Jul 27 19:32:02.192262 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:02.192222    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz" podStartSLOduration=2.584477818 podStartE2EDuration="5.192207698s" totalImagesPullingTime="2.60772988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:32:02.191599033 +0000 UTC m=+483.334803412" watchObservedRunningTime="2026-07-27 19:32:02.192207698 +0000 UTC m=+483.335412074"
Jul 27 19:32:03.179364 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:03.179328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56" event={"ID":"2d451838-3c69-45da-a7d3-8e133a81860d","Type":"ContainerStarted","Data":"80250d4a48401638a340445e21253c6630f495d84f3c65ec5636372af9126246"}
Jul 27 19:32:03.198070 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:03.198000    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56" podStartSLOduration=2.552080422 podStartE2EDuration="6.197985247s" totalImagesPullingTime="3.645904825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:32:03.197296693 +0000 UTC m=+484.340501068" watchObservedRunningTime="2026-07-27 19:32:03.197985247 +0000 UTC m=+484.341189624"
Jul 27 19:32:04.126486 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:04.126460    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xjj5p"
Jul 27 19:32:04.184659 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:04.184627    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"
Jul 27 19:32:05.125292 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:05.125249    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-f9zw2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.18:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 19:32:05.125464 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:05.125315    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f9zw2" podUID="d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" containerName="discovery" probeResult="failure" output="Get \"http://10.133.0.18:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 19:32:33.184925 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:33.184894    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x5ztz"
Jul 27 19:32:35.192642 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:35.192607    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkz56"
Jul 27 19:32:47.558640 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.558609    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-645vm"]
Jul 27 19:32:47.558994 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.558875    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" containerName="discovery"
Jul 27 19:32:47.558994 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.558885    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" containerName="discovery"
Jul 27 19:32:47.558994 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.558932    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0dcfaa6-0bc2-45d5-ae73-25d94fec5198" containerName="discovery"
Jul 27 19:32:47.570447 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.570418    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-645vm"
Jul 27 19:32:47.573109 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.573071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-645vm"]
Jul 27 19:32:47.573463 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.573441    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 19:32:47.574957 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.574922    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-sttwx\""
Jul 27 19:32:47.575155 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.575139    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 19:32:47.749234 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.749197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thklm\" (UniqueName: \"kubernetes.io/projected/2ef76dcd-3ec5-441e-9294-46ebce29649d-kube-api-access-thklm\") pod \"kuadrant-operator-catalog-645vm\" (UID: \"2ef76dcd-3ec5-441e-9294-46ebce29649d\") " pod="kuadrant-system/kuadrant-operator-catalog-645vm"
Jul 27 19:32:47.849753 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.849680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thklm\" (UniqueName: \"kubernetes.io/projected/2ef76dcd-3ec5-441e-9294-46ebce29649d-kube-api-access-thklm\") pod \"kuadrant-operator-catalog-645vm\" (UID: \"2ef76dcd-3ec5-441e-9294-46ebce29649d\") " pod="kuadrant-system/kuadrant-operator-catalog-645vm"
Jul 27 19:32:47.859944 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.859910    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thklm\" (UniqueName: \"kubernetes.io/projected/2ef76dcd-3ec5-441e-9294-46ebce29649d-kube-api-access-thklm\") pod \"kuadrant-operator-catalog-645vm\" (UID: \"2ef76dcd-3ec5-441e-9294-46ebce29649d\") " pod="kuadrant-system/kuadrant-operator-catalog-645vm"
Jul 27 19:32:47.880853 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.880829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-645vm"
Jul 27 19:32:47.910965 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:47.910933    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-645vm"]
Jul 27 19:32:48.019481 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:48.019454    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-645vm"]
Jul 27 19:32:48.022278 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:32:48.022252    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef76dcd_3ec5_441e_9294_46ebce29649d.slice/crio-82b8a8729e0636029171d3c280044086044047975560a1f292861a6b0ca834e1 WatchSource:0}: Error finding container 82b8a8729e0636029171d3c280044086044047975560a1f292861a6b0ca834e1: Status 404 returned error can't find the container with id 82b8a8729e0636029171d3c280044086044047975560a1f292861a6b0ca834e1
Jul 27 19:32:48.132189 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:48.132129    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ckm7x"]
Jul 27 19:32:48.134778 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:48.134763    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ckm7x"
Jul 27 19:32:48.145660 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:48.145632    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ckm7x"]
Jul 27 19:32:48.253904 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:48.253875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvbtm\" (UniqueName: \"kubernetes.io/projected/1c976d66-b867-4430-9563-3e81eac77fdc-kube-api-access-jvbtm\") pod \"kuadrant-operator-catalog-ckm7x\" (UID: \"1c976d66-b867-4430-9563-3e81eac77fdc\") " pod="kuadrant-system/kuadrant-operator-catalog-ckm7x"
Jul 27 19:32:48.354845 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:48.354811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvbtm\" (UniqueName: \"kubernetes.io/projected/1c976d66-b867-4430-9563-3e81eac77fdc-kube-api-access-jvbtm\") pod \"kuadrant-operator-catalog-ckm7x\" (UID: \"1c976d66-b867-4430-9563-3e81eac77fdc\") " pod="kuadrant-system/kuadrant-operator-catalog-ckm7x"
Jul 27 19:32:48.365949 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:48.365920    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-645vm" event={"ID":"2ef76dcd-3ec5-441e-9294-46ebce29649d","Type":"ContainerStarted","Data":"82b8a8729e0636029171d3c280044086044047975560a1f292861a6b0ca834e1"}
Jul 27 19:32:48.367691 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:48.367671    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvbtm\" (UniqueName: \"kubernetes.io/projected/1c976d66-b867-4430-9563-3e81eac77fdc-kube-api-access-jvbtm\") pod \"kuadrant-operator-catalog-ckm7x\" (UID: \"1c976d66-b867-4430-9563-3e81eac77fdc\") " pod="kuadrant-system/kuadrant-operator-catalog-ckm7x"
Jul 27 19:32:48.443656 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:48.443586    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ckm7x"
Jul 27 19:32:48.584648 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:48.584620    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ckm7x"]
Jul 27 19:32:48.595639 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:32:48.595612    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c976d66_b867_4430_9563_3e81eac77fdc.slice/crio-44dfd601751ea2273be873ae4e0fe4befb7b3c0b6b17d25b566f9bc4ed28ef36 WatchSource:0}: Error finding container 44dfd601751ea2273be873ae4e0fe4befb7b3c0b6b17d25b566f9bc4ed28ef36: Status 404 returned error can't find the container with id 44dfd601751ea2273be873ae4e0fe4befb7b3c0b6b17d25b566f9bc4ed28ef36
Jul 27 19:32:49.373348 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:49.373309    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ckm7x" event={"ID":"1c976d66-b867-4430-9563-3e81eac77fdc","Type":"ContainerStarted","Data":"44dfd601751ea2273be873ae4e0fe4befb7b3c0b6b17d25b566f9bc4ed28ef36"}
Jul 27 19:32:51.384098 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:51.384027    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-645vm" event={"ID":"2ef76dcd-3ec5-441e-9294-46ebce29649d","Type":"ContainerStarted","Data":"b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb"}
Jul 27 19:32:51.384544 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:51.384156    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-645vm" podUID="2ef76dcd-3ec5-441e-9294-46ebce29649d" containerName="registry-server" containerID="cri-o://b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb" gracePeriod=2
Jul 27 19:32:51.385788 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:51.385765    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ckm7x" event={"ID":"1c976d66-b867-4430-9563-3e81eac77fdc","Type":"ContainerStarted","Data":"5afa0b0d60586b36def8fae8cecf7152746fd0fcf4eeccfba292378453e45b1e"}
Jul 27 19:32:51.404159 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:51.404118    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-645vm" podStartSLOduration=2.096071219 podStartE2EDuration="4.404103001s" totalImagesPullingTime="2.308031782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:32:51.403225147 +0000 UTC m=+532.546429524" watchObservedRunningTime="2026-07-27 19:32:51.404103001 +0000 UTC m=+532.547307376"
Jul 27 19:32:51.421360 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:51.421319    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ckm7x" podStartSLOduration=1.666098876 podStartE2EDuration="3.421306023s" totalImagesPullingTime="1.755207147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:32:51.420641668 +0000 UTC m=+532.563846046" watchObservedRunningTime="2026-07-27 19:32:51.421306023 +0000 UTC m=+532.564510398"
Jul 27 19:32:51.622684 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:51.622663    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-645vm"
Jul 27 19:32:51.780352 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:51.780272    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thklm\" (UniqueName: \"kubernetes.io/projected/2ef76dcd-3ec5-441e-9294-46ebce29649d-kube-api-access-thklm\") pod \"2ef76dcd-3ec5-441e-9294-46ebce29649d\" (UID: \"2ef76dcd-3ec5-441e-9294-46ebce29649d\") "
Jul 27 19:32:51.782523 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:51.782501    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef76dcd-3ec5-441e-9294-46ebce29649d-kube-api-access-thklm" (OuterVolumeSpecName: "kube-api-access-thklm") pod "2ef76dcd-3ec5-441e-9294-46ebce29649d" (UID: "2ef76dcd-3ec5-441e-9294-46ebce29649d"). InnerVolumeSpecName "kube-api-access-thklm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:32:51.880692 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:51.880662    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thklm\" (UniqueName: \"kubernetes.io/projected/2ef76dcd-3ec5-441e-9294-46ebce29649d-kube-api-access-thklm\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:32:52.390602 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:52.390571    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ef76dcd-3ec5-441e-9294-46ebce29649d" containerID="b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb" exitCode=0
Jul 27 19:32:52.391017 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:52.390608    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-645vm"
Jul 27 19:32:52.391017 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:52.390641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-645vm" event={"ID":"2ef76dcd-3ec5-441e-9294-46ebce29649d","Type":"ContainerDied","Data":"b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb"}
Jul 27 19:32:52.391017 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:52.390681    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-645vm" event={"ID":"2ef76dcd-3ec5-441e-9294-46ebce29649d","Type":"ContainerDied","Data":"82b8a8729e0636029171d3c280044086044047975560a1f292861a6b0ca834e1"}
Jul 27 19:32:52.391017 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:52.390705    2563 scope.go:117] "RemoveContainer" containerID="b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb"
Jul 27 19:32:52.399847 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:52.399831    2563 scope.go:117] "RemoveContainer" containerID="b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb"
Jul 27 19:32:52.400116 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:32:52.400098    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb\": container with ID starting with b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb not found: ID does not exist" containerID="b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb"
Jul 27 19:32:52.400189 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:52.400126    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb"} err="failed to get container status \"b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb\": rpc error: code = NotFound desc = could not find container \"b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb\": container with ID starting with b48e8556f558075baad0cb92270f278cfe47e207b9946c6803c0fc77afcf65cb not found: ID does not exist"
Jul 27 19:32:52.414587 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:52.414566    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-645vm"]
Jul 27 19:32:52.419284 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:52.419264    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-645vm"]
Jul 27 19:32:53.371668 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:53.371640    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ef76dcd-3ec5-441e-9294-46ebce29649d" path="/var/lib/kubelet/pods/2ef76dcd-3ec5-441e-9294-46ebce29649d/volumes"
Jul 27 19:32:58.444327 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:58.444293    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ckm7x"
Jul 27 19:32:58.444805 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:58.444341    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ckm7x"
Jul 27 19:32:58.465679 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:58.465654    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ckm7x"
Jul 27 19:32:59.441092 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:32:59.441068    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ckm7x"
Jul 27 19:33:21.423231 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.423197    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"]
Jul 27 19:33:21.423828 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.423487    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef76dcd-3ec5-441e-9294-46ebce29649d" containerName="registry-server"
Jul 27 19:33:21.423828 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.423497    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef76dcd-3ec5-441e-9294-46ebce29649d" containerName="registry-server"
Jul 27 19:33:21.423828 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.423554    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef76dcd-3ec5-441e-9294-46ebce29649d" containerName="registry-server"
Jul 27 19:33:21.426329 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.426307    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:21.429910 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.429889    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5qhf8\""
Jul 27 19:33:21.441580 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.441558    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"]
Jul 27 19:33:21.477025 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.477001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbtfv\" (UniqueName: \"kubernetes.io/projected/f63c5eaa-ea4d-45c9-9946-c3df7453c046-kube-api-access-tbtfv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69dbr\" (UID: \"f63c5eaa-ea4d-45c9-9946-c3df7453c046\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:21.477162 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.477067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f63c5eaa-ea4d-45c9-9946-c3df7453c046-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69dbr\" (UID: \"f63c5eaa-ea4d-45c9-9946-c3df7453c046\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:21.578214 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.578178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbtfv\" (UniqueName: \"kubernetes.io/projected/f63c5eaa-ea4d-45c9-9946-c3df7453c046-kube-api-access-tbtfv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69dbr\" (UID: \"f63c5eaa-ea4d-45c9-9946-c3df7453c046\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:21.578368 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.578263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f63c5eaa-ea4d-45c9-9946-c3df7453c046-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69dbr\" (UID: \"f63c5eaa-ea4d-45c9-9946-c3df7453c046\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:21.578711 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.578688    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f63c5eaa-ea4d-45c9-9946-c3df7453c046-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69dbr\" (UID: \"f63c5eaa-ea4d-45c9-9946-c3df7453c046\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:21.591785 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.591758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbtfv\" (UniqueName: \"kubernetes.io/projected/f63c5eaa-ea4d-45c9-9946-c3df7453c046-kube-api-access-tbtfv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69dbr\" (UID: \"f63c5eaa-ea4d-45c9-9946-c3df7453c046\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:21.736493 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.736419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:21.868004 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:21.867976    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"]
Jul 27 19:33:21.871885 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:33:21.871860    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63c5eaa_ea4d_45c9_9946_c3df7453c046.slice/crio-e3882a4c330393063590dca37aea781b3ba4c0ed17560324e096e5331629dbd1 WatchSource:0}: Error finding container e3882a4c330393063590dca37aea781b3ba4c0ed17560324e096e5331629dbd1: Status 404 returned error can't find the container with id e3882a4c330393063590dca37aea781b3ba4c0ed17560324e096e5331629dbd1
Jul 27 19:33:22.511615 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:22.511581    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr" event={"ID":"f63c5eaa-ea4d-45c9-9946-c3df7453c046","Type":"ContainerStarted","Data":"e3882a4c330393063590dca37aea781b3ba4c0ed17560324e096e5331629dbd1"}
Jul 27 19:33:24.049488 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:24.049455    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq"]
Jul 27 19:33:24.053443 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:24.053427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq"
Jul 27 19:33:24.057579 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:24.057554    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-h7cg4\""
Jul 27 19:33:24.076310 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:24.076281    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq"]
Jul 27 19:33:24.099213 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:24.099189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxzs8\" (UniqueName: \"kubernetes.io/projected/0cc4e170-fc65-4df9-a246-341d9dbf0c5b-kube-api-access-lxzs8\") pod \"authorino-operator-75cc8d5cb7-4lnsq\" (UID: \"0cc4e170-fc65-4df9-a246-341d9dbf0c5b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq"
Jul 27 19:33:24.199788 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:24.199757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxzs8\" (UniqueName: \"kubernetes.io/projected/0cc4e170-fc65-4df9-a246-341d9dbf0c5b-kube-api-access-lxzs8\") pod \"authorino-operator-75cc8d5cb7-4lnsq\" (UID: \"0cc4e170-fc65-4df9-a246-341d9dbf0c5b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq"
Jul 27 19:33:24.211669 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:24.211648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxzs8\" (UniqueName: \"kubernetes.io/projected/0cc4e170-fc65-4df9-a246-341d9dbf0c5b-kube-api-access-lxzs8\") pod \"authorino-operator-75cc8d5cb7-4lnsq\" (UID: \"0cc4e170-fc65-4df9-a246-341d9dbf0c5b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq"
Jul 27 19:33:24.366021 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:24.365998    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq"
Jul 27 19:33:24.506176 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:24.506060    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq"]
Jul 27 19:33:24.509154 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:33:24.509125    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc4e170_fc65_4df9_a246_341d9dbf0c5b.slice/crio-0a8ec34f28ac7e39d57b3b5c89052b69857e02d1b1278ecc5c95aeaa29b2e9f9 WatchSource:0}: Error finding container 0a8ec34f28ac7e39d57b3b5c89052b69857e02d1b1278ecc5c95aeaa29b2e9f9: Status 404 returned error can't find the container with id 0a8ec34f28ac7e39d57b3b5c89052b69857e02d1b1278ecc5c95aeaa29b2e9f9
Jul 27 19:33:24.521588 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:24.521557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq" event={"ID":"0cc4e170-fc65-4df9-a246-341d9dbf0c5b","Type":"ContainerStarted","Data":"0a8ec34f28ac7e39d57b3b5c89052b69857e02d1b1278ecc5c95aeaa29b2e9f9"}
Jul 27 19:33:26.046912 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:26.046880    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"]
Jul 27 19:33:26.051671 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:26.051643    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:26.057086 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:26.057061    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4c2xb\""
Jul 27 19:33:26.066473 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:26.066445    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"]
Jul 27 19:33:26.116841 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:26.116807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbjwj\" (UniqueName: \"kubernetes.io/projected/533b3752-3d21-4ebf-8061-35dd28a4f6c6-kube-api-access-kbjwj\") pod \"limitador-operator-controller-manager-859d7b78bd-dwnnr\" (UID: \"533b3752-3d21-4ebf-8061-35dd28a4f6c6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:26.217597 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:26.217563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbjwj\" (UniqueName: \"kubernetes.io/projected/533b3752-3d21-4ebf-8061-35dd28a4f6c6-kube-api-access-kbjwj\") pod \"limitador-operator-controller-manager-859d7b78bd-dwnnr\" (UID: \"533b3752-3d21-4ebf-8061-35dd28a4f6c6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:26.232170 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:26.232139    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbjwj\" (UniqueName: \"kubernetes.io/projected/533b3752-3d21-4ebf-8061-35dd28a4f6c6-kube-api-access-kbjwj\") pod \"limitador-operator-controller-manager-859d7b78bd-dwnnr\" (UID: \"533b3752-3d21-4ebf-8061-35dd28a4f6c6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:26.363598 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:26.363390    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:26.941486 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:26.941462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"]
Jul 27 19:33:26.942645 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:33:26.942618    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533b3752_3d21_4ebf_8061_35dd28a4f6c6.slice/crio-8df95f75d2153f7b2ffbf5304c88b5bc54ac3e765eb3e573b47cc6d87d975d39 WatchSource:0}: Error finding container 8df95f75d2153f7b2ffbf5304c88b5bc54ac3e765eb3e573b47cc6d87d975d39: Status 404 returned error can't find the container with id 8df95f75d2153f7b2ffbf5304c88b5bc54ac3e765eb3e573b47cc6d87d975d39
Jul 27 19:33:27.537572 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:27.537534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq" event={"ID":"0cc4e170-fc65-4df9-a246-341d9dbf0c5b","Type":"ContainerStarted","Data":"17b06fa2507e0a4fec8f9ae8b6d4902c6a0af96877188d46677d8383eeb54167"}
Jul 27 19:33:27.538157 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:27.537640    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq"
Jul 27 19:33:27.539187 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:27.539166    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr" event={"ID":"533b3752-3d21-4ebf-8061-35dd28a4f6c6","Type":"ContainerStarted","Data":"8df95f75d2153f7b2ffbf5304c88b5bc54ac3e765eb3e573b47cc6d87d975d39"}
Jul 27 19:33:27.591748 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:27.591690    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq" podStartSLOduration=1.262316546 podStartE2EDuration="3.591667918s" totalImagesPullingTime="2.329351372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:27.590110188 +0000 UTC m=+568.733314569" watchObservedRunningTime="2026-07-27 19:33:27.591667918 +0000 UTC m=+568.734872293"
Jul 27 19:33:29.550278 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:29.550239    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr" event={"ID":"f63c5eaa-ea4d-45c9-9946-c3df7453c046","Type":"ContainerStarted","Data":"66115186d333f287ba79a448c98ed4beae9595a4d81bab78b65b46c06858019d"}
Jul 27 19:33:29.550650 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:29.550342    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:29.551808 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:29.551783    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr" event={"ID":"533b3752-3d21-4ebf-8061-35dd28a4f6c6","Type":"ContainerStarted","Data":"69169701ccd0f0215dad0c5b9dc480442bce11b0ca957310d2015ecc1a1e0d2c"}
Jul 27 19:33:29.551919 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:29.551842    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:29.587988 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:29.587927    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr" podStartSLOduration=1.002276754 podStartE2EDuration="8.587906681s" totalImagesPullingTime="7.585629927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:29.585939013 +0000 UTC m=+570.729143414" watchObservedRunningTime="2026-07-27 19:33:29.587906681 +0000 UTC m=+570.731111058"
Jul 27 19:33:29.618202 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:29.618152    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr" podStartSLOduration=1.0997013820000001 podStartE2EDuration="3.618135504s" totalImagesPullingTime="2.518434122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:29.616424914 +0000 UTC m=+570.759629317" watchObservedRunningTime="2026-07-27 19:33:29.618135504 +0000 UTC m=+570.761339879"
Jul 27 19:33:38.546667 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:38.546635    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4lnsq"
Jul 27 19:33:40.559580 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:40.559550    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:40.559952 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:40.559766    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:42.565109 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.565077    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"]
Jul 27 19:33:42.565507 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.565241    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr" podUID="f63c5eaa-ea4d-45c9-9946-c3df7453c046" containerName="manager" containerID="cri-o://66115186d333f287ba79a448c98ed4beae9595a4d81bab78b65b46c06858019d" gracePeriod=2
Jul 27 19:33:42.577831 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.577806    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"]
Jul 27 19:33:42.595689 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.595660    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"]
Jul 27 19:33:42.595853 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.595830    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr" podUID="533b3752-3d21-4ebf-8061-35dd28a4f6c6" containerName="manager" containerID="cri-o://69169701ccd0f0215dad0c5b9dc480442bce11b0ca957310d2015ecc1a1e0d2c" gracePeriod=2
Jul 27 19:33:42.605301 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.605270    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"]
Jul 27 19:33:42.605994 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.605729    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f63c5eaa-ea4d-45c9-9946-c3df7453c046" containerName="manager"
Jul 27 19:33:42.605994 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.605752    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f63c5eaa-ea4d-45c9-9946-c3df7453c046" containerName="manager"
Jul 27 19:33:42.605994 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.605852    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f63c5eaa-ea4d-45c9-9946-c3df7453c046" containerName="manager"
Jul 27 19:33:42.607705 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:33:42.607670    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-69dbr\" is forbidden: User \"system:node:ip-10-0-134-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-17.ec2.internal' and this object" podUID="f63c5eaa-ea4d-45c9-9946-c3df7453c046" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:42.608887 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.608864    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"]
Jul 27 19:33:42.608992 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.608975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"
Jul 27 19:33:42.630906 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.630887    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn"]
Jul 27 19:33:42.631298 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.631279    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="533b3752-3d21-4ebf-8061-35dd28a4f6c6" containerName="manager"
Jul 27 19:33:42.631375 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.631302    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="533b3752-3d21-4ebf-8061-35dd28a4f6c6" containerName="manager"
Jul 27 19:33:42.631435 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.631386    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="533b3752-3d21-4ebf-8061-35dd28a4f6c6" containerName="manager"
Jul 27 19:33:42.634930 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.634908    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"]
Jul 27 19:33:42.635092 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.635061    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn"
Jul 27 19:33:42.657958 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.657932    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn"]
Jul 27 19:33:42.661617 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:33:42.661591    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dwnnr\" is forbidden: User \"system:node:ip-10-0-134-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-17.ec2.internal' and this object" podUID="533b3752-3d21-4ebf-8061-35dd28a4f6c6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:42.664408 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:33:42.664386    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-69dbr\" is forbidden: User \"system:node:ip-10-0-134-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-17.ec2.internal' and this object" podUID="f63c5eaa-ea4d-45c9-9946-c3df7453c046" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:42.693021 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:33:42.692994    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dwnnr\" is forbidden: User \"system:node:ip-10-0-134-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-17.ec2.internal' and this object" podUID="533b3752-3d21-4ebf-8061-35dd28a4f6c6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:42.696140 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:33:42.696116    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-69dbr\" is forbidden: User \"system:node:ip-10-0-134-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-17.ec2.internal' and this object" podUID="f63c5eaa-ea4d-45c9-9946-c3df7453c046" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:42.743392 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.743359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvhhs\" (UniqueName: \"kubernetes.io/projected/2337cef6-7a6b-41a3-80a6-92cb6b925116-kube-api-access-wvhhs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6t7lz\" (UID: \"2337cef6-7a6b-41a3-80a6-92cb6b925116\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"
Jul 27 19:33:42.743392 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.743397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hzcd\" (UniqueName: \"kubernetes.io/projected/a91f763d-e7c7-42b5-9730-aadd40c5d242-kube-api-access-9hzcd\") pod \"limitador-operator-controller-manager-859d7b78bd-zzbdn\" (UID: \"a91f763d-e7c7-42b5-9730-aadd40c5d242\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn"
Jul 27 19:33:42.743572 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.743422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2337cef6-7a6b-41a3-80a6-92cb6b925116-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6t7lz\" (UID: \"2337cef6-7a6b-41a3-80a6-92cb6b925116\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"
Jul 27 19:33:42.844115 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.844084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvhhs\" (UniqueName: \"kubernetes.io/projected/2337cef6-7a6b-41a3-80a6-92cb6b925116-kube-api-access-wvhhs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6t7lz\" (UID: \"2337cef6-7a6b-41a3-80a6-92cb6b925116\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"
Jul 27 19:33:42.844218 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.844120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hzcd\" (UniqueName: \"kubernetes.io/projected/a91f763d-e7c7-42b5-9730-aadd40c5d242-kube-api-access-9hzcd\") pod \"limitador-operator-controller-manager-859d7b78bd-zzbdn\" (UID: \"a91f763d-e7c7-42b5-9730-aadd40c5d242\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn"
Jul 27 19:33:42.844218 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.844140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2337cef6-7a6b-41a3-80a6-92cb6b925116-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6t7lz\" (UID: \"2337cef6-7a6b-41a3-80a6-92cb6b925116\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"
Jul 27 19:33:42.844448 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.844428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2337cef6-7a6b-41a3-80a6-92cb6b925116-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6t7lz\" (UID: \"2337cef6-7a6b-41a3-80a6-92cb6b925116\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"
Jul 27 19:33:42.848555 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.848534    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:42.851244 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.851226    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:42.852817 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:33:42.852796    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dwnnr\" is forbidden: User \"system:node:ip-10-0-134-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-17.ec2.internal' and this object" podUID="533b3752-3d21-4ebf-8061-35dd28a4f6c6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:42.861072 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:33:42.861048    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-69dbr\" is forbidden: User \"system:node:ip-10-0-134-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-17.ec2.internal' and this object" podUID="f63c5eaa-ea4d-45c9-9946-c3df7453c046" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:42.866471 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:33:42.866453    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-69dbr\" is forbidden: User \"system:node:ip-10-0-134-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-17.ec2.internal' and this object" podUID="f63c5eaa-ea4d-45c9-9946-c3df7453c046" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:42.866805 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.866788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvhhs\" (UniqueName: \"kubernetes.io/projected/2337cef6-7a6b-41a3-80a6-92cb6b925116-kube-api-access-wvhhs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6t7lz\" (UID: \"2337cef6-7a6b-41a3-80a6-92cb6b925116\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"
Jul 27 19:33:42.869938 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:33:42.869915    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dwnnr\" is forbidden: User \"system:node:ip-10-0-134-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-17.ec2.internal' and this object" podUID="533b3752-3d21-4ebf-8061-35dd28a4f6c6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:42.888349 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.888325    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hzcd\" (UniqueName: \"kubernetes.io/projected/a91f763d-e7c7-42b5-9730-aadd40c5d242-kube-api-access-9hzcd\") pod \"limitador-operator-controller-manager-859d7b78bd-zzbdn\" (UID: \"a91f763d-e7c7-42b5-9730-aadd40c5d242\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn"
Jul 27 19:33:42.945376 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.945356    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbjwj\" (UniqueName: \"kubernetes.io/projected/533b3752-3d21-4ebf-8061-35dd28a4f6c6-kube-api-access-kbjwj\") pod \"533b3752-3d21-4ebf-8061-35dd28a4f6c6\" (UID: \"533b3752-3d21-4ebf-8061-35dd28a4f6c6\") "
Jul 27 19:33:42.945478 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.945383    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbtfv\" (UniqueName: \"kubernetes.io/projected/f63c5eaa-ea4d-45c9-9946-c3df7453c046-kube-api-access-tbtfv\") pod \"f63c5eaa-ea4d-45c9-9946-c3df7453c046\" (UID: \"f63c5eaa-ea4d-45c9-9946-c3df7453c046\") "
Jul 27 19:33:42.945478 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.945427    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f63c5eaa-ea4d-45c9-9946-c3df7453c046-extensions-socket-volume\") pod \"f63c5eaa-ea4d-45c9-9946-c3df7453c046\" (UID: \"f63c5eaa-ea4d-45c9-9946-c3df7453c046\") "
Jul 27 19:33:42.945961 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.945941    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f63c5eaa-ea4d-45c9-9946-c3df7453c046-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f63c5eaa-ea4d-45c9-9946-c3df7453c046" (UID: "f63c5eaa-ea4d-45c9-9946-c3df7453c046"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:42.947459 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.947439    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/533b3752-3d21-4ebf-8061-35dd28a4f6c6-kube-api-access-kbjwj" (OuterVolumeSpecName: "kube-api-access-kbjwj") pod "533b3752-3d21-4ebf-8061-35dd28a4f6c6" (UID: "533b3752-3d21-4ebf-8061-35dd28a4f6c6"). InnerVolumeSpecName "kube-api-access-kbjwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:42.947532 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:42.947516    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f63c5eaa-ea4d-45c9-9946-c3df7453c046-kube-api-access-tbtfv" (OuterVolumeSpecName: "kube-api-access-tbtfv") pod "f63c5eaa-ea4d-45c9-9946-c3df7453c046" (UID: "f63c5eaa-ea4d-45c9-9946-c3df7453c046"). InnerVolumeSpecName "kube-api-access-tbtfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:43.004776 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.004753    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"
Jul 27 19:33:43.010793 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.010773    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn"
Jul 27 19:33:43.046240 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.046202    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f63c5eaa-ea4d-45c9-9946-c3df7453c046-extensions-socket-volume\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:33:43.046240 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.046241    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbjwj\" (UniqueName: \"kubernetes.io/projected/533b3752-3d21-4ebf-8061-35dd28a4f6c6-kube-api-access-kbjwj\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:33:43.046461 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.046255    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbtfv\" (UniqueName: \"kubernetes.io/projected/f63c5eaa-ea4d-45c9-9946-c3df7453c046-kube-api-access-tbtfv\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:33:43.157110 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.157086    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"]
Jul 27 19:33:43.159440 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:33:43.159418    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2337cef6_7a6b_41a3_80a6_92cb6b925116.slice/crio-63269155e4f2961dce50e0c70b735880277bd75b7bd1c826e842b62111b6746c WatchSource:0}: Error finding container 63269155e4f2961dce50e0c70b735880277bd75b7bd1c826e842b62111b6746c: Status 404 returned error can't find the container with id 63269155e4f2961dce50e0c70b735880277bd75b7bd1c826e842b62111b6746c
Jul 27 19:33:43.172455 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.172435    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn"]
Jul 27 19:33:43.174599 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:33:43.174576    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91f763d_e7c7_42b5_9730_aadd40c5d242.slice/crio-d1f2f1de0bd72aa58cae5d4c459cddfc156b60a077fb9656cef9c1a0348143ff WatchSource:0}: Error finding container d1f2f1de0bd72aa58cae5d4c459cddfc156b60a077fb9656cef9c1a0348143ff: Status 404 returned error can't find the container with id d1f2f1de0bd72aa58cae5d4c459cddfc156b60a077fb9656cef9c1a0348143ff
Jul 27 19:33:43.372176 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.372099    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="533b3752-3d21-4ebf-8061-35dd28a4f6c6" path="/var/lib/kubelet/pods/533b3752-3d21-4ebf-8061-35dd28a4f6c6/volumes"
Jul 27 19:33:43.372434 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.372422    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f63c5eaa-ea4d-45c9-9946-c3df7453c046" path="/var/lib/kubelet/pods/f63c5eaa-ea4d-45c9-9946-c3df7453c046/volumes"
Jul 27 19:33:43.614255 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.614221    2563 generic.go:356] "Generic (PLEG): container finished" podID="533b3752-3d21-4ebf-8061-35dd28a4f6c6" containerID="69169701ccd0f0215dad0c5b9dc480442bce11b0ca957310d2015ecc1a1e0d2c" exitCode=0
Jul 27 19:33:43.614689 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.614281    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwnnr"
Jul 27 19:33:43.614689 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.614321    2563 scope.go:117] "RemoveContainer" containerID="69169701ccd0f0215dad0c5b9dc480442bce11b0ca957310d2015ecc1a1e0d2c"
Jul 27 19:33:43.616438 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.616399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz" event={"ID":"2337cef6-7a6b-41a3-80a6-92cb6b925116","Type":"ContainerStarted","Data":"6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c"}
Jul 27 19:33:43.616589 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.616471    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz" event={"ID":"2337cef6-7a6b-41a3-80a6-92cb6b925116","Type":"ContainerStarted","Data":"63269155e4f2961dce50e0c70b735880277bd75b7bd1c826e842b62111b6746c"}
Jul 27 19:33:43.616589 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.616525    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"
Jul 27 19:33:43.618244 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.618219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn" event={"ID":"a91f763d-e7c7-42b5-9730-aadd40c5d242","Type":"ContainerStarted","Data":"e73a4f3eaa8a2f0003dc0afe5d64fbed4c7e3f8d295822cc878e7e5943a04e24"}
Jul 27 19:33:43.618337 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.618265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn" event={"ID":"a91f763d-e7c7-42b5-9730-aadd40c5d242","Type":"ContainerStarted","Data":"d1f2f1de0bd72aa58cae5d4c459cddfc156b60a077fb9656cef9c1a0348143ff"}
Jul 27 19:33:43.618337 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.618295    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn"
Jul 27 19:33:43.619672 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.619646    2563 generic.go:356] "Generic (PLEG): container finished" podID="f63c5eaa-ea4d-45c9-9946-c3df7453c046" containerID="66115186d333f287ba79a448c98ed4beae9595a4d81bab78b65b46c06858019d" exitCode=0
Jul 27 19:33:43.619757 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.619682    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dbr"
Jul 27 19:33:43.623295 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.623281    2563 scope.go:117] "RemoveContainer" containerID="69169701ccd0f0215dad0c5b9dc480442bce11b0ca957310d2015ecc1a1e0d2c"
Jul 27 19:33:43.623534 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:33:43.623516    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69169701ccd0f0215dad0c5b9dc480442bce11b0ca957310d2015ecc1a1e0d2c\": container with ID starting with 69169701ccd0f0215dad0c5b9dc480442bce11b0ca957310d2015ecc1a1e0d2c not found: ID does not exist" containerID="69169701ccd0f0215dad0c5b9dc480442bce11b0ca957310d2015ecc1a1e0d2c"
Jul 27 19:33:43.623590 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.623540    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69169701ccd0f0215dad0c5b9dc480442bce11b0ca957310d2015ecc1a1e0d2c"} err="failed to get container status \"69169701ccd0f0215dad0c5b9dc480442bce11b0ca957310d2015ecc1a1e0d2c\": rpc error: code = NotFound desc = could not find container \"69169701ccd0f0215dad0c5b9dc480442bce11b0ca957310d2015ecc1a1e0d2c\": container with ID starting with 69169701ccd0f0215dad0c5b9dc480442bce11b0ca957310d2015ecc1a1e0d2c not found: ID does not exist"
Jul 27 19:33:43.623590 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.623558    2563 scope.go:117] "RemoveContainer" containerID="66115186d333f287ba79a448c98ed4beae9595a4d81bab78b65b46c06858019d"
Jul 27 19:33:43.630878 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.630861    2563 scope.go:117] "RemoveContainer" containerID="66115186d333f287ba79a448c98ed4beae9595a4d81bab78b65b46c06858019d"
Jul 27 19:33:43.631182 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:33:43.631162    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66115186d333f287ba79a448c98ed4beae9595a4d81bab78b65b46c06858019d\": container with ID starting with 66115186d333f287ba79a448c98ed4beae9595a4d81bab78b65b46c06858019d not found: ID does not exist" containerID="66115186d333f287ba79a448c98ed4beae9595a4d81bab78b65b46c06858019d"
Jul 27 19:33:43.631255 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.631190    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66115186d333f287ba79a448c98ed4beae9595a4d81bab78b65b46c06858019d"} err="failed to get container status \"66115186d333f287ba79a448c98ed4beae9595a4d81bab78b65b46c06858019d\": rpc error: code = NotFound desc = could not find container \"66115186d333f287ba79a448c98ed4beae9595a4d81bab78b65b46c06858019d\": container with ID starting with 66115186d333f287ba79a448c98ed4beae9595a4d81bab78b65b46c06858019d not found: ID does not exist"
Jul 27 19:33:43.670896 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.670855    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn" podStartSLOduration=1.6708429489999999 podStartE2EDuration="1.670842949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:43.669986332 +0000 UTC m=+584.813190709" watchObservedRunningTime="2026-07-27 19:33:43.670842949 +0000 UTC m=+584.814047325"
Jul 27 19:33:43.671285 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.671264    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz" podStartSLOduration=1.671258882 podStartE2EDuration="1.671258882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:43.640472137 +0000 UTC m=+584.783676512" watchObservedRunningTime="2026-07-27 19:33:43.671258882 +0000 UTC m=+584.814463258"
Jul 27 19:33:43.771826 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.771794    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"]
Jul 27 19:33:43.776249 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.776234    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"
Jul 27 19:33:43.791527 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.791504    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"]
Jul 27 19:33:43.852255 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.852223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwdhf\" (UniqueName: \"kubernetes.io/projected/e90434cb-13ea-4939-86bd-240e85f51782-kube-api-access-gwdhf\") pod \"kuadrant-operator-controller-manager-86878c769f-b4fs6\" (UID: \"e90434cb-13ea-4939-86bd-240e85f51782\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"
Jul 27 19:33:43.852397 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.852269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e90434cb-13ea-4939-86bd-240e85f51782-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b4fs6\" (UID: \"e90434cb-13ea-4939-86bd-240e85f51782\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"
Jul 27 19:33:43.953534 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.953458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e90434cb-13ea-4939-86bd-240e85f51782-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b4fs6\" (UID: \"e90434cb-13ea-4939-86bd-240e85f51782\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"
Jul 27 19:33:43.953652 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.953552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwdhf\" (UniqueName: \"kubernetes.io/projected/e90434cb-13ea-4939-86bd-240e85f51782-kube-api-access-gwdhf\") pod \"kuadrant-operator-controller-manager-86878c769f-b4fs6\" (UID: \"e90434cb-13ea-4939-86bd-240e85f51782\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"
Jul 27 19:33:43.953890 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.953869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e90434cb-13ea-4939-86bd-240e85f51782-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b4fs6\" (UID: \"e90434cb-13ea-4939-86bd-240e85f51782\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"
Jul 27 19:33:43.965244 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:43.965221    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwdhf\" (UniqueName: \"kubernetes.io/projected/e90434cb-13ea-4939-86bd-240e85f51782-kube-api-access-gwdhf\") pod \"kuadrant-operator-controller-manager-86878c769f-b4fs6\" (UID: \"e90434cb-13ea-4939-86bd-240e85f51782\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"
Jul 27 19:33:44.087551 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:44.087518    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"
Jul 27 19:33:44.309560 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:44.309533    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"]
Jul 27 19:33:44.310449 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:33:44.310427    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90434cb_13ea_4939_86bd_240e85f51782.slice/crio-ae1d1167d0d4d4ab79eb1038a4c8ac04e62bc9e99d0b15846e4787a53f90e857 WatchSource:0}: Error finding container ae1d1167d0d4d4ab79eb1038a4c8ac04e62bc9e99d0b15846e4787a53f90e857: Status 404 returned error can't find the container with id ae1d1167d0d4d4ab79eb1038a4c8ac04e62bc9e99d0b15846e4787a53f90e857
Jul 27 19:33:44.627413 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:44.627326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6" event={"ID":"e90434cb-13ea-4939-86bd-240e85f51782","Type":"ContainerStarted","Data":"d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d"}
Jul 27 19:33:44.627413 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:44.627379    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6" event={"ID":"e90434cb-13ea-4939-86bd-240e85f51782","Type":"ContainerStarted","Data":"ae1d1167d0d4d4ab79eb1038a4c8ac04e62bc9e99d0b15846e4787a53f90e857"}
Jul 27 19:33:44.627413 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:44.627409    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"
Jul 27 19:33:54.630584 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:54.630552    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzbdn"
Jul 27 19:33:54.631077 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:54.630744    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"
Jul 27 19:33:54.658328 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:54.658273    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6" podStartSLOduration=11.658260284 podStartE2EDuration="11.658260284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:44.651684128 +0000 UTC m=+585.794888503" watchObservedRunningTime="2026-07-27 19:33:54.658260284 +0000 UTC m=+595.801464638"
Jul 27 19:33:55.636308 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:55.636277    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"
Jul 27 19:33:55.698763 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:55.698735    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"]
Jul 27 19:33:55.698941 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:55.698919    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz" podUID="2337cef6-7a6b-41a3-80a6-92cb6b925116" containerName="manager" containerID="cri-o://6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c" gracePeriod=10
Jul 27 19:33:55.987285 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:55.987254    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"
Jul 27 19:33:56.038009 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.037981    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2337cef6-7a6b-41a3-80a6-92cb6b925116-extensions-socket-volume\") pod \"2337cef6-7a6b-41a3-80a6-92cb6b925116\" (UID: \"2337cef6-7a6b-41a3-80a6-92cb6b925116\") "
Jul 27 19:33:56.038182 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.038096    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvhhs\" (UniqueName: \"kubernetes.io/projected/2337cef6-7a6b-41a3-80a6-92cb6b925116-kube-api-access-wvhhs\") pod \"2337cef6-7a6b-41a3-80a6-92cb6b925116\" (UID: \"2337cef6-7a6b-41a3-80a6-92cb6b925116\") "
Jul 27 19:33:56.038428 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.038401    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2337cef6-7a6b-41a3-80a6-92cb6b925116-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2337cef6-7a6b-41a3-80a6-92cb6b925116" (UID: "2337cef6-7a6b-41a3-80a6-92cb6b925116"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:56.040152 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.040130    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2337cef6-7a6b-41a3-80a6-92cb6b925116-kube-api-access-wvhhs" (OuterVolumeSpecName: "kube-api-access-wvhhs") pod "2337cef6-7a6b-41a3-80a6-92cb6b925116" (UID: "2337cef6-7a6b-41a3-80a6-92cb6b925116"). InnerVolumeSpecName "kube-api-access-wvhhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:56.139709 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.139649    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvhhs\" (UniqueName: \"kubernetes.io/projected/2337cef6-7a6b-41a3-80a6-92cb6b925116-kube-api-access-wvhhs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:33:56.139709 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.139671    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2337cef6-7a6b-41a3-80a6-92cb6b925116-extensions-socket-volume\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:33:56.682629 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.682596    2563 generic.go:356] "Generic (PLEG): container finished" podID="2337cef6-7a6b-41a3-80a6-92cb6b925116" containerID="6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c" exitCode=0
Jul 27 19:33:56.683097 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.682648    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"
Jul 27 19:33:56.683097 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.682685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz" event={"ID":"2337cef6-7a6b-41a3-80a6-92cb6b925116","Type":"ContainerDied","Data":"6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c"}
Jul 27 19:33:56.683097 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.682737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz" event={"ID":"2337cef6-7a6b-41a3-80a6-92cb6b925116","Type":"ContainerDied","Data":"63269155e4f2961dce50e0c70b735880277bd75b7bd1c826e842b62111b6746c"}
Jul 27 19:33:56.683097 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.682760    2563 scope.go:117] "RemoveContainer" containerID="6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c"
Jul 27 19:33:56.691164 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.691134    2563 scope.go:117] "RemoveContainer" containerID="6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c"
Jul 27 19:33:56.691391 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:33:56.691377    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c\": container with ID starting with 6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c not found: ID does not exist" containerID="6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c"
Jul 27 19:33:56.691437 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.691398    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c"} err="failed to get container status \"6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c\": rpc error: code = NotFound desc = could not find container \"6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c\": container with ID starting with 6c306e9bf5585275f2d9b1394812e36b5fcdd8401a7d3d71958c2ac420c5ab3c not found: ID does not exist"
Jul 27 19:33:56.708254 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.708230    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"]
Jul 27 19:33:56.718061 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:56.718025    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6t7lz"]
Jul 27 19:33:57.371462 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:33:57.371433    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2337cef6-7a6b-41a3-80a6-92cb6b925116" path="/var/lib/kubelet/pods/2337cef6-7a6b-41a3-80a6-92cb6b925116/volumes"
Jul 27 19:34:11.998747 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:11.998717    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"]
Jul 27 19:34:11.999153 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:11.999025    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2337cef6-7a6b-41a3-80a6-92cb6b925116" containerName="manager"
Jul 27 19:34:11.999153 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:11.999053    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2337cef6-7a6b-41a3-80a6-92cb6b925116" containerName="manager"
Jul 27 19:34:11.999153 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:11.999111    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2337cef6-7a6b-41a3-80a6-92cb6b925116" containerName="manager"
Jul 27 19:34:12.002154 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.002139    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.005273 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.005251    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bm452\""
Jul 27 19:34:12.022522 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.022497    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"]
Jul 27 19:34:12.162430 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.162399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.162598 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.162444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.162598 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.162471    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.162598 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.162546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.162598 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.162591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.162807 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.162646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.162807 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.162665    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhkjs\" (UniqueName: \"kubernetes.io/projected/b11a86c7-2f27-42a6-bf83-dd394ca260f1-kube-api-access-dhkjs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.162807 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.162683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.162807 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.162702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.263969 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.263884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.263969 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.263926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.263969 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.263949    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.264261 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.263978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.264261 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.264027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.264261 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.264066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhkjs\" (UniqueName: \"kubernetes.io/projected/b11a86c7-2f27-42a6-bf83-dd394ca260f1-kube-api-access-dhkjs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.264261 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.264083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.264261 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.264116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.264261 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.264143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.264565 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.264469    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.264621 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.264582    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.264682 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.264659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.264810 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.264782    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.265220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.265197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.266504 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.266479    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.266612 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.266596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.274788 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.274766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b11a86c7-2f27-42a6-bf83-dd394ca260f1-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.274943 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.274921    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhkjs\" (UniqueName: \"kubernetes.io/projected/b11a86c7-2f27-42a6-bf83-dd394ca260f1-kube-api-access-dhkjs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8kxns\" (UID: \"b11a86c7-2f27-42a6-bf83-dd394ca260f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.312411 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.312379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:12.452615 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.452588    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"]
Jul 27 19:34:12.454483 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:34:12.454458    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11a86c7_2f27_42a6_bf83_dd394ca260f1.slice/crio-b6009f33e7c7aa3c839ba3b1e1c99dd2163fcf77a58172a4eadfe13cc89e7371 WatchSource:0}: Error finding container b6009f33e7c7aa3c839ba3b1e1c99dd2163fcf77a58172a4eadfe13cc89e7371: Status 404 returned error can't find the container with id b6009f33e7c7aa3c839ba3b1e1c99dd2163fcf77a58172a4eadfe13cc89e7371
Jul 27 19:34:12.456525 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.456493    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:34:12.456618 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.456569    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:34:12.456678 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.456614    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:34:12.757972 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.757938    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns" event={"ID":"b11a86c7-2f27-42a6-bf83-dd394ca260f1","Type":"ContainerStarted","Data":"4e62a14d66ff6ac0155f965a7badc0cc1d900678abbecd4f12c5a9ab59225e38"}
Jul 27 19:34:12.758189 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.757998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns" event={"ID":"b11a86c7-2f27-42a6-bf83-dd394ca260f1","Type":"ContainerStarted","Data":"b6009f33e7c7aa3c839ba3b1e1c99dd2163fcf77a58172a4eadfe13cc89e7371"}
Jul 27 19:34:12.780134 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:12.780085    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns" podStartSLOduration=1.780066334 podStartE2EDuration="1.780066334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:12.779097388 +0000 UTC m=+613.922301758" watchObservedRunningTime="2026-07-27 19:34:12.780066334 +0000 UTC m=+613.923270711"
Jul 27 19:34:13.313081 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:13.313052    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:13.317772 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:13.317742    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:13.763151 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:13.763073    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:13.763963 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:13.763945    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:34:14.673476 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:14.673435    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-bk765"]
Jul 27 19:34:14.675842 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:14.675820    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bk765"
Jul 27 19:34:14.678657 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:14.678633    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-h8746\""
Jul 27 19:34:14.681663 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:14.681638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bk765"]
Jul 27 19:34:14.788436 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:14.788399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpkz4\" (UniqueName: \"kubernetes.io/projected/d9d79b1d-53ae-46ba-aeec-6faee4ffb070-kube-api-access-hpkz4\") pod \"authorino-58cd955675-bk765\" (UID: \"d9d79b1d-53ae-46ba-aeec-6faee4ffb070\") " pod="kuadrant-system/authorino-58cd955675-bk765"
Jul 27 19:34:14.888989 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:14.888952    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpkz4\" (UniqueName: \"kubernetes.io/projected/d9d79b1d-53ae-46ba-aeec-6faee4ffb070-kube-api-access-hpkz4\") pod \"authorino-58cd955675-bk765\" (UID: \"d9d79b1d-53ae-46ba-aeec-6faee4ffb070\") " pod="kuadrant-system/authorino-58cd955675-bk765"
Jul 27 19:34:14.903878 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:14.903844    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-gq6tc"]
Jul 27 19:34:14.906165 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:14.906140    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gq6tc"
Jul 27 19:34:14.906394 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:14.906372    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpkz4\" (UniqueName: \"kubernetes.io/projected/d9d79b1d-53ae-46ba-aeec-6faee4ffb070-kube-api-access-hpkz4\") pod \"authorino-58cd955675-bk765\" (UID: \"d9d79b1d-53ae-46ba-aeec-6faee4ffb070\") " pod="kuadrant-system/authorino-58cd955675-bk765"
Jul 27 19:34:14.919030 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:14.919005    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gq6tc"]
Jul 27 19:34:14.986764 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:14.986695    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bk765"
Jul 27 19:34:14.989693 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:14.989670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92hdf\" (UniqueName: \"kubernetes.io/projected/a5085b24-36d1-4022-b308-f8564b8d5e81-kube-api-access-92hdf\") pod \"authorino-75d556bd77-gq6tc\" (UID: \"a5085b24-36d1-4022-b308-f8564b8d5e81\") " pod="kuadrant-system/authorino-75d556bd77-gq6tc"
Jul 27 19:34:15.090579 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:15.090549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92hdf\" (UniqueName: \"kubernetes.io/projected/a5085b24-36d1-4022-b308-f8564b8d5e81-kube-api-access-92hdf\") pod \"authorino-75d556bd77-gq6tc\" (UID: \"a5085b24-36d1-4022-b308-f8564b8d5e81\") " pod="kuadrant-system/authorino-75d556bd77-gq6tc"
Jul 27 19:34:15.100670 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:15.100641    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92hdf\" (UniqueName: \"kubernetes.io/projected/a5085b24-36d1-4022-b308-f8564b8d5e81-kube-api-access-92hdf\") pod \"authorino-75d556bd77-gq6tc\" (UID: \"a5085b24-36d1-4022-b308-f8564b8d5e81\") " pod="kuadrant-system/authorino-75d556bd77-gq6tc"
Jul 27 19:34:15.114462 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:15.114439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bk765"]
Jul 27 19:34:15.116397 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:34:15.116369    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9d79b1d_53ae_46ba_aeec_6faee4ffb070.slice/crio-439c7fae1646f97658dcfd8780f0abe912a672cfe4f398a1ce11c3bf70c13070 WatchSource:0}: Error finding container 439c7fae1646f97658dcfd8780f0abe912a672cfe4f398a1ce11c3bf70c13070: Status 404 returned error can't find the container with id 439c7fae1646f97658dcfd8780f0abe912a672cfe4f398a1ce11c3bf70c13070
Jul 27 19:34:15.222732 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:15.222701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gq6tc"
Jul 27 19:34:15.354844 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:15.354822    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gq6tc"]
Jul 27 19:34:15.357523 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:34:15.357484    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5085b24_36d1_4022_b308_f8564b8d5e81.slice/crio-7bcd21ba1dc77790899fc5eaf57c66e47a0bff3e178cef6a9ff777fac635fb03 WatchSource:0}: Error finding container 7bcd21ba1dc77790899fc5eaf57c66e47a0bff3e178cef6a9ff777fac635fb03: Status 404 returned error can't find the container with id 7bcd21ba1dc77790899fc5eaf57c66e47a0bff3e178cef6a9ff777fac635fb03
Jul 27 19:34:15.773074 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:15.773023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gq6tc" event={"ID":"a5085b24-36d1-4022-b308-f8564b8d5e81","Type":"ContainerStarted","Data":"7bcd21ba1dc77790899fc5eaf57c66e47a0bff3e178cef6a9ff777fac635fb03"}
Jul 27 19:34:15.774075 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:15.774028    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bk765" event={"ID":"d9d79b1d-53ae-46ba-aeec-6faee4ffb070","Type":"ContainerStarted","Data":"439c7fae1646f97658dcfd8780f0abe912a672cfe4f398a1ce11c3bf70c13070"}
Jul 27 19:34:18.795120 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:18.795088    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gq6tc" event={"ID":"a5085b24-36d1-4022-b308-f8564b8d5e81","Type":"ContainerStarted","Data":"9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2"}
Jul 27 19:34:18.797233 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:18.797205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bk765" event={"ID":"d9d79b1d-53ae-46ba-aeec-6faee4ffb070","Type":"ContainerStarted","Data":"04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5"}
Jul 27 19:34:18.818337 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:18.818285    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-gq6tc" podStartSLOduration=1.509703766 podStartE2EDuration="4.81826562s" totalImagesPullingTime="3.308561854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:18.817017595 +0000 UTC m=+619.960221952" watchObservedRunningTime="2026-07-27 19:34:18.81826562 +0000 UTC m=+619.961469997"
Jul 27 19:34:18.842074 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:18.842004    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-bk765" podStartSLOduration=1.2967003 podStartE2EDuration="4.841984444s" totalImagesPullingTime="3.545284144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:18.840481625 +0000 UTC m=+619.983686002" watchObservedRunningTime="2026-07-27 19:34:18.841984444 +0000 UTC m=+619.985188866"
Jul 27 19:34:18.858892 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:18.858851    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bk765"]
Jul 27 19:34:20.805401 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:20.805322    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-bk765" podUID="d9d79b1d-53ae-46ba-aeec-6faee4ffb070" containerName="authorino" containerID="cri-o://04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5" gracePeriod=30
Jul 27 19:34:21.049310 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.049288    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bk765"
Jul 27 19:34:21.152281 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.152213    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpkz4\" (UniqueName: \"kubernetes.io/projected/d9d79b1d-53ae-46ba-aeec-6faee4ffb070-kube-api-access-hpkz4\") pod \"d9d79b1d-53ae-46ba-aeec-6faee4ffb070\" (UID: \"d9d79b1d-53ae-46ba-aeec-6faee4ffb070\") "
Jul 27 19:34:21.154370 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.154344    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9d79b1d-53ae-46ba-aeec-6faee4ffb070-kube-api-access-hpkz4" (OuterVolumeSpecName: "kube-api-access-hpkz4") pod "d9d79b1d-53ae-46ba-aeec-6faee4ffb070" (UID: "d9d79b1d-53ae-46ba-aeec-6faee4ffb070"). InnerVolumeSpecName "kube-api-access-hpkz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:21.252939 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.252917    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpkz4\" (UniqueName: \"kubernetes.io/projected/d9d79b1d-53ae-46ba-aeec-6faee4ffb070-kube-api-access-hpkz4\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:34:21.810540 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.810506    2563 generic.go:356] "Generic (PLEG): container finished" podID="d9d79b1d-53ae-46ba-aeec-6faee4ffb070" containerID="04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5" exitCode=0
Jul 27 19:34:21.810982 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.810547    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bk765"
Jul 27 19:34:21.810982 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.810590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bk765" event={"ID":"d9d79b1d-53ae-46ba-aeec-6faee4ffb070","Type":"ContainerDied","Data":"04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5"}
Jul 27 19:34:21.810982 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.810626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bk765" event={"ID":"d9d79b1d-53ae-46ba-aeec-6faee4ffb070","Type":"ContainerDied","Data":"439c7fae1646f97658dcfd8780f0abe912a672cfe4f398a1ce11c3bf70c13070"}
Jul 27 19:34:21.810982 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.810643    2563 scope.go:117] "RemoveContainer" containerID="04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5"
Jul 27 19:34:21.819000 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.818984    2563 scope.go:117] "RemoveContainer" containerID="04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5"
Jul 27 19:34:21.819259 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:34:21.819242    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5\": container with ID starting with 04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5 not found: ID does not exist" containerID="04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5"
Jul 27 19:34:21.819326 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.819266    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5"} err="failed to get container status \"04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5\": rpc error: code = NotFound desc = could not find container \"04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5\": container with ID starting with 04252c0780546d5fa2de635c75cca83f5eac8f20f8c6cd3cff7aed823c9938e5 not found: ID does not exist"
Jul 27 19:34:21.831421 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.831402    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bk765"]
Jul 27 19:34:21.836418 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:21.836400    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-bk765"]
Jul 27 19:34:23.372175 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:23.372139    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9d79b1d-53ae-46ba-aeec-6faee4ffb070" path="/var/lib/kubelet/pods/d9d79b1d-53ae-46ba-aeec-6faee4ffb070/volumes"
Jul 27 19:34:42.768908 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:42.768870    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-czdsf"]
Jul 27 19:34:42.774449 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:42.769261    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d79b1d-53ae-46ba-aeec-6faee4ffb070" containerName="authorino"
Jul 27 19:34:42.774449 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:42.769273    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d79b1d-53ae-46ba-aeec-6faee4ffb070" containerName="authorino"
Jul 27 19:34:42.774449 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:42.769341    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d79b1d-53ae-46ba-aeec-6faee4ffb070" containerName="authorino"
Jul 27 19:34:42.775312 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:42.775294    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-czdsf"
Jul 27 19:34:42.780598 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:42.780560    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-czdsf"]
Jul 27 19:34:42.822349 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:42.822319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dsc4\" (UniqueName: \"kubernetes.io/projected/02ef1df2-b9d9-4199-bcca-af26ed202b33-kube-api-access-7dsc4\") pod \"authorino-5d4b67c446-czdsf\" (UID: \"02ef1df2-b9d9-4199-bcca-af26ed202b33\") " pod="kuadrant-system/authorino-5d4b67c446-czdsf"
Jul 27 19:34:42.923001 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:42.922974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dsc4\" (UniqueName: \"kubernetes.io/projected/02ef1df2-b9d9-4199-bcca-af26ed202b33-kube-api-access-7dsc4\") pod \"authorino-5d4b67c446-czdsf\" (UID: \"02ef1df2-b9d9-4199-bcca-af26ed202b33\") " pod="kuadrant-system/authorino-5d4b67c446-czdsf"
Jul 27 19:34:42.934214 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:42.934186    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dsc4\" (UniqueName: \"kubernetes.io/projected/02ef1df2-b9d9-4199-bcca-af26ed202b33-kube-api-access-7dsc4\") pod \"authorino-5d4b67c446-czdsf\" (UID: \"02ef1df2-b9d9-4199-bcca-af26ed202b33\") " pod="kuadrant-system/authorino-5d4b67c446-czdsf"
Jul 27 19:34:42.996013 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:42.995984    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-czdsf"]
Jul 27 19:34:42.996244 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:42.996232    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-czdsf"
Jul 27 19:34:43.029788 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.029718    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75b854f88d-t5p4z"]
Jul 27 19:34:43.033916 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.033889    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b854f88d-t5p4z"
Jul 27 19:34:43.043599 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.043575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75b854f88d-t5p4z"]
Jul 27 19:34:43.121856 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.121825    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75b854f88d-t5p4z"]
Jul 27 19:34:43.122123 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:34:43.122103    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-88gpz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-75b854f88d-t5p4z" podUID="73198dd6-aa93-4df3-8a18-34394ffc3363"
Jul 27 19:34:43.124355 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.124333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88gpz\" (UniqueName: \"kubernetes.io/projected/73198dd6-aa93-4df3-8a18-34394ffc3363-kube-api-access-88gpz\") pod \"authorino-75b854f88d-t5p4z\" (UID: \"73198dd6-aa93-4df3-8a18-34394ffc3363\") " pod="kuadrant-system/authorino-75b854f88d-t5p4z"
Jul 27 19:34:43.138341 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.138321    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-czdsf"]
Jul 27 19:34:43.141337 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:34:43.141310    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02ef1df2_b9d9_4199_bcca_af26ed202b33.slice/crio-6ffc07829d93f4e061e9b26729ed0a24f7bfc0b797fa3eb0749a914b600cefec WatchSource:0}: Error finding container 6ffc07829d93f4e061e9b26729ed0a24f7bfc0b797fa3eb0749a914b600cefec: Status 404 returned error can't find the container with id 6ffc07829d93f4e061e9b26729ed0a24f7bfc0b797fa3eb0749a914b600cefec
Jul 27 19:34:43.155808 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.155788    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7446d58b9b-wj2r2"]
Jul 27 19:34:43.160361 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.159700    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7446d58b9b-wj2r2"
Jul 27 19:34:43.163972 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.163949    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 19:34:43.170181 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.170158    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7446d58b9b-wj2r2"]
Jul 27 19:34:43.224941 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.224913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qmff\" (UniqueName: \"kubernetes.io/projected/7002502a-c9ae-42f5-b0bd-73d1594e7454-kube-api-access-9qmff\") pod \"authorino-7446d58b9b-wj2r2\" (UID: \"7002502a-c9ae-42f5-b0bd-73d1594e7454\") " pod="kuadrant-system/authorino-7446d58b9b-wj2r2"
Jul 27 19:34:43.225090 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.224976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88gpz\" (UniqueName: \"kubernetes.io/projected/73198dd6-aa93-4df3-8a18-34394ffc3363-kube-api-access-88gpz\") pod \"authorino-75b854f88d-t5p4z\" (UID: \"73198dd6-aa93-4df3-8a18-34394ffc3363\") " pod="kuadrant-system/authorino-75b854f88d-t5p4z"
Jul 27 19:34:43.225145 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.225124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7002502a-c9ae-42f5-b0bd-73d1594e7454-tls-cert\") pod \"authorino-7446d58b9b-wj2r2\" (UID: \"7002502a-c9ae-42f5-b0bd-73d1594e7454\") " pod="kuadrant-system/authorino-7446d58b9b-wj2r2"
Jul 27 19:34:43.235929 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.235903    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88gpz\" (UniqueName: \"kubernetes.io/projected/73198dd6-aa93-4df3-8a18-34394ffc3363-kube-api-access-88gpz\") pod \"authorino-75b854f88d-t5p4z\" (UID: \"73198dd6-aa93-4df3-8a18-34394ffc3363\") " pod="kuadrant-system/authorino-75b854f88d-t5p4z"
Jul 27 19:34:43.326184 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.326149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7002502a-c9ae-42f5-b0bd-73d1594e7454-tls-cert\") pod \"authorino-7446d58b9b-wj2r2\" (UID: \"7002502a-c9ae-42f5-b0bd-73d1594e7454\") " pod="kuadrant-system/authorino-7446d58b9b-wj2r2"
Jul 27 19:34:43.326349 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.326217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qmff\" (UniqueName: \"kubernetes.io/projected/7002502a-c9ae-42f5-b0bd-73d1594e7454-kube-api-access-9qmff\") pod \"authorino-7446d58b9b-wj2r2\" (UID: \"7002502a-c9ae-42f5-b0bd-73d1594e7454\") " pod="kuadrant-system/authorino-7446d58b9b-wj2r2"
Jul 27 19:34:43.328587 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.328569    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7002502a-c9ae-42f5-b0bd-73d1594e7454-tls-cert\") pod \"authorino-7446d58b9b-wj2r2\" (UID: \"7002502a-c9ae-42f5-b0bd-73d1594e7454\") " pod="kuadrant-system/authorino-7446d58b9b-wj2r2"
Jul 27 19:34:43.336378 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.336356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qmff\" (UniqueName: \"kubernetes.io/projected/7002502a-c9ae-42f5-b0bd-73d1594e7454-kube-api-access-9qmff\") pod \"authorino-7446d58b9b-wj2r2\" (UID: \"7002502a-c9ae-42f5-b0bd-73d1594e7454\") " pod="kuadrant-system/authorino-7446d58b9b-wj2r2"
Jul 27 19:34:43.469587 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.469565    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7446d58b9b-wj2r2"
Jul 27 19:34:43.602142 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.602117    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7446d58b9b-wj2r2"]
Jul 27 19:34:43.610118 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:34:43.610094    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7002502a_c9ae_42f5_b0bd_73d1594e7454.slice/crio-5fddd0fe3ebbecd3c19166db4c5729bde1e2191b0f5057cb9029e74d14cb14f9 WatchSource:0}: Error finding container 5fddd0fe3ebbecd3c19166db4c5729bde1e2191b0f5057cb9029e74d14cb14f9: Status 404 returned error can't find the container with id 5fddd0fe3ebbecd3c19166db4c5729bde1e2191b0f5057cb9029e74d14cb14f9
Jul 27 19:34:43.907985 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.907899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7446d58b9b-wj2r2" event={"ID":"7002502a-c9ae-42f5-b0bd-73d1594e7454","Type":"ContainerStarted","Data":"5fddd0fe3ebbecd3c19166db4c5729bde1e2191b0f5057cb9029e74d14cb14f9"}
Jul 27 19:34:43.909361 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.909345    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b854f88d-t5p4z"
Jul 27 19:34:43.909491 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.909389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-czdsf" event={"ID":"02ef1df2-b9d9-4199-bcca-af26ed202b33","Type":"ContainerStarted","Data":"9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05"}
Jul 27 19:34:43.909491 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.909429    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-czdsf" event={"ID":"02ef1df2-b9d9-4199-bcca-af26ed202b33","Type":"ContainerStarted","Data":"6ffc07829d93f4e061e9b26729ed0a24f7bfc0b797fa3eb0749a914b600cefec"}
Jul 27 19:34:43.909491 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.909390    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-czdsf" podUID="02ef1df2-b9d9-4199-bcca-af26ed202b33" containerName="authorino" containerID="cri-o://9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05" gracePeriod=30
Jul 27 19:34:43.916025 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.916006    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b854f88d-t5p4z"
Jul 27 19:34:43.928707 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:43.928669    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-czdsf" podStartSLOduration=1.495105039 podStartE2EDuration="1.928655434s" totalImagesPullingTime="433.550395ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:43.927242425 +0000 UTC m=+645.070446801" watchObservedRunningTime="2026-07-27 19:34:43.928655434 +0000 UTC m=+645.071859810"
Jul 27 19:34:44.033290 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.033268    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88gpz\" (UniqueName: \"kubernetes.io/projected/73198dd6-aa93-4df3-8a18-34394ffc3363-kube-api-access-88gpz\") pod \"73198dd6-aa93-4df3-8a18-34394ffc3363\" (UID: \"73198dd6-aa93-4df3-8a18-34394ffc3363\") "
Jul 27 19:34:44.035529 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.035504    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73198dd6-aa93-4df3-8a18-34394ffc3363-kube-api-access-88gpz" (OuterVolumeSpecName: "kube-api-access-88gpz") pod "73198dd6-aa93-4df3-8a18-34394ffc3363" (UID: "73198dd6-aa93-4df3-8a18-34394ffc3363"). InnerVolumeSpecName "kube-api-access-88gpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:44.134831 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.134796    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88gpz\" (UniqueName: \"kubernetes.io/projected/73198dd6-aa93-4df3-8a18-34394ffc3363-kube-api-access-88gpz\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:34:44.172310 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.172289    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-czdsf"
Jul 27 19:34:44.235477 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.235446    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dsc4\" (UniqueName: \"kubernetes.io/projected/02ef1df2-b9d9-4199-bcca-af26ed202b33-kube-api-access-7dsc4\") pod \"02ef1df2-b9d9-4199-bcca-af26ed202b33\" (UID: \"02ef1df2-b9d9-4199-bcca-af26ed202b33\") "
Jul 27 19:34:44.237576 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.237550    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ef1df2-b9d9-4199-bcca-af26ed202b33-kube-api-access-7dsc4" (OuterVolumeSpecName: "kube-api-access-7dsc4") pod "02ef1df2-b9d9-4199-bcca-af26ed202b33" (UID: "02ef1df2-b9d9-4199-bcca-af26ed202b33"). InnerVolumeSpecName "kube-api-access-7dsc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:44.336220 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.336191    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dsc4\" (UniqueName: \"kubernetes.io/projected/02ef1df2-b9d9-4199-bcca-af26ed202b33-kube-api-access-7dsc4\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:34:44.915398 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.915362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7446d58b9b-wj2r2" event={"ID":"7002502a-c9ae-42f5-b0bd-73d1594e7454","Type":"ContainerStarted","Data":"78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4"}
Jul 27 19:34:44.916642 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.916619    2563 generic.go:356] "Generic (PLEG): container finished" podID="02ef1df2-b9d9-4199-bcca-af26ed202b33" containerID="9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05" exitCode=0
Jul 27 19:34:44.916744 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.916649    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-czdsf"
Jul 27 19:34:44.916744 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.916680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-czdsf" event={"ID":"02ef1df2-b9d9-4199-bcca-af26ed202b33","Type":"ContainerDied","Data":"9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05"}
Jul 27 19:34:44.916744 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.916707    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-czdsf" event={"ID":"02ef1df2-b9d9-4199-bcca-af26ed202b33","Type":"ContainerDied","Data":"6ffc07829d93f4e061e9b26729ed0a24f7bfc0b797fa3eb0749a914b600cefec"}
Jul 27 19:34:44.916744 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.916723    2563 scope.go:117] "RemoveContainer" containerID="9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05"
Jul 27 19:34:44.916865 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.916821    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b854f88d-t5p4z"
Jul 27 19:34:44.925512 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.925424    2563 scope.go:117] "RemoveContainer" containerID="9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05"
Jul 27 19:34:44.925735 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:34:44.925709    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05\": container with ID starting with 9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05 not found: ID does not exist" containerID="9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05"
Jul 27 19:34:44.925799 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.925748    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05"} err="failed to get container status \"9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05\": rpc error: code = NotFound desc = could not find container \"9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05\": container with ID starting with 9bdc7ec268bbd7db9cf94fbce95d39b9b06bc7380a7b536ae369b912dd8b4d05 not found: ID does not exist"
Jul 27 19:34:44.934337 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.934294    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7446d58b9b-wj2r2" podStartSLOduration=1.5631591390000001 podStartE2EDuration="1.934279932s" totalImagesPullingTime="371.120793ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:44.933224959 +0000 UTC m=+646.076429334" watchObservedRunningTime="2026-07-27 19:34:44.934279932 +0000 UTC m=+646.077484375"
Jul 27 19:34:44.951357 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.951334    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-czdsf"]
Jul 27 19:34:44.956430 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.956408    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-czdsf"]
Jul 27 19:34:44.964677 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.964656    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gq6tc"]
Jul 27 19:34:44.964838 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.964819    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-gq6tc" podUID="a5085b24-36d1-4022-b308-f8564b8d5e81" containerName="authorino" containerID="cri-o://9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2" gracePeriod=30
Jul 27 19:34:44.991868 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:44.991841    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75b854f88d-t5p4z"]
Jul 27 19:34:45.002404 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.002372    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75b854f88d-t5p4z"]
Jul 27 19:34:45.243913 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.243883    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gq6tc"
Jul 27 19:34:45.344443 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.344405    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92hdf\" (UniqueName: \"kubernetes.io/projected/a5085b24-36d1-4022-b308-f8564b8d5e81-kube-api-access-92hdf\") pod \"a5085b24-36d1-4022-b308-f8564b8d5e81\" (UID: \"a5085b24-36d1-4022-b308-f8564b8d5e81\") "
Jul 27 19:34:45.346562 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.346527    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5085b24-36d1-4022-b308-f8564b8d5e81-kube-api-access-92hdf" (OuterVolumeSpecName: "kube-api-access-92hdf") pod "a5085b24-36d1-4022-b308-f8564b8d5e81" (UID: "a5085b24-36d1-4022-b308-f8564b8d5e81"). InnerVolumeSpecName "kube-api-access-92hdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:45.372684 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.372661    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02ef1df2-b9d9-4199-bcca-af26ed202b33" path="/var/lib/kubelet/pods/02ef1df2-b9d9-4199-bcca-af26ed202b33/volumes"
Jul 27 19:34:45.372967 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.372955    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73198dd6-aa93-4df3-8a18-34394ffc3363" path="/var/lib/kubelet/pods/73198dd6-aa93-4df3-8a18-34394ffc3363/volumes"
Jul 27 19:34:45.445325 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.445303    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92hdf\" (UniqueName: \"kubernetes.io/projected/a5085b24-36d1-4022-b308-f8564b8d5e81-kube-api-access-92hdf\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:34:45.923087 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.923056    2563 generic.go:356] "Generic (PLEG): container finished" podID="a5085b24-36d1-4022-b308-f8564b8d5e81" containerID="9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2" exitCode=0
Jul 27 19:34:45.923561 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.923105    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gq6tc"
Jul 27 19:34:45.923561 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.923136    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gq6tc" event={"ID":"a5085b24-36d1-4022-b308-f8564b8d5e81","Type":"ContainerDied","Data":"9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2"}
Jul 27 19:34:45.923561 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.923177    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gq6tc" event={"ID":"a5085b24-36d1-4022-b308-f8564b8d5e81","Type":"ContainerDied","Data":"7bcd21ba1dc77790899fc5eaf57c66e47a0bff3e178cef6a9ff777fac635fb03"}
Jul 27 19:34:45.923561 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.923193    2563 scope.go:117] "RemoveContainer" containerID="9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2"
Jul 27 19:34:45.931138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.931123    2563 scope.go:117] "RemoveContainer" containerID="9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2"
Jul 27 19:34:45.931427 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:34:45.931400    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2\": container with ID starting with 9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2 not found: ID does not exist" containerID="9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2"
Jul 27 19:34:45.931474 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.931436    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2"} err="failed to get container status \"9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2\": rpc error: code = NotFound desc = could not find container \"9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2\": container with ID starting with 9fa3dc8583da8aabbe57b2f34e49614bd898f0841a3c0f1202549a6d0b3d93c2 not found: ID does not exist"
Jul 27 19:34:45.964731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.964699    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gq6tc"]
Jul 27 19:34:45.971095 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:45.971074    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gq6tc"]
Jul 27 19:34:47.371628 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:47.371596    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5085b24-36d1-4022-b308-f8564b8d5e81" path="/var/lib/kubelet/pods/a5085b24-36d1-4022-b308-f8564b8d5e81/volumes"
Jul 27 19:34:49.666132 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.666090    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7667d8f55-65f9w"]
Jul 27 19:34:49.667312 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.667282    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ef1df2-b9d9-4199-bcca-af26ed202b33" containerName="authorino"
Jul 27 19:34:49.667462 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.667451    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ef1df2-b9d9-4199-bcca-af26ed202b33" containerName="authorino"
Jul 27 19:34:49.667546 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.667537    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5085b24-36d1-4022-b308-f8564b8d5e81" containerName="authorino"
Jul 27 19:34:49.667631 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.667623    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5085b24-36d1-4022-b308-f8564b8d5e81" containerName="authorino"
Jul 27 19:34:49.667798 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.667788    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5085b24-36d1-4022-b308-f8564b8d5e81" containerName="authorino"
Jul 27 19:34:49.667895 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.667885    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ef1df2-b9d9-4199-bcca-af26ed202b33" containerName="authorino"
Jul 27 19:34:49.671337 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.671314    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7667d8f55-65f9w"
Jul 27 19:34:49.675322 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.675289    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p42lw\""
Jul 27 19:34:49.675473 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.675455    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 19:34:49.675896 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.675880    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 19:34:49.682277 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.682254    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7667d8f55-65f9w"]
Jul 27 19:34:49.780356 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.780323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jc2w\" (UniqueName: \"kubernetes.io/projected/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31-kube-api-access-2jc2w\") pod \"maas-controller-7667d8f55-65f9w\" (UID: \"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31\") " pod="opendatahub/maas-controller-7667d8f55-65f9w"
Jul 27 19:34:49.780514 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.780376    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31-webhook-cert\") pod \"maas-controller-7667d8f55-65f9w\" (UID: \"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31\") " pod="opendatahub/maas-controller-7667d8f55-65f9w"
Jul 27 19:34:49.844646 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.844612    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79d876b7f6-tvkq4"]
Jul 27 19:34:49.847820 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.847806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d876b7f6-tvkq4"
Jul 27 19:34:49.860919 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.860888    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79d876b7f6-tvkq4"]
Jul 27 19:34:49.880815 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.880778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jc2w\" (UniqueName: \"kubernetes.io/projected/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31-kube-api-access-2jc2w\") pod \"maas-controller-7667d8f55-65f9w\" (UID: \"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31\") " pod="opendatahub/maas-controller-7667d8f55-65f9w"
Jul 27 19:34:49.880976 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.880870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31-webhook-cert\") pod \"maas-controller-7667d8f55-65f9w\" (UID: \"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31\") " pod="opendatahub/maas-controller-7667d8f55-65f9w"
Jul 27 19:34:49.883504 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.883482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31-webhook-cert\") pod \"maas-controller-7667d8f55-65f9w\" (UID: \"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31\") " pod="opendatahub/maas-controller-7667d8f55-65f9w"
Jul 27 19:34:49.891971 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.891953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jc2w\" (UniqueName: \"kubernetes.io/projected/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31-kube-api-access-2jc2w\") pod \"maas-controller-7667d8f55-65f9w\" (UID: \"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31\") " pod="opendatahub/maas-controller-7667d8f55-65f9w"
Jul 27 19:34:49.981439 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.981361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm988\" (UniqueName: \"kubernetes.io/projected/4f6d6b94-3945-497a-829a-4766f6f56fce-kube-api-access-qm988\") pod \"maas-controller-79d876b7f6-tvkq4\" (UID: \"4f6d6b94-3945-497a-829a-4766f6f56fce\") " pod="opendatahub/maas-controller-79d876b7f6-tvkq4"
Jul 27 19:34:49.981439 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.981419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f6d6b94-3945-497a-829a-4766f6f56fce-webhook-cert\") pod \"maas-controller-79d876b7f6-tvkq4\" (UID: \"4f6d6b94-3945-497a-829a-4766f6f56fce\") " pod="opendatahub/maas-controller-79d876b7f6-tvkq4"
Jul 27 19:34:49.985234 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:49.985218    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7667d8f55-65f9w"
Jul 27 19:34:50.082557 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:50.082525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm988\" (UniqueName: \"kubernetes.io/projected/4f6d6b94-3945-497a-829a-4766f6f56fce-kube-api-access-qm988\") pod \"maas-controller-79d876b7f6-tvkq4\" (UID: \"4f6d6b94-3945-497a-829a-4766f6f56fce\") " pod="opendatahub/maas-controller-79d876b7f6-tvkq4"
Jul 27 19:34:50.082723 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:50.082591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f6d6b94-3945-497a-829a-4766f6f56fce-webhook-cert\") pod \"maas-controller-79d876b7f6-tvkq4\" (UID: \"4f6d6b94-3945-497a-829a-4766f6f56fce\") " pod="opendatahub/maas-controller-79d876b7f6-tvkq4"
Jul 27 19:34:50.085776 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:50.085508    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f6d6b94-3945-497a-829a-4766f6f56fce-webhook-cert\") pod \"maas-controller-79d876b7f6-tvkq4\" (UID: \"4f6d6b94-3945-497a-829a-4766f6f56fce\") " pod="opendatahub/maas-controller-79d876b7f6-tvkq4"
Jul 27 19:34:50.095141 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:50.095118    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm988\" (UniqueName: \"kubernetes.io/projected/4f6d6b94-3945-497a-829a-4766f6f56fce-kube-api-access-qm988\") pod \"maas-controller-79d876b7f6-tvkq4\" (UID: \"4f6d6b94-3945-497a-829a-4766f6f56fce\") " pod="opendatahub/maas-controller-79d876b7f6-tvkq4"
Jul 27 19:34:50.129698 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:50.129628    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7667d8f55-65f9w"]
Jul 27 19:34:50.131871 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:34:50.131848    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b59e72d_edb5_4a5a_b15a_6b2072ae7e31.slice/crio-b7839a9d901d5e688563ee63384b9fb4fb1b63e3030d9da17f9bb70fb29daa64 WatchSource:0}: Error finding container b7839a9d901d5e688563ee63384b9fb4fb1b63e3030d9da17f9bb70fb29daa64: Status 404 returned error can't find the container with id b7839a9d901d5e688563ee63384b9fb4fb1b63e3030d9da17f9bb70fb29daa64
Jul 27 19:34:50.158240 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:50.158219    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d876b7f6-tvkq4"
Jul 27 19:34:50.295400 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:50.295372    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79d876b7f6-tvkq4"]
Jul 27 19:34:50.298953 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:34:50.298921    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6d6b94_3945_497a_829a_4766f6f56fce.slice/crio-7e0192c4189b74af1f07882b32d7acfc86efc4fbaf5a17c627aef3fb12edda7d WatchSource:0}: Error finding container 7e0192c4189b74af1f07882b32d7acfc86efc4fbaf5a17c627aef3fb12edda7d: Status 404 returned error can't find the container with id 7e0192c4189b74af1f07882b32d7acfc86efc4fbaf5a17c627aef3fb12edda7d
Jul 27 19:34:50.956786 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:50.956747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d876b7f6-tvkq4" event={"ID":"4f6d6b94-3945-497a-829a-4766f6f56fce","Type":"ContainerStarted","Data":"7e0192c4189b74af1f07882b32d7acfc86efc4fbaf5a17c627aef3fb12edda7d"}
Jul 27 19:34:50.958837 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:50.958806    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7667d8f55-65f9w" event={"ID":"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31","Type":"ContainerStarted","Data":"b7839a9d901d5e688563ee63384b9fb4fb1b63e3030d9da17f9bb70fb29daa64"}
Jul 27 19:34:52.970690 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:52.970591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d876b7f6-tvkq4" event={"ID":"4f6d6b94-3945-497a-829a-4766f6f56fce","Type":"ContainerStarted","Data":"703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58"}
Jul 27 19:34:52.971091 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:52.970692    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79d876b7f6-tvkq4"
Jul 27 19:34:52.972089 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:52.972064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7667d8f55-65f9w" event={"ID":"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31","Type":"ContainerStarted","Data":"4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad"}
Jul 27 19:34:52.972200 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:52.972156    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7667d8f55-65f9w"
Jul 27 19:34:53.005598 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:34:53.005553    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79d876b7f6-tvkq4" podStartSLOduration=1.589412758 podStartE2EDuration="4.00553872s" totalImagesPullingTime="2.416125962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:53.003933802 +0000 UTC m=+654.147138177" watchObservedRunningTime="2026-07-27 19:34:53.00553872 +0000 UTC m=+654.148743096"
Jul 27 19:35:03.979421 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:03.979392    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7667d8f55-65f9w"
Jul 27 19:35:03.979794 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:03.979459    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79d876b7f6-tvkq4"
Jul 27 19:35:04.000883 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:04.000838    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7667d8f55-65f9w" podStartSLOduration=12.411002269 podStartE2EDuration="15.000824604s" totalImagesPullingTime="2.589822335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:53.027443085 +0000 UTC m=+654.170647464" watchObservedRunningTime="2026-07-27 19:35:04.000824604 +0000 UTC m=+665.144028980"
Jul 27 19:35:04.052773 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:04.052734    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7667d8f55-65f9w"]
Jul 27 19:35:04.052962 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:04.052936    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7667d8f55-65f9w" podUID="7b59e72d-edb5-4a5a-b15a-6b2072ae7e31" containerName="manager" containerID="cri-o://4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad" gracePeriod=30
Jul 27 19:35:04.298799 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:04.298769    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7667d8f55-65f9w"
Jul 27 19:35:04.404684 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:04.404654    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jc2w\" (UniqueName: \"kubernetes.io/projected/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31-kube-api-access-2jc2w\") pod \"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31\" (UID: \"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31\") "
Jul 27 19:35:04.404816 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:04.404735    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31-webhook-cert\") pod \"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31\" (UID: \"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31\") "
Jul 27 19:35:04.407000 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:04.406968    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7b59e72d-edb5-4a5a-b15a-6b2072ae7e31" (UID: "7b59e72d-edb5-4a5a-b15a-6b2072ae7e31"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:35:04.407139 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:04.407013    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31-kube-api-access-2jc2w" (OuterVolumeSpecName: "kube-api-access-2jc2w") pod "7b59e72d-edb5-4a5a-b15a-6b2072ae7e31" (UID: "7b59e72d-edb5-4a5a-b15a-6b2072ae7e31"). InnerVolumeSpecName "kube-api-access-2jc2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:35:04.505766 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:04.505737    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31-webhook-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:35:04.505766 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:04.505761    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jc2w\" (UniqueName: \"kubernetes.io/projected/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31-kube-api-access-2jc2w\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:35:05.027360 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:05.027321    2563 generic.go:356] "Generic (PLEG): container finished" podID="7b59e72d-edb5-4a5a-b15a-6b2072ae7e31" containerID="4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad" exitCode=0
Jul 27 19:35:05.027833 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:05.027383    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7667d8f55-65f9w"
Jul 27 19:35:05.027833 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:05.027414    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7667d8f55-65f9w" event={"ID":"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31","Type":"ContainerDied","Data":"4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad"}
Jul 27 19:35:05.027833 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:05.027511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7667d8f55-65f9w" event={"ID":"7b59e72d-edb5-4a5a-b15a-6b2072ae7e31","Type":"ContainerDied","Data":"b7839a9d901d5e688563ee63384b9fb4fb1b63e3030d9da17f9bb70fb29daa64"}
Jul 27 19:35:05.027833 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:05.027545    2563 scope.go:117] "RemoveContainer" containerID="4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad"
Jul 27 19:35:05.036281 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:05.036265    2563 scope.go:117] "RemoveContainer" containerID="4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad"
Jul 27 19:35:05.036521 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:35:05.036501    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad\": container with ID starting with 4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad not found: ID does not exist" containerID="4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad"
Jul 27 19:35:05.036564 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:05.036532    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad"} err="failed to get container status \"4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad\": rpc error: code = NotFound desc = could not find container \"4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad\": container with ID starting with 4e356324d473848a6e4521ca94a73ed6414ee2d0c0d3d3f07f3b23b82b710fad not found: ID does not exist"
Jul 27 19:35:05.052397 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:05.052371    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7667d8f55-65f9w"]
Jul 27 19:35:05.064459 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:05.064437    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7667d8f55-65f9w"]
Jul 27 19:35:05.371818 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:05.371787    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b59e72d-edb5-4a5a-b15a-6b2072ae7e31" path="/var/lib/kubelet/pods/7b59e72d-edb5-4a5a-b15a-6b2072ae7e31/volumes"
Jul 27 19:35:26.399865 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.399809    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"]
Jul 27 19:35:26.400346 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.400169    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b59e72d-edb5-4a5a-b15a-6b2072ae7e31" containerName="manager"
Jul 27 19:35:26.400346 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.400181    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b59e72d-edb5-4a5a-b15a-6b2072ae7e31" containerName="manager"
Jul 27 19:35:26.400346 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.400237    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b59e72d-edb5-4a5a-b15a-6b2072ae7e31" containerName="manager"
Jul 27 19:35:26.403084 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.403062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"
Jul 27 19:35:26.405969 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.405950    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 19:35:26.406092 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.406079    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4rl86\""
Jul 27 19:35:26.413253 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.413232    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"]
Jul 27 19:35:26.487702 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.487662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzk5d\" (UniqueName: \"kubernetes.io/projected/51062138-adfa-4c13-aea8-33c214f08d65-kube-api-access-pzk5d\") pod \"payload-pre-processing-687dbb6cf6-n9vbl\" (UID: \"51062138-adfa-4c13-aea8-33c214f08d65\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"
Jul 27 19:35:26.487922 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.487729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51062138-adfa-4c13-aea8-33c214f08d65-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-n9vbl\" (UID: \"51062138-adfa-4c13-aea8-33c214f08d65\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"
Jul 27 19:35:26.588410 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.588374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzk5d\" (UniqueName: \"kubernetes.io/projected/51062138-adfa-4c13-aea8-33c214f08d65-kube-api-access-pzk5d\") pod \"payload-pre-processing-687dbb6cf6-n9vbl\" (UID: \"51062138-adfa-4c13-aea8-33c214f08d65\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"
Jul 27 19:35:26.588577 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.588426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51062138-adfa-4c13-aea8-33c214f08d65-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-n9vbl\" (UID: \"51062138-adfa-4c13-aea8-33c214f08d65\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"
Jul 27 19:35:26.589139 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.589120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51062138-adfa-4c13-aea8-33c214f08d65-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-n9vbl\" (UID: \"51062138-adfa-4c13-aea8-33c214f08d65\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"
Jul 27 19:35:26.598757 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.598730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzk5d\" (UniqueName: \"kubernetes.io/projected/51062138-adfa-4c13-aea8-33c214f08d65-kube-api-access-pzk5d\") pod \"payload-pre-processing-687dbb6cf6-n9vbl\" (UID: \"51062138-adfa-4c13-aea8-33c214f08d65\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"
Jul 27 19:35:26.715281 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.715212    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"
Jul 27 19:35:26.887062 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:26.883841    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"]
Jul 27 19:35:26.908666 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:35:26.908630    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51062138_adfa_4c13_aea8_33c214f08d65.slice/crio-0e9d0b39eefd88fd1649c7abde3ec128b0f770bf2b03bc70ebb7ad21a196706a WatchSource:0}: Error finding container 0e9d0b39eefd88fd1649c7abde3ec128b0f770bf2b03bc70ebb7ad21a196706a: Status 404 returned error can't find the container with id 0e9d0b39eefd88fd1649c7abde3ec128b0f770bf2b03bc70ebb7ad21a196706a
Jul 27 19:35:27.125839 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:27.125806    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl" event={"ID":"51062138-adfa-4c13-aea8-33c214f08d65","Type":"ContainerStarted","Data":"0e9d0b39eefd88fd1649c7abde3ec128b0f770bf2b03bc70ebb7ad21a196706a"}
Jul 27 19:35:30.143550 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:30.143514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl" event={"ID":"51062138-adfa-4c13-aea8-33c214f08d65","Type":"ContainerStarted","Data":"753e14035424ae9bf88565c606841cc2c1e04a88a5063d4b00e08d2b54c456ef"}
Jul 27 19:35:30.144013 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:30.143601    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"
Jul 27 19:35:30.165119 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:30.165017    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl" podStartSLOduration=1.350522006 podStartE2EDuration="4.165004964s" totalImagesPullingTime="2.814482958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:35:30.163939018 +0000 UTC m=+691.307143397" watchObservedRunningTime="2026-07-27 19:35:30.165004964 +0000 UTC m=+691.308209339"
Jul 27 19:35:34.166024 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:34.165990    2563 generic.go:356] "Generic (PLEG): container finished" podID="b11a86c7-2f27-42a6-bf83-dd394ca260f1" containerID="4e62a14d66ff6ac0155f965a7badc0cc1d900678abbecd4f12c5a9ab59225e38" exitCode=0
Jul 27 19:35:34.166445 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:34.166072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns" event={"ID":"b11a86c7-2f27-42a6-bf83-dd394ca260f1","Type":"ContainerDied","Data":"4e62a14d66ff6ac0155f965a7badc0cc1d900678abbecd4f12c5a9ab59225e38"}
Jul 27 19:35:34.166445 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:34.166399    2563 scope.go:117] "RemoveContainer" containerID="4e62a14d66ff6ac0155f965a7badc0cc1d900678abbecd4f12c5a9ab59225e38"
Jul 27 19:35:34.167361 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:34.167337    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:35:34.167435 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:34.167412    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:35:34.167473 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:34.167444    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:35:35.172818 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:35.172791    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns" event={"ID":"b11a86c7-2f27-42a6-bf83-dd394ca260f1","Type":"ContainerStarted","Data":"e71dc3dc18b9f07fe9949bb43c58995848865b826643ed28040d9ce3db0d6ccb"}
Jul 27 19:35:35.312861 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:35.312827    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:35:35.313139 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:35.313113    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-8kxns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 27 19:35:35.313191 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:35.313164    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns" podUID="b11a86c7-2f27-42a6-bf83-dd394ca260f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 27 19:35:36.313025 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:36.312990    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-8kxns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 27 19:35:36.313440 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:36.313068    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns" podUID="b11a86c7-2f27-42a6-bf83-dd394ca260f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 27 19:35:37.313259 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:37.313228    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-8kxns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 27 19:35:37.313728 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:37.313285    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns" podUID="b11a86c7-2f27-42a6-bf83-dd394ca260f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 27 19:35:38.313502 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:38.313462    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-8kxns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 27 19:35:38.313901 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:38.313531    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns" podUID="b11a86c7-2f27-42a6-bf83-dd394ca260f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 27 19:35:39.317112 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:39.317085    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:35:39.317533 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:39.317360    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:35:39.317944 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:39.317929    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8kxns"
Jul 27 19:35:41.150555 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:41.150515    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl" podUID="51062138-adfa-4c13-aea8-33c214f08d65" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.38:9004: connect: connection refused"
Jul 27 19:35:43.132575 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.132543    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"]
Jul 27 19:35:43.140211 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.140179    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.143528 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.143500    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 19:35:43.143682 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.143529    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 19:35:43.143682 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.143536    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l7pwx\""
Jul 27 19:35:43.143682 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.143602    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 27 19:35:43.149852 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.149827    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"]
Jul 27 19:35:43.242265 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.242231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/609a20d1-fc7f-4dee-aab9-068fe18268b4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.242265 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.242273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/609a20d1-fc7f-4dee-aab9-068fe18268b4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.242518 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.242380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/609a20d1-fc7f-4dee-aab9-068fe18268b4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.242518 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.242443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/609a20d1-fc7f-4dee-aab9-068fe18268b4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.242518 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.242477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/609a20d1-fc7f-4dee-aab9-068fe18268b4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.242518 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.242514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq8fd\" (UniqueName: \"kubernetes.io/projected/609a20d1-fc7f-4dee-aab9-068fe18268b4-kube-api-access-wq8fd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.343597 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.343565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/609a20d1-fc7f-4dee-aab9-068fe18268b4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.343597 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.343605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/609a20d1-fc7f-4dee-aab9-068fe18268b4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.343844 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.343640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/609a20d1-fc7f-4dee-aab9-068fe18268b4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.343844 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.343672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/609a20d1-fc7f-4dee-aab9-068fe18268b4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.343844 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.343694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/609a20d1-fc7f-4dee-aab9-068fe18268b4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.343844 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.343715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq8fd\" (UniqueName: \"kubernetes.io/projected/609a20d1-fc7f-4dee-aab9-068fe18268b4-kube-api-access-wq8fd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.344074 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.343980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/609a20d1-fc7f-4dee-aab9-068fe18268b4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.344178 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.344136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/609a20d1-fc7f-4dee-aab9-068fe18268b4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.344178 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.344147    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/609a20d1-fc7f-4dee-aab9-068fe18268b4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.346099 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.346081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/609a20d1-fc7f-4dee-aab9-068fe18268b4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.346436 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.346418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/609a20d1-fc7f-4dee-aab9-068fe18268b4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.354219 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.354199    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq8fd\" (UniqueName: \"kubernetes.io/projected/609a20d1-fc7f-4dee-aab9-068fe18268b4-kube-api-access-wq8fd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt\" (UID: \"609a20d1-fc7f-4dee-aab9-068fe18268b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.453661 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.453582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:43.593818 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:43.593785    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"]
Jul 27 19:35:43.598144 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:35:43.598118    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod609a20d1_fc7f_4dee_aab9_068fe18268b4.slice/crio-cf93c14fd038414605592f103313e75a38ee7fc4135428438010182c6f5c4e08 WatchSource:0}: Error finding container cf93c14fd038414605592f103313e75a38ee7fc4135428438010182c6f5c4e08: Status 404 returned error can't find the container with id cf93c14fd038414605592f103313e75a38ee7fc4135428438010182c6f5c4e08
Jul 27 19:35:44.224824 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:44.224786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt" event={"ID":"609a20d1-fc7f-4dee-aab9-068fe18268b4","Type":"ContainerStarted","Data":"cf93c14fd038414605592f103313e75a38ee7fc4135428438010182c6f5c4e08"}
Jul 27 19:35:45.231279 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:45.231243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt" event={"ID":"609a20d1-fc7f-4dee-aab9-068fe18268b4","Type":"ContainerStarted","Data":"9e5aa4d9cdde4b809fe8e8e96c03de111d8591370f786df6f68f72a2e11f3403"}
Jul 27 19:35:45.254191 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:45.254138    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt" podStartSLOduration=1.207213752 podStartE2EDuration="2.25412052s" totalImagesPullingTime="1.046906768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:35:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:35:45.252853358 +0000 UTC m=+706.396057733" watchObservedRunningTime="2026-07-27 19:35:45.25412052 +0000 UTC m=+706.397324896"
Jul 27 19:35:46.716004 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:46.715961    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl" podUID="51062138-adfa-4c13-aea8-33c214f08d65" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.38:9004: connect: connection refused"
Jul 27 19:35:51.150502 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:51.150419    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-n9vbl"
Jul 27 19:35:53.453924 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:53.453886    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:53.454333 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:53.453948    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:53.466511 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:53.466488    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:35:54.283494 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:35:54.283467    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt"
Jul 27 19:36:14.880916 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:14.880879    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"]
Jul 27 19:36:14.887947 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:14.887924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:14.890695 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:14.890674    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 19:36:14.908809 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:14.908784    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"]
Jul 27 19:36:15.011414 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.011383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a64605-e011-40f5-ab17-7af1bbc16741-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.011414 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.011419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a64605-e011-40f5-ab17-7af1bbc16741-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.011882 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.011444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pmng\" (UniqueName: \"kubernetes.io/projected/52a64605-e011-40f5-ab17-7af1bbc16741-kube-api-access-6pmng\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.011882 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.011484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a64605-e011-40f5-ab17-7af1bbc16741-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.011882 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.011503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a64605-e011-40f5-ab17-7af1bbc16741-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.011882 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.011537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a64605-e011-40f5-ab17-7af1bbc16741-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.112399 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.112366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a64605-e011-40f5-ab17-7af1bbc16741-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.112588 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.112404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a64605-e011-40f5-ab17-7af1bbc16741-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.112588 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.112433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a64605-e011-40f5-ab17-7af1bbc16741-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.112588 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.112491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a64605-e011-40f5-ab17-7af1bbc16741-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.112588 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.112510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a64605-e011-40f5-ab17-7af1bbc16741-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.112588 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.112526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pmng\" (UniqueName: \"kubernetes.io/projected/52a64605-e011-40f5-ab17-7af1bbc16741-kube-api-access-6pmng\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.112894 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.112870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a64605-e011-40f5-ab17-7af1bbc16741-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.112951 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.112889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a64605-e011-40f5-ab17-7af1bbc16741-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.112987 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.112941    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a64605-e011-40f5-ab17-7af1bbc16741-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.114968 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.114944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a64605-e011-40f5-ab17-7af1bbc16741-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.115307 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.115289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a64605-e011-40f5-ab17-7af1bbc16741-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.122350 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.122324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pmng\" (UniqueName: \"kubernetes.io/projected/52a64605-e011-40f5-ab17-7af1bbc16741-kube-api-access-6pmng\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x\" (UID: \"52a64605-e011-40f5-ab17-7af1bbc16741\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.198154 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.198084    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:15.339537 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.339509    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"]
Jul 27 19:36:15.343540 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:36:15.343516    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a64605_e011_40f5_ab17_7af1bbc16741.slice/crio-569bab8bc81f01db93405a5befdc300c8dca13171848c5edc5069aa7f8061779 WatchSource:0}: Error finding container 569bab8bc81f01db93405a5befdc300c8dca13171848c5edc5069aa7f8061779: Status 404 returned error can't find the container with id 569bab8bc81f01db93405a5befdc300c8dca13171848c5edc5069aa7f8061779
Jul 27 19:36:15.344923 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.344906    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:36:15.376633 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:15.376606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x" event={"ID":"52a64605-e011-40f5-ab17-7af1bbc16741","Type":"ContainerStarted","Data":"569bab8bc81f01db93405a5befdc300c8dca13171848c5edc5069aa7f8061779"}
Jul 27 19:36:16.385628 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:16.385585    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x" event={"ID":"52a64605-e011-40f5-ab17-7af1bbc16741","Type":"ContainerStarted","Data":"d3e4974a39ae80ce50e917a8d962b7740659e1b9c731f4bb61cdc51c50bc73a3"}
Jul 27 19:36:16.408002 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:16.407944    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x" podStartSLOduration=2.21796755 podStartE2EDuration="2.407927452s" totalImagesPullingTime="189.959902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:16.406023045 +0000 UTC m=+737.549227433" watchObservedRunningTime="2026-07-27 19:36:16.407927452 +0000 UTC m=+737.551131827"
Jul 27 19:36:25.198405 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:25.198375    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:25.198782 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:25.198455    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:25.210500 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:25.210475    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:25.442062 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:25.442020    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x"
Jul 27 19:36:28.741812 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.741780    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"]
Jul 27 19:36:28.745430 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.745400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.748711 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.748688    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 27 19:36:28.757138 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.757113    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"]
Jul 27 19:36:28.827594 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.827558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mrzt\" (UniqueName: \"kubernetes.io/projected/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-kube-api-access-2mrzt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.827594 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.827597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.827799 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.827667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.827799 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.827698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.827799 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.827748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.827896 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.827804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.929065 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.929009    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.929222 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.929116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.929222 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.929159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mrzt\" (UniqueName: \"kubernetes.io/projected/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-kube-api-access-2mrzt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.929383 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.929362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.929448 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.929430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.929487 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.929447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.929487 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.929437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.929548 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.929487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.929685 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.929672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.931731 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.931706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.931970 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.931951    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:28.939057 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:28.939017    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mrzt\" (UniqueName: \"kubernetes.io/projected/eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc-kube-api-access-2mrzt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g5b24\" (UID: \"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:29.054756 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:29.054725    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:29.194725 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:29.194697    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"]
Jul 27 19:36:29.196137 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:36:29.196110    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeff1fcf3_56c0_4afd_84e1_50bb7e73a4fc.slice/crio-321a7e8a4ebeb0967118a4c5962e3b99c1d99fcd6d746d4099cd8dca36b46c80 WatchSource:0}: Error finding container 321a7e8a4ebeb0967118a4c5962e3b99c1d99fcd6d746d4099cd8dca36b46c80: Status 404 returned error can't find the container with id 321a7e8a4ebeb0967118a4c5962e3b99c1d99fcd6d746d4099cd8dca36b46c80
Jul 27 19:36:29.450602 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:29.450564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24" event={"ID":"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc","Type":"ContainerStarted","Data":"321a7e8a4ebeb0967118a4c5962e3b99c1d99fcd6d746d4099cd8dca36b46c80"}
Jul 27 19:36:30.456896 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:30.456861    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24" event={"ID":"eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc","Type":"ContainerStarted","Data":"9cfef731d0d24b4b2322488d27f1e2e6f5dd6140f3b30b91bb4c7760321f3338"}
Jul 27 19:36:30.480412 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:30.480352    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24" podStartSLOduration=2.278283725 podStartE2EDuration="2.480334386s" totalImagesPullingTime="202.050661ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:30.479142365 +0000 UTC m=+751.622346743" watchObservedRunningTime="2026-07-27 19:36:30.480334386 +0000 UTC m=+751.623538763"
Jul 27 19:36:39.055809 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:39.055773    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:39.056294 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:39.056033    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:39.068277 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:39.068257    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:36:39.509512 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:36:39.509431    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g5b24"
Jul 27 19:37:59.713400 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:37:59.713355    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86c948ccc7-5v6hz"]
Jul 27 19:37:59.717144 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:37:59.717120    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86c948ccc7-5v6hz"
Jul 27 19:37:59.727583 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:37:59.727558    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86c948ccc7-5v6hz"]
Jul 27 19:37:59.876987 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:37:59.876951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kpxp\" (UniqueName: \"kubernetes.io/projected/256052de-6d72-43c2-a1e1-ca7bf6c8d234-kube-api-access-8kpxp\") pod \"authorino-86c948ccc7-5v6hz\" (UID: \"256052de-6d72-43c2-a1e1-ca7bf6c8d234\") " pod="kuadrant-system/authorino-86c948ccc7-5v6hz"
Jul 27 19:37:59.877184 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:37:59.877120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/256052de-6d72-43c2-a1e1-ca7bf6c8d234-tls-cert\") pod \"authorino-86c948ccc7-5v6hz\" (UID: \"256052de-6d72-43c2-a1e1-ca7bf6c8d234\") " pod="kuadrant-system/authorino-86c948ccc7-5v6hz"
Jul 27 19:37:59.978399 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:37:59.978317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kpxp\" (UniqueName: \"kubernetes.io/projected/256052de-6d72-43c2-a1e1-ca7bf6c8d234-kube-api-access-8kpxp\") pod \"authorino-86c948ccc7-5v6hz\" (UID: \"256052de-6d72-43c2-a1e1-ca7bf6c8d234\") " pod="kuadrant-system/authorino-86c948ccc7-5v6hz"
Jul 27 19:37:59.978399 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:37:59.978394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/256052de-6d72-43c2-a1e1-ca7bf6c8d234-tls-cert\") pod \"authorino-86c948ccc7-5v6hz\" (UID: \"256052de-6d72-43c2-a1e1-ca7bf6c8d234\") " pod="kuadrant-system/authorino-86c948ccc7-5v6hz"
Jul 27 19:37:59.981265 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:37:59.981243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/256052de-6d72-43c2-a1e1-ca7bf6c8d234-tls-cert\") pod \"authorino-86c948ccc7-5v6hz\" (UID: \"256052de-6d72-43c2-a1e1-ca7bf6c8d234\") " pod="kuadrant-system/authorino-86c948ccc7-5v6hz"
Jul 27 19:37:59.992949 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:37:59.992928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kpxp\" (UniqueName: \"kubernetes.io/projected/256052de-6d72-43c2-a1e1-ca7bf6c8d234-kube-api-access-8kpxp\") pod \"authorino-86c948ccc7-5v6hz\" (UID: \"256052de-6d72-43c2-a1e1-ca7bf6c8d234\") " pod="kuadrant-system/authorino-86c948ccc7-5v6hz"
Jul 27 19:38:00.026923 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:00.026899    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86c948ccc7-5v6hz"
Jul 27 19:38:00.168608 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:00.168587    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86c948ccc7-5v6hz"]
Jul 27 19:38:00.171294 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:38:00.171271    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod256052de_6d72_43c2_a1e1_ca7bf6c8d234.slice/crio-c030b23527d7113e6d96718921e6d8cb4c71079c21f7dca0d2e9db33d4d48a7b WatchSource:0}: Error finding container c030b23527d7113e6d96718921e6d8cb4c71079c21f7dca0d2e9db33d4d48a7b: Status 404 returned error can't find the container with id c030b23527d7113e6d96718921e6d8cb4c71079c21f7dca0d2e9db33d4d48a7b
Jul 27 19:38:00.887626 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:00.887567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86c948ccc7-5v6hz" event={"ID":"256052de-6d72-43c2-a1e1-ca7bf6c8d234","Type":"ContainerStarted","Data":"cb9ee76681f4ba8746e933b11b4ff27f24647d42415d378d3d4c0accff2403a9"}
Jul 27 19:38:00.887626 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:00.887629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86c948ccc7-5v6hz" event={"ID":"256052de-6d72-43c2-a1e1-ca7bf6c8d234","Type":"ContainerStarted","Data":"c030b23527d7113e6d96718921e6d8cb4c71079c21f7dca0d2e9db33d4d48a7b"}
Jul 27 19:38:00.928422 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:00.928356    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86c948ccc7-5v6hz" podStartSLOduration=1.557974261 podStartE2EDuration="1.928334602s" totalImagesPullingTime="370.360341ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:38:00.927383609 +0000 UTC m=+842.070587985" watchObservedRunningTime="2026-07-27 19:38:00.928334602 +0000 UTC m=+842.071538984"
Jul 27 19:38:00.982843 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:00.982791    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7446d58b9b-wj2r2"]
Jul 27 19:38:00.983097 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:00.983065    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7446d58b9b-wj2r2" podUID="7002502a-c9ae-42f5-b0bd-73d1594e7454" containerName="authorino" containerID="cri-o://78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4" gracePeriod=30
Jul 27 19:38:01.264454 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.264423    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7446d58b9b-wj2r2"
Jul 27 19:38:01.392098 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.392061    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qmff\" (UniqueName: \"kubernetes.io/projected/7002502a-c9ae-42f5-b0bd-73d1594e7454-kube-api-access-9qmff\") pod \"7002502a-c9ae-42f5-b0bd-73d1594e7454\" (UID: \"7002502a-c9ae-42f5-b0bd-73d1594e7454\") "
Jul 27 19:38:01.392098 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.392097    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7002502a-c9ae-42f5-b0bd-73d1594e7454-tls-cert\") pod \"7002502a-c9ae-42f5-b0bd-73d1594e7454\" (UID: \"7002502a-c9ae-42f5-b0bd-73d1594e7454\") "
Jul 27 19:38:01.394289 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.394254    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7002502a-c9ae-42f5-b0bd-73d1594e7454-kube-api-access-9qmff" (OuterVolumeSpecName: "kube-api-access-9qmff") pod "7002502a-c9ae-42f5-b0bd-73d1594e7454" (UID: "7002502a-c9ae-42f5-b0bd-73d1594e7454"). InnerVolumeSpecName "kube-api-access-9qmff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:38:01.403547 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.403518    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7002502a-c9ae-42f5-b0bd-73d1594e7454-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7002502a-c9ae-42f5-b0bd-73d1594e7454" (UID: "7002502a-c9ae-42f5-b0bd-73d1594e7454"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:38:01.493177 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.493105    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qmff\" (UniqueName: \"kubernetes.io/projected/7002502a-c9ae-42f5-b0bd-73d1594e7454-kube-api-access-9qmff\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:38:01.493177 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.493131    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7002502a-c9ae-42f5-b0bd-73d1594e7454-tls-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:38:01.894543 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.894506    2563 generic.go:356] "Generic (PLEG): container finished" podID="7002502a-c9ae-42f5-b0bd-73d1594e7454" containerID="78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4" exitCode=0
Jul 27 19:38:01.894959 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.894549    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7446d58b9b-wj2r2"
Jul 27 19:38:01.894959 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.894599    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7446d58b9b-wj2r2" event={"ID":"7002502a-c9ae-42f5-b0bd-73d1594e7454","Type":"ContainerDied","Data":"78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4"}
Jul 27 19:38:01.894959 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.894651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7446d58b9b-wj2r2" event={"ID":"7002502a-c9ae-42f5-b0bd-73d1594e7454","Type":"ContainerDied","Data":"5fddd0fe3ebbecd3c19166db4c5729bde1e2191b0f5057cb9029e74d14cb14f9"}
Jul 27 19:38:01.894959 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.894674    2563 scope.go:117] "RemoveContainer" containerID="78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4"
Jul 27 19:38:01.906350 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.906325    2563 scope.go:117] "RemoveContainer" containerID="78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4"
Jul 27 19:38:01.906664 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:38:01.906646    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4\": container with ID starting with 78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4 not found: ID does not exist" containerID="78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4"
Jul 27 19:38:01.906732 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.906678    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4"} err="failed to get container status \"78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4\": rpc error: code = NotFound desc = could not find container \"78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4\": container with ID starting with 78b1192d81a4ae05ec31ecaef5c183e39dd889c8517e8794e741620cd30bd6c4 not found: ID does not exist"
Jul 27 19:38:01.920588 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.920559    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7446d58b9b-wj2r2"]
Jul 27 19:38:01.924691 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:01.924669    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7446d58b9b-wj2r2"]
Jul 27 19:38:03.372258 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:03.372228    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7002502a-c9ae-42f5-b0bd-73d1594e7454" path="/var/lib/kubelet/pods/7002502a-c9ae-42f5-b0bd-73d1594e7454/volumes"
Jul 27 19:38:46.516368 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:46.516329    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79d876b7f6-tvkq4"]
Jul 27 19:38:46.516893 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:46.516567    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-79d876b7f6-tvkq4" podUID="4f6d6b94-3945-497a-829a-4766f6f56fce" containerName="manager" containerID="cri-o://703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58" gracePeriod=30
Jul 27 19:38:46.776427 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:46.776368    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d876b7f6-tvkq4"
Jul 27 19:38:46.872988 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:46.872955    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f6d6b94-3945-497a-829a-4766f6f56fce-webhook-cert\") pod \"4f6d6b94-3945-497a-829a-4766f6f56fce\" (UID: \"4f6d6b94-3945-497a-829a-4766f6f56fce\") "
Jul 27 19:38:46.873168 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:46.873106    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm988\" (UniqueName: \"kubernetes.io/projected/4f6d6b94-3945-497a-829a-4766f6f56fce-kube-api-access-qm988\") pod \"4f6d6b94-3945-497a-829a-4766f6f56fce\" (UID: \"4f6d6b94-3945-497a-829a-4766f6f56fce\") "
Jul 27 19:38:46.875079 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:46.875052    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f6d6b94-3945-497a-829a-4766f6f56fce-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4f6d6b94-3945-497a-829a-4766f6f56fce" (UID: "4f6d6b94-3945-497a-829a-4766f6f56fce"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:38:46.875154 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:46.875134    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f6d6b94-3945-497a-829a-4766f6f56fce-kube-api-access-qm988" (OuterVolumeSpecName: "kube-api-access-qm988") pod "4f6d6b94-3945-497a-829a-4766f6f56fce" (UID: "4f6d6b94-3945-497a-829a-4766f6f56fce"). InnerVolumeSpecName "kube-api-access-qm988". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:38:46.973960 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:46.973930    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm988\" (UniqueName: \"kubernetes.io/projected/4f6d6b94-3945-497a-829a-4766f6f56fce-kube-api-access-qm988\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:38:46.973960 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:46.973955    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f6d6b94-3945-497a-829a-4766f6f56fce-webhook-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:38:47.106091 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:47.106032    2563 generic.go:356] "Generic (PLEG): container finished" podID="4f6d6b94-3945-497a-829a-4766f6f56fce" containerID="703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58" exitCode=0
Jul 27 19:38:47.106255 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:47.106104    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d876b7f6-tvkq4"
Jul 27 19:38:47.106255 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:47.106114    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d876b7f6-tvkq4" event={"ID":"4f6d6b94-3945-497a-829a-4766f6f56fce","Type":"ContainerDied","Data":"703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58"}
Jul 27 19:38:47.106255 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:47.106166    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d876b7f6-tvkq4" event={"ID":"4f6d6b94-3945-497a-829a-4766f6f56fce","Type":"ContainerDied","Data":"7e0192c4189b74af1f07882b32d7acfc86efc4fbaf5a17c627aef3fb12edda7d"}
Jul 27 19:38:47.106255 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:47.106187    2563 scope.go:117] "RemoveContainer" containerID="703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58"
Jul 27 19:38:47.114981 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:47.114962    2563 scope.go:117] "RemoveContainer" containerID="703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58"
Jul 27 19:38:47.115287 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:38:47.115268    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58\": container with ID starting with 703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58 not found: ID does not exist" containerID="703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58"
Jul 27 19:38:47.115336 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:47.115297    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58"} err="failed to get container status \"703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58\": rpc error: code = NotFound desc = could not find container \"703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58\": container with ID starting with 703fbf08e404886122b7b673fbeb38f41ada6214fa95e0dd5a48012622650c58 not found: ID does not exist"
Jul 27 19:38:47.137653 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:47.137629    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79d876b7f6-tvkq4"]
Jul 27 19:38:47.148487 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:47.148466    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79d876b7f6-tvkq4"]
Jul 27 19:38:47.372250 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:38:47.372171    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f6d6b94-3945-497a-829a-4766f6f56fce" path="/var/lib/kubelet/pods/4f6d6b94-3945-497a-829a-4766f6f56fce/volumes"
Jul 27 19:39:47.933001 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:47.932970    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79d876b7f6-tqd5r"]
Jul 27 19:39:47.933415 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:47.933326    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f6d6b94-3945-497a-829a-4766f6f56fce" containerName="manager"
Jul 27 19:39:47.933415 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:47.933337    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f6d6b94-3945-497a-829a-4766f6f56fce" containerName="manager"
Jul 27 19:39:47.933415 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:47.933356    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7002502a-c9ae-42f5-b0bd-73d1594e7454" containerName="authorino"
Jul 27 19:39:47.933415 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:47.933362    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7002502a-c9ae-42f5-b0bd-73d1594e7454" containerName="authorino"
Jul 27 19:39:47.933415 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:47.933414    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f6d6b94-3945-497a-829a-4766f6f56fce" containerName="manager"
Jul 27 19:39:47.933657 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:47.933425    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7002502a-c9ae-42f5-b0bd-73d1594e7454" containerName="authorino"
Jul 27 19:39:47.936466 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:47.936447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d876b7f6-tqd5r"
Jul 27 19:39:47.940792 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:47.940770    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 19:39:47.940792 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:47.940787    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 19:39:47.940911 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:47.940790    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p42lw\""
Jul 27 19:39:47.946804 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:47.946780    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79d876b7f6-tqd5r"]
Jul 27 19:39:48.093362 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:48.093336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmjr4\" (UniqueName: \"kubernetes.io/projected/1a361b62-280d-4b4f-bf08-c822006f8735-kube-api-access-rmjr4\") pod \"maas-controller-79d876b7f6-tqd5r\" (UID: \"1a361b62-280d-4b4f-bf08-c822006f8735\") " pod="opendatahub/maas-controller-79d876b7f6-tqd5r"
Jul 27 19:39:48.093541 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:48.093366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a361b62-280d-4b4f-bf08-c822006f8735-webhook-cert\") pod \"maas-controller-79d876b7f6-tqd5r\" (UID: \"1a361b62-280d-4b4f-bf08-c822006f8735\") " pod="opendatahub/maas-controller-79d876b7f6-tqd5r"
Jul 27 19:39:48.193909 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:48.193816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmjr4\" (UniqueName: \"kubernetes.io/projected/1a361b62-280d-4b4f-bf08-c822006f8735-kube-api-access-rmjr4\") pod \"maas-controller-79d876b7f6-tqd5r\" (UID: \"1a361b62-280d-4b4f-bf08-c822006f8735\") " pod="opendatahub/maas-controller-79d876b7f6-tqd5r"
Jul 27 19:39:48.193909 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:48.193849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a361b62-280d-4b4f-bf08-c822006f8735-webhook-cert\") pod \"maas-controller-79d876b7f6-tqd5r\" (UID: \"1a361b62-280d-4b4f-bf08-c822006f8735\") " pod="opendatahub/maas-controller-79d876b7f6-tqd5r"
Jul 27 19:39:48.196431 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:48.196409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a361b62-280d-4b4f-bf08-c822006f8735-webhook-cert\") pod \"maas-controller-79d876b7f6-tqd5r\" (UID: \"1a361b62-280d-4b4f-bf08-c822006f8735\") " pod="opendatahub/maas-controller-79d876b7f6-tqd5r"
Jul 27 19:39:48.204825 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:48.204803    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmjr4\" (UniqueName: \"kubernetes.io/projected/1a361b62-280d-4b4f-bf08-c822006f8735-kube-api-access-rmjr4\") pod \"maas-controller-79d876b7f6-tqd5r\" (UID: \"1a361b62-280d-4b4f-bf08-c822006f8735\") " pod="opendatahub/maas-controller-79d876b7f6-tqd5r"
Jul 27 19:39:48.247400 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:48.247381    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d876b7f6-tqd5r"
Jul 27 19:39:48.388214 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:48.388189    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79d876b7f6-tqd5r"]
Jul 27 19:39:48.390443 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:39:48.390408    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a361b62_280d_4b4f_bf08_c822006f8735.slice/crio-c632644eb2fce1928a791deb37313212931489644d5d6ec413b2f42b52ebdb89 WatchSource:0}: Error finding container c632644eb2fce1928a791deb37313212931489644d5d6ec413b2f42b52ebdb89: Status 404 returned error can't find the container with id c632644eb2fce1928a791deb37313212931489644d5d6ec413b2f42b52ebdb89
Jul 27 19:39:49.399240 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:49.399201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d876b7f6-tqd5r" event={"ID":"1a361b62-280d-4b4f-bf08-c822006f8735","Type":"ContainerStarted","Data":"8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b"}
Jul 27 19:39:49.399654 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:49.399260    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d876b7f6-tqd5r" event={"ID":"1a361b62-280d-4b4f-bf08-c822006f8735","Type":"ContainerStarted","Data":"c632644eb2fce1928a791deb37313212931489644d5d6ec413b2f42b52ebdb89"}
Jul 27 19:39:49.399654 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:49.399292    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79d876b7f6-tqd5r"
Jul 27 19:39:49.424882 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:39:49.424833    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79d876b7f6-tqd5r" podStartSLOduration=1.815157941 podStartE2EDuration="2.424816732s" totalImagesPullingTime="609.658791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:39:49.421966843 +0000 UTC m=+950.565171219" watchObservedRunningTime="2026-07-27 19:39:49.424816732 +0000 UTC m=+950.568021107"
Jul 27 19:40:00.405926 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:00.405895    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79d876b7f6-tqd5r"
Jul 27 19:40:05.042803 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.042768    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79d876b7f6-tqd5r"]
Jul 27 19:40:05.043214 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.042952    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-79d876b7f6-tqd5r" podUID="1a361b62-280d-4b4f-bf08-c822006f8735" containerName="manager" containerID="cri-o://8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b" gracePeriod=30
Jul 27 19:40:05.297824 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.297765    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d876b7f6-tqd5r"
Jul 27 19:40:05.328551 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.328522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmjr4\" (UniqueName: \"kubernetes.io/projected/1a361b62-280d-4b4f-bf08-c822006f8735-kube-api-access-rmjr4\") pod \"1a361b62-280d-4b4f-bf08-c822006f8735\" (UID: \"1a361b62-280d-4b4f-bf08-c822006f8735\") "
Jul 27 19:40:05.328689 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.328603    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a361b62-280d-4b4f-bf08-c822006f8735-webhook-cert\") pod \"1a361b62-280d-4b4f-bf08-c822006f8735\" (UID: \"1a361b62-280d-4b4f-bf08-c822006f8735\") "
Jul 27 19:40:05.330850 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.330824    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a361b62-280d-4b4f-bf08-c822006f8735-kube-api-access-rmjr4" (OuterVolumeSpecName: "kube-api-access-rmjr4") pod "1a361b62-280d-4b4f-bf08-c822006f8735" (UID: "1a361b62-280d-4b4f-bf08-c822006f8735"). InnerVolumeSpecName "kube-api-access-rmjr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:40:05.330952 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.330878    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a361b62-280d-4b4f-bf08-c822006f8735-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1a361b62-280d-4b4f-bf08-c822006f8735" (UID: "1a361b62-280d-4b4f-bf08-c822006f8735"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:40:05.429896 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.429867    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmjr4\" (UniqueName: \"kubernetes.io/projected/1a361b62-280d-4b4f-bf08-c822006f8735-kube-api-access-rmjr4\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:40:05.429896 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.429891    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a361b62-280d-4b4f-bf08-c822006f8735-webhook-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:40:05.477633 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.477608    2563 generic.go:356] "Generic (PLEG): container finished" podID="1a361b62-280d-4b4f-bf08-c822006f8735" containerID="8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b" exitCode=0
Jul 27 19:40:05.477764 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.477642    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d876b7f6-tqd5r"
Jul 27 19:40:05.477764 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.477654    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d876b7f6-tqd5r" event={"ID":"1a361b62-280d-4b4f-bf08-c822006f8735","Type":"ContainerDied","Data":"8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b"}
Jul 27 19:40:05.477764 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.477697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d876b7f6-tqd5r" event={"ID":"1a361b62-280d-4b4f-bf08-c822006f8735","Type":"ContainerDied","Data":"c632644eb2fce1928a791deb37313212931489644d5d6ec413b2f42b52ebdb89"}
Jul 27 19:40:05.477764 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.477718    2563 scope.go:117] "RemoveContainer" containerID="8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b"
Jul 27 19:40:05.486523 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.486503    2563 scope.go:117] "RemoveContainer" containerID="8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b"
Jul 27 19:40:05.486791 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:40:05.486764    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b\": container with ID starting with 8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b not found: ID does not exist" containerID="8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b"
Jul 27 19:40:05.486844 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.486795    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b"} err="failed to get container status \"8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b\": rpc error: code = NotFound desc = could not find container \"8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b\": container with ID starting with 8ef636406d57422a3390ce5122b3a3e43761b3625e4a802f1b278a9bf5077a5b not found: ID does not exist"
Jul 27 19:40:05.500456 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.500434    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79d876b7f6-tqd5r"]
Jul 27 19:40:05.504933 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:05.504906    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79d876b7f6-tqd5r"]
Jul 27 19:40:06.272876 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.272844    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79d876b7f6-ggmcj"]
Jul 27 19:40:06.273315 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.273213    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a361b62-280d-4b4f-bf08-c822006f8735" containerName="manager"
Jul 27 19:40:06.273315 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.273224    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a361b62-280d-4b4f-bf08-c822006f8735" containerName="manager"
Jul 27 19:40:06.273315 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.273301    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a361b62-280d-4b4f-bf08-c822006f8735" containerName="manager"
Jul 27 19:40:06.277425 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.277405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d876b7f6-ggmcj"
Jul 27 19:40:06.282087 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.282068    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p42lw\""
Jul 27 19:40:06.282212 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.282066    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 19:40:06.282212 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.282113    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 19:40:06.288242 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.288207    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79d876b7f6-ggmcj"]
Jul 27 19:40:06.337901 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.337877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a450e62-1d76-4fdc-b2ab-b0d8661b9122-webhook-cert\") pod \"maas-controller-79d876b7f6-ggmcj\" (UID: \"3a450e62-1d76-4fdc-b2ab-b0d8661b9122\") " pod="opendatahub/maas-controller-79d876b7f6-ggmcj"
Jul 27 19:40:06.338024 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.337945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkcdr\" (UniqueName: \"kubernetes.io/projected/3a450e62-1d76-4fdc-b2ab-b0d8661b9122-kube-api-access-fkcdr\") pod \"maas-controller-79d876b7f6-ggmcj\" (UID: \"3a450e62-1d76-4fdc-b2ab-b0d8661b9122\") " pod="opendatahub/maas-controller-79d876b7f6-ggmcj"
Jul 27 19:40:06.439147 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.439117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a450e62-1d76-4fdc-b2ab-b0d8661b9122-webhook-cert\") pod \"maas-controller-79d876b7f6-ggmcj\" (UID: \"3a450e62-1d76-4fdc-b2ab-b0d8661b9122\") " pod="opendatahub/maas-controller-79d876b7f6-ggmcj"
Jul 27 19:40:06.439272 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.439202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcdr\" (UniqueName: \"kubernetes.io/projected/3a450e62-1d76-4fdc-b2ab-b0d8661b9122-kube-api-access-fkcdr\") pod \"maas-controller-79d876b7f6-ggmcj\" (UID: \"3a450e62-1d76-4fdc-b2ab-b0d8661b9122\") " pod="opendatahub/maas-controller-79d876b7f6-ggmcj"
Jul 27 19:40:06.441596 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.441570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a450e62-1d76-4fdc-b2ab-b0d8661b9122-webhook-cert\") pod \"maas-controller-79d876b7f6-ggmcj\" (UID: \"3a450e62-1d76-4fdc-b2ab-b0d8661b9122\") " pod="opendatahub/maas-controller-79d876b7f6-ggmcj"
Jul 27 19:40:06.450578 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.450555    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkcdr\" (UniqueName: \"kubernetes.io/projected/3a450e62-1d76-4fdc-b2ab-b0d8661b9122-kube-api-access-fkcdr\") pod \"maas-controller-79d876b7f6-ggmcj\" (UID: \"3a450e62-1d76-4fdc-b2ab-b0d8661b9122\") " pod="opendatahub/maas-controller-79d876b7f6-ggmcj"
Jul 27 19:40:06.589987 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.589951    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d876b7f6-ggmcj"
Jul 27 19:40:06.732328 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:06.731558    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79d876b7f6-ggmcj"]
Jul 27 19:40:06.737681 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:40:06.737637    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a450e62_1d76_4fdc_b2ab_b0d8661b9122.slice/crio-d56a0ecdb68d2e6e16f685244ce60427a657c0a63087554d0b469eec5b16710d WatchSource:0}: Error finding container d56a0ecdb68d2e6e16f685244ce60427a657c0a63087554d0b469eec5b16710d: Status 404 returned error can't find the container with id d56a0ecdb68d2e6e16f685244ce60427a657c0a63087554d0b469eec5b16710d
Jul 27 19:40:07.372384 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:07.372355    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a361b62-280d-4b4f-bf08-c822006f8735" path="/var/lib/kubelet/pods/1a361b62-280d-4b4f-bf08-c822006f8735/volumes"
Jul 27 19:40:07.490106 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:07.489980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d876b7f6-ggmcj" event={"ID":"3a450e62-1d76-4fdc-b2ab-b0d8661b9122","Type":"ContainerStarted","Data":"06d7b50d69ba273cab5b99f818c0a782b36d46304ee14d1fc3c2666fccdda957"}
Jul 27 19:40:07.490106 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:07.490033    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d876b7f6-ggmcj" event={"ID":"3a450e62-1d76-4fdc-b2ab-b0d8661b9122","Type":"ContainerStarted","Data":"d56a0ecdb68d2e6e16f685244ce60427a657c0a63087554d0b469eec5b16710d"}
Jul 27 19:40:07.490106 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:07.490075    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79d876b7f6-ggmcj"
Jul 27 19:40:07.511247 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:07.511198    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79d876b7f6-ggmcj" podStartSLOduration=1.050413589 podStartE2EDuration="1.511183668s" totalImagesPullingTime="460.770079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:40:07.509802093 +0000 UTC m=+968.653006470" watchObservedRunningTime="2026-07-27 19:40:07.511183668 +0000 UTC m=+968.654388064"
Jul 27 19:40:18.497206 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:40:18.497172    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79d876b7f6-ggmcj"
Jul 27 19:44:46.212311 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:46.212275    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"]
Jul 27 19:44:46.212880 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:46.212460    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6" podUID="e90434cb-13ea-4939-86bd-240e85f51782" containerName="manager" containerID="cri-o://d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d" gracePeriod=10
Jul 27 19:44:49.269994 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.269972    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"
Jul 27 19:44:49.375843 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.375767    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e90434cb-13ea-4939-86bd-240e85f51782-extensions-socket-volume\") pod \"e90434cb-13ea-4939-86bd-240e85f51782\" (UID: \"e90434cb-13ea-4939-86bd-240e85f51782\") "
Jul 27 19:44:49.375843 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.375830    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwdhf\" (UniqueName: \"kubernetes.io/projected/e90434cb-13ea-4939-86bd-240e85f51782-kube-api-access-gwdhf\") pod \"e90434cb-13ea-4939-86bd-240e85f51782\" (UID: \"e90434cb-13ea-4939-86bd-240e85f51782\") "
Jul 27 19:44:49.376222 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.376199    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e90434cb-13ea-4939-86bd-240e85f51782-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e90434cb-13ea-4939-86bd-240e85f51782" (UID: "e90434cb-13ea-4939-86bd-240e85f51782"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:44:49.377941 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.377919    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e90434cb-13ea-4939-86bd-240e85f51782-kube-api-access-gwdhf" (OuterVolumeSpecName: "kube-api-access-gwdhf") pod "e90434cb-13ea-4939-86bd-240e85f51782" (UID: "e90434cb-13ea-4939-86bd-240e85f51782"). InnerVolumeSpecName "kube-api-access-gwdhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:44:49.476815 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.476786    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e90434cb-13ea-4939-86bd-240e85f51782-extensions-socket-volume\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:44:49.476815 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.476807    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwdhf\" (UniqueName: \"kubernetes.io/projected/e90434cb-13ea-4939-86bd-240e85f51782-kube-api-access-gwdhf\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:44:49.831445 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.831407    2563 generic.go:356] "Generic (PLEG): container finished" podID="e90434cb-13ea-4939-86bd-240e85f51782" containerID="d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d" exitCode=0
Jul 27 19:44:49.831601 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.831448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6" event={"ID":"e90434cb-13ea-4939-86bd-240e85f51782","Type":"ContainerDied","Data":"d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d"}
Jul 27 19:44:49.831601 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.831464    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"
Jul 27 19:44:49.831601 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.831529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6" event={"ID":"e90434cb-13ea-4939-86bd-240e85f51782","Type":"ContainerDied","Data":"ae1d1167d0d4d4ab79eb1038a4c8ac04e62bc9e99d0b15846e4787a53f90e857"}
Jul 27 19:44:49.831601 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.831552    2563 scope.go:117] "RemoveContainer" containerID="d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d"
Jul 27 19:44:49.840890 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.840876    2563 scope.go:117] "RemoveContainer" containerID="d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d"
Jul 27 19:44:49.841183 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:44:49.841164    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d\": container with ID starting with d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d not found: ID does not exist" containerID="d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d"
Jul 27 19:44:49.841244 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.841190    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d"} err="failed to get container status \"d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d\": rpc error: code = NotFound desc = could not find container \"d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d\": container with ID starting with d58993b21961461aa22ad566a10ab834e896defca85687550696da4db115f52d not found: ID does not exist"
Jul 27 19:44:49.870057 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.870014    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"]
Jul 27 19:44:49.876582 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:49.876559    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b4fs6"]
Jul 27 19:44:51.373338 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:44:51.373308    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e90434cb-13ea-4939-86bd-240e85f51782" path="/var/lib/kubelet/pods/e90434cb-13ea-4939-86bd-240e85f51782/volumes"
Jul 27 19:45:00.175628 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:00.175596    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753025-679ml"]
Jul 27 19:45:00.176009 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:00.175958    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e90434cb-13ea-4939-86bd-240e85f51782" containerName="manager"
Jul 27 19:45:00.176009 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:00.175969    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e90434cb-13ea-4939-86bd-240e85f51782" containerName="manager"
Jul 27 19:45:00.176123 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:00.176048    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e90434cb-13ea-4939-86bd-240e85f51782" containerName="manager"
Jul 27 19:45:00.180096 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:00.180079    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-679ml"
Jul 27 19:45:00.183877 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:00.183860    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pljl4\""
Jul 27 19:45:00.189723 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:00.189701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-679ml"
Jul 27 19:45:00.195420 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:00.195396    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753025-679ml"]
Jul 27 19:45:00.336903 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:00.336876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753025-679ml"]
Jul 27 19:45:00.339560 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:45:00.339534    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f3ad2d_7b45_4199_a950_be745b313a35.slice/crio-38f82ccd9ab9aeffff1a9d075f71eec8fe30bc48ff128334d27b7ba80620ab2c WatchSource:0}: Error finding container 38f82ccd9ab9aeffff1a9d075f71eec8fe30bc48ff128334d27b7ba80620ab2c: Status 404 returned error can't find the container with id 38f82ccd9ab9aeffff1a9d075f71eec8fe30bc48ff128334d27b7ba80620ab2c
Jul 27 19:45:00.341442 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:00.341423    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:45:00.883269 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:00.883233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-679ml" event={"ID":"34f3ad2d-7b45-4199-a950-be745b313a35","Type":"ContainerStarted","Data":"38f82ccd9ab9aeffff1a9d075f71eec8fe30bc48ff128334d27b7ba80620ab2c"}
Jul 27 19:45:03.898873 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:03.898841    2563 generic.go:356] "Generic (PLEG): container finished" podID="34f3ad2d-7b45-4199-a950-be745b313a35" containerID="0c9bdd0f9bd1d12fc8ea2f749976acd174f1bc151eb6bab57986da94dfd96dbd" exitCode=0
Jul 27 19:45:03.899290 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:03.898933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-679ml" event={"ID":"34f3ad2d-7b45-4199-a950-be745b313a35","Type":"ContainerDied","Data":"0c9bdd0f9bd1d12fc8ea2f749976acd174f1bc151eb6bab57986da94dfd96dbd"}
Jul 27 19:45:05.038658 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:05.038634    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-679ml"
Jul 27 19:45:05.909727 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:05.909698    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-679ml"
Jul 27 19:45:05.909900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:05.909739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-679ml" event={"ID":"34f3ad2d-7b45-4199-a950-be745b313a35","Type":"ContainerDied","Data":"38f82ccd9ab9aeffff1a9d075f71eec8fe30bc48ff128334d27b7ba80620ab2c"}
Jul 27 19:45:05.909900 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:05.909807    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38f82ccd9ab9aeffff1a9d075f71eec8fe30bc48ff128334d27b7ba80620ab2c"
Jul 27 19:45:47.390266 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.390236    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"]
Jul 27 19:45:47.391776 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.390566    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34f3ad2d-7b45-4199-a950-be745b313a35" containerName="cleanup"
Jul 27 19:45:47.391776 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.390577    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="34f3ad2d-7b45-4199-a950-be745b313a35" containerName="cleanup"
Jul 27 19:45:47.391776 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.390649    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="34f3ad2d-7b45-4199-a950-be745b313a35" containerName="cleanup"
Jul 27 19:45:47.392648 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.392634    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"
Jul 27 19:45:47.396879 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.396860    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5qhf8\""
Jul 27 19:45:47.412625 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.412600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"]
Jul 27 19:45:47.541213 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.541182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/554f1663-d7c1-4693-ab72-9307cccb8fef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l6jqh\" (UID: \"554f1663-d7c1-4693-ab72-9307cccb8fef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"
Jul 27 19:45:47.541213 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.541218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc82c\" (UniqueName: \"kubernetes.io/projected/554f1663-d7c1-4693-ab72-9307cccb8fef-kube-api-access-jc82c\") pod \"kuadrant-operator-controller-manager-86878c769f-l6jqh\" (UID: \"554f1663-d7c1-4693-ab72-9307cccb8fef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"
Jul 27 19:45:47.642094 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.641997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/554f1663-d7c1-4693-ab72-9307cccb8fef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l6jqh\" (UID: \"554f1663-d7c1-4693-ab72-9307cccb8fef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"
Jul 27 19:45:47.642094 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.642055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc82c\" (UniqueName: \"kubernetes.io/projected/554f1663-d7c1-4693-ab72-9307cccb8fef-kube-api-access-jc82c\") pod \"kuadrant-operator-controller-manager-86878c769f-l6jqh\" (UID: \"554f1663-d7c1-4693-ab72-9307cccb8fef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"
Jul 27 19:45:47.642447 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.642424    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/554f1663-d7c1-4693-ab72-9307cccb8fef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l6jqh\" (UID: \"554f1663-d7c1-4693-ab72-9307cccb8fef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"
Jul 27 19:45:47.659453 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.659425    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc82c\" (UniqueName: \"kubernetes.io/projected/554f1663-d7c1-4693-ab72-9307cccb8fef-kube-api-access-jc82c\") pod \"kuadrant-operator-controller-manager-86878c769f-l6jqh\" (UID: \"554f1663-d7c1-4693-ab72-9307cccb8fef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"
Jul 27 19:45:47.702078 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.702020    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"
Jul 27 19:45:47.849539 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:47.849210    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"]
Jul 27 19:45:47.853124 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:45:47.853093    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554f1663_d7c1_4693_ab72_9307cccb8fef.slice/crio-93001b85119fc1a548dd0848e6ca2a9fd69892713775e9d8aa57e02a425fccc8 WatchSource:0}: Error finding container 93001b85119fc1a548dd0848e6ca2a9fd69892713775e9d8aa57e02a425fccc8: Status 404 returned error can't find the container with id 93001b85119fc1a548dd0848e6ca2a9fd69892713775e9d8aa57e02a425fccc8
Jul 27 19:45:48.106756 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:48.106722    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh" event={"ID":"554f1663-d7c1-4693-ab72-9307cccb8fef","Type":"ContainerStarted","Data":"035fc497b181262c3ff861f3fa9baebc3471972ae9d5ec1210f6512284c634b8"}
Jul 27 19:45:48.106911 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:48.106781    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh" event={"ID":"554f1663-d7c1-4693-ab72-9307cccb8fef","Type":"ContainerStarted","Data":"93001b85119fc1a548dd0848e6ca2a9fd69892713775e9d8aa57e02a425fccc8"}
Jul 27 19:45:48.106911 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:48.106859    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"
Jul 27 19:45:48.134246 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:48.134141    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh" podStartSLOduration=1.134123218 podStartE2EDuration="1.134123218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:45:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:45:48.132595012 +0000 UTC m=+1309.275799412" watchObservedRunningTime="2026-07-27 19:45:48.134123218 +0000 UTC m=+1309.277327596"
Jul 27 19:45:59.114463 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:45:59.114430    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l6jqh"
Jul 27 19:52:55.828976 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.828898    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"]
Jul 27 19:52:55.831495 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.831476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:55.836653 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.836629    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e5b0400d-openshift-default-dockercfg-v9g9v\""
Jul 27 19:52:55.864120 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.864088    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"]
Jul 27 19:52:55.931127 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.931099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-credential-socket\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:55.931296 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.931133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e89544a1-575e-4a80-8782-4596455f39d8-istio-token\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:55.931296 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.931162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e89544a1-575e-4a80-8782-4596455f39d8-istio-podinfo\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:55.931296 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.931228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-workload-socket\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:55.931296 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.931257    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e89544a1-575e-4a80-8782-4596455f39d8-istiod-ca-cert\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:55.931462 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.931310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-istio-envoy\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:55.931462 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.931326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpbcx\" (UniqueName: \"kubernetes.io/projected/e89544a1-575e-4a80-8782-4596455f39d8-kube-api-access-mpbcx\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:55.931462 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.931387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-istio-data\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:55.931462 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:55.931426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-workload-certs\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.032577 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.032538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-workload-certs\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.032760 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.032657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-credential-socket\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.032760 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.032686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e89544a1-575e-4a80-8782-4596455f39d8-istio-token\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.032760 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.032724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e89544a1-575e-4a80-8782-4596455f39d8-istio-podinfo\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.032927 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.032764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-workload-socket\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.032927 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.032771    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-workload-certs\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.032927 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.032787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e89544a1-575e-4a80-8782-4596455f39d8-istiod-ca-cert\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.032927 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.032864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-istio-envoy\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.032927 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.032890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpbcx\" (UniqueName: \"kubernetes.io/projected/e89544a1-575e-4a80-8782-4596455f39d8-kube-api-access-mpbcx\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.033211 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.032931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-istio-data\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.033211 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.033018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-credential-socket\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.033211 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.033087    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-workload-socket\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.033368 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.033323    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-istio-data\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.033699 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.033680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e89544a1-575e-4a80-8782-4596455f39d8-istiod-ca-cert\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.035206 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.035189    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-istio-envoy\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.035341 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.035321    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e89544a1-575e-4a80-8782-4596455f39d8-istio-podinfo\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.044912 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.044882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpbcx\" (UniqueName: \"kubernetes.io/projected/e89544a1-575e-4a80-8782-4596455f39d8-kube-api-access-mpbcx\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.046293 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.046271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e89544a1-575e-4a80-8782-4596455f39d8-istio-token\") pod \"e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") " pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.141915 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.141834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:56.284109 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.284072    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"]
Jul 27 19:52:56.286787 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:52:56.286759    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89544a1_575e_4a80_8782_4596455f39d8.slice/crio-e3ca956338f7d3ea74beaa9103f8156bdec71f327c2f8f4a017ef1ef4a3d4b9a WatchSource:0}: Error finding container e3ca956338f7d3ea74beaa9103f8156bdec71f327c2f8f4a017ef1ef4a3d4b9a: Status 404 returned error can't find the container with id e3ca956338f7d3ea74beaa9103f8156bdec71f327c2f8f4a017ef1ef4a3d4b9a
Jul 27 19:52:56.289292 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.289261    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:52:56.289362 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.289330    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:52:56.289398 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:56.289359    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:52:57.175423 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:57.175387    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2" event={"ID":"e89544a1-575e-4a80-8782-4596455f39d8","Type":"ContainerStarted","Data":"8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f"}
Jul 27 19:52:57.175782 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:57.175437    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2" event={"ID":"e89544a1-575e-4a80-8782-4596455f39d8","Type":"ContainerStarted","Data":"e3ca956338f7d3ea74beaa9103f8156bdec71f327c2f8f4a017ef1ef4a3d4b9a"}
Jul 27 19:52:57.208077 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:57.208012    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2" podStartSLOduration=2.207994487 podStartE2EDuration="2.207994487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:52:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:52:57.205937008 +0000 UTC m=+1738.349141384" watchObservedRunningTime="2026-07-27 19:52:57.207994487 +0000 UTC m=+1738.351198863"
Jul 27 19:52:58.142107 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:58.142072    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:58.146942 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:58.146918    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:58.180999 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:58.180971    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:52:58.181915 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:52:58.181898    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:53:12.252657 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:12.252626    2563 generic.go:356] "Generic (PLEG): container finished" podID="e89544a1-575e-4a80-8782-4596455f39d8" containerID="8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f" exitCode=0
Jul 27 19:53:12.253170 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:12.252684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2" event={"ID":"e89544a1-575e-4a80-8782-4596455f39d8","Type":"ContainerDied","Data":"8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f"}
Jul 27 19:53:12.253170 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:12.253137    2563 scope.go:117] "RemoveContainer" containerID="8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f"
Jul 27 19:53:12.254239 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:12.254208    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:53:12.254306 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:12.254276    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:53:12.254347 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:12.254316    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:53:13.181531 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:13.181489    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:53:13.260425 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:13.260385    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2" event={"ID":"e89544a1-575e-4a80-8782-4596455f39d8","Type":"ContainerStarted","Data":"cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984"}
Jul 27 19:53:14.142708 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:14.142680    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:53:14.143423 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:14.143394    2563 patch_prober.go:28] interesting pod/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 27 19:53:14.143545 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:14.143447    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2" podUID="e89544a1-575e-4a80-8782-4596455f39d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 27 19:53:15.143125 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:15.143091    2563 patch_prober.go:28] interesting pod/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 27 19:53:15.143515 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:15.143143    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2" podUID="e89544a1-575e-4a80-8782-4596455f39d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 27 19:53:16.142506 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:16.142463    2563 patch_prober.go:28] interesting pod/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 27 19:53:16.142715 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:16.142537    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2" podUID="e89544a1-575e-4a80-8782-4596455f39d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 27 19:53:17.146617 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:17.146587    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:53:17.146986 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:17.146941    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:53:17.147546 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:53:17.147532    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:58:20.442820 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:20.442743    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"]
Jul 27 19:58:20.443317 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:20.442956    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2" podUID="e89544a1-575e-4a80-8782-4596455f39d8" containerName="istio-proxy" containerID="cri-o://cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984" gracePeriod=30
Jul 27 19:58:21.498960 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.498922    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"]
Jul 27 19:58:21.501247 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.501228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.504264 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.504239    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-4369fd46-gw-openshift-default-dockercfg-6kvt9\""
Jul 27 19:58:21.515094 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.515071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"]
Jul 27 19:58:21.571320 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.571292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-envoy\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.571486 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.571332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-workload-socket\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.571486 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.571397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02d70341-7d64-4412-a196-ad7d7347a5e0-istiod-ca-cert\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.571486 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.571436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-podinfo\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.571486 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.571469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-token\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.571627 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.571539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-credential-socket\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.571627 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.571565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-workload-certs\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.571627 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.571591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2zk8\" (UniqueName: \"kubernetes.io/projected/02d70341-7d64-4412-a196-ad7d7347a5e0-kube-api-access-t2zk8\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.571725 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.571631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-data\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.672779 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.672745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02d70341-7d64-4412-a196-ad7d7347a5e0-istiod-ca-cert\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.672779 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.672783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-podinfo\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.673074 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.672814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-token\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.673074 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.672844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-credential-socket\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.673074 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.672870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-workload-certs\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.673074 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.672888    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2zk8\" (UniqueName: \"kubernetes.io/projected/02d70341-7d64-4412-a196-ad7d7347a5e0-kube-api-access-t2zk8\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.673074 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.672917    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-data\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.673074 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.672944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-envoy\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.673074 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.672982    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-workload-socket\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.673459 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.673406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-workload-socket\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.673459 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.673450    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-workload-certs\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.673547 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.673503    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-data\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.673547 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.673516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-credential-socket\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.673656 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.673604    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02d70341-7d64-4412-a196-ad7d7347a5e0-istiod-ca-cert\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.675594 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.675570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-envoy\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.675720 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.675703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-podinfo\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.683870 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.683847    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-token\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.684007 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.683982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2zk8\" (UniqueName: \"kubernetes.io/projected/02d70341-7d64-4412-a196-ad7d7347a5e0-kube-api-access-t2zk8\") pod \"e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") " pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.811215 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.811190    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:21.961223 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.961201    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"]
Jul 27 19:58:21.963167 ip-10-0-134-17 kubenswrapper[2563]: W0727 19:58:21.963142    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d70341_7d64_4412_a196_ad7d7347a5e0.slice/crio-9da80b63a79f282c2202aec08f910a65df255a3c11001ac4366802f2e902610f WatchSource:0}: Error finding container 9da80b63a79f282c2202aec08f910a65df255a3c11001ac4366802f2e902610f: Status 404 returned error can't find the container with id 9da80b63a79f282c2202aec08f910a65df255a3c11001ac4366802f2e902610f
Jul 27 19:58:21.965332 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.965296    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:58:21.965420 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.965362    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:58:21.965420 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:21.965394    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:58:22.735158 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:22.735123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z" event={"ID":"02d70341-7d64-4412-a196-ad7d7347a5e0","Type":"ContainerStarted","Data":"62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69"}
Jul 27 19:58:22.735554 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:22.735173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z" event={"ID":"02d70341-7d64-4412-a196-ad7d7347a5e0","Type":"ContainerStarted","Data":"9da80b63a79f282c2202aec08f910a65df255a3c11001ac4366802f2e902610f"}
Jul 27 19:58:22.763098 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:22.763030    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z" podStartSLOduration=1.7630077 podStartE2EDuration="1.7630077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:58:22.76170764 +0000 UTC m=+2063.904912017" watchObservedRunningTime="2026-07-27 19:58:22.7630077 +0000 UTC m=+2063.906212075"
Jul 27 19:58:22.812056 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:22.812007    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:23.816730 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:23.816691    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:24.745027 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:24.744995    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:24.746099 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:24.746076    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:25.700297 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.700270    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:58:25.752163 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.752093    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"
Jul 27 19:58:25.752163 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.752114    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2" event={"ID":"e89544a1-575e-4a80-8782-4596455f39d8","Type":"ContainerDied","Data":"cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984"}
Jul 27 19:58:25.752374 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.752176    2563 scope.go:117] "RemoveContainer" containerID="cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984"
Jul 27 19:58:25.752374 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.752082    2563 generic.go:356] "Generic (PLEG): container finished" podID="e89544a1-575e-4a80-8782-4596455f39d8" containerID="cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984" exitCode=0
Jul 27 19:58:25.752374 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.752314    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2" event={"ID":"e89544a1-575e-4a80-8782-4596455f39d8","Type":"ContainerDied","Data":"e3ca956338f7d3ea74beaa9103f8156bdec71f327c2f8f4a017ef1ef4a3d4b9a"}
Jul 27 19:58:25.761195 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.761177    2563 scope.go:117] "RemoveContainer" containerID="8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f"
Jul 27 19:58:25.769210 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.769184    2563 scope.go:117] "RemoveContainer" containerID="cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984"
Jul 27 19:58:25.769469 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:58:25.769451    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984\": container with ID starting with cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984 not found: ID does not exist" containerID="cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984"
Jul 27 19:58:25.769642 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.769477    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984"} err="failed to get container status \"cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984\": rpc error: code = NotFound desc = could not find container \"cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984\": container with ID starting with cf531304e980747f612473defec2daa857f755a6c08b4fe0e2cb1d2e535db984 not found: ID does not exist"
Jul 27 19:58:25.769642 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.769494    2563 scope.go:117] "RemoveContainer" containerID="8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f"
Jul 27 19:58:25.769740 ip-10-0-134-17 kubenswrapper[2563]: E0727 19:58:25.769723    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f\": container with ID starting with 8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f not found: ID does not exist" containerID="8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f"
Jul 27 19:58:25.769777 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.769745    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f"} err="failed to get container status \"8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f\": rpc error: code = NotFound desc = could not find container \"8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f\": container with ID starting with 8b923baccc0c71edd9ed81d7e5672b2b3f07e294665ea27ab62ba810a11e840f not found: ID does not exist"
Jul 27 19:58:25.812134 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812105    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-istio-data\") pod \"e89544a1-575e-4a80-8782-4596455f39d8\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") "
Jul 27 19:58:25.812305 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812141    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e89544a1-575e-4a80-8782-4596455f39d8-istio-token\") pod \"e89544a1-575e-4a80-8782-4596455f39d8\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") "
Jul 27 19:58:25.812305 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812197    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-workload-certs\") pod \"e89544a1-575e-4a80-8782-4596455f39d8\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") "
Jul 27 19:58:25.812305 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812226    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-credential-socket\") pod \"e89544a1-575e-4a80-8782-4596455f39d8\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") "
Jul 27 19:58:25.812305 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812262    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e89544a1-575e-4a80-8782-4596455f39d8-istio-podinfo\") pod \"e89544a1-575e-4a80-8782-4596455f39d8\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") "
Jul 27 19:58:25.812526 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812491    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-workload-socket\") pod \"e89544a1-575e-4a80-8782-4596455f39d8\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") "
Jul 27 19:58:25.812587 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812556    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e89544a1-575e-4a80-8782-4596455f39d8" (UID: "e89544a1-575e-4a80-8782-4596455f39d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:25.812587 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812576    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e89544a1-575e-4a80-8782-4596455f39d8-istiod-ca-cert\") pod \"e89544a1-575e-4a80-8782-4596455f39d8\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") "
Jul 27 19:58:25.812695 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812645    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpbcx\" (UniqueName: \"kubernetes.io/projected/e89544a1-575e-4a80-8782-4596455f39d8-kube-api-access-mpbcx\") pod \"e89544a1-575e-4a80-8782-4596455f39d8\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") "
Jul 27 19:58:25.812751 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812706    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-istio-envoy\") pod \"e89544a1-575e-4a80-8782-4596455f39d8\" (UID: \"e89544a1-575e-4a80-8782-4596455f39d8\") "
Jul 27 19:58:25.812837 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812572    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e89544a1-575e-4a80-8782-4596455f39d8" (UID: "e89544a1-575e-4a80-8782-4596455f39d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:25.812908 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812890    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e89544a1-575e-4a80-8782-4596455f39d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e89544a1-575e-4a80-8782-4596455f39d8" (UID: "e89544a1-575e-4a80-8782-4596455f39d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:25.813025 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812977    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e89544a1-575e-4a80-8782-4596455f39d8" (UID: "e89544a1-575e-4a80-8782-4596455f39d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:25.813025 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.812992    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:58:25.813025 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.813001    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "e89544a1-575e-4a80-8782-4596455f39d8" (UID: "e89544a1-575e-4a80-8782-4596455f39d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:25.813025 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.813008    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:58:25.813025 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.813022    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e89544a1-575e-4a80-8782-4596455f39d8-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:58:25.814880 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.814852    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e89544a1-575e-4a80-8782-4596455f39d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e89544a1-575e-4a80-8782-4596455f39d8" (UID: "e89544a1-575e-4a80-8782-4596455f39d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:58:25.815065 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.815027    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e89544a1-575e-4a80-8782-4596455f39d8-kube-api-access-mpbcx" (OuterVolumeSpecName: "kube-api-access-mpbcx") pod "e89544a1-575e-4a80-8782-4596455f39d8" (UID: "e89544a1-575e-4a80-8782-4596455f39d8"). InnerVolumeSpecName "kube-api-access-mpbcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:25.815065 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.815027    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e89544a1-575e-4a80-8782-4596455f39d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "e89544a1-575e-4a80-8782-4596455f39d8" (UID: "e89544a1-575e-4a80-8782-4596455f39d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:25.815185 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.815116    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e89544a1-575e-4a80-8782-4596455f39d8" (UID: "e89544a1-575e-4a80-8782-4596455f39d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:25.913947 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.913905    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:58:25.913947 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.913941    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:58:25.913947 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.913954    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e89544a1-575e-4a80-8782-4596455f39d8-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:58:25.914288 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.913966    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e89544a1-575e-4a80-8782-4596455f39d8-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:58:25.914288 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.913978    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e89544a1-575e-4a80-8782-4596455f39d8-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:58:25.914288 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:25.913991    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpbcx\" (UniqueName: \"kubernetes.io/projected/e89544a1-575e-4a80-8782-4596455f39d8-kube-api-access-mpbcx\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 19:58:26.079200 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:26.079165    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"]
Jul 27 19:58:26.086823 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:26.086797    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e5b0400d-openshift-default-787bf78fbd-bj7v2"]
Jul 27 19:58:27.377233 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:27.377197    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e89544a1-575e-4a80-8782-4596455f39d8" path="/var/lib/kubelet/pods/e89544a1-575e-4a80-8782-4596455f39d8/volumes"
Jul 27 19:58:36.810566 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:36.810528    2563 generic.go:356] "Generic (PLEG): container finished" podID="02d70341-7d64-4412-a196-ad7d7347a5e0" containerID="62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69" exitCode=0
Jul 27 19:58:36.810988 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:36.810595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z" event={"ID":"02d70341-7d64-4412-a196-ad7d7347a5e0","Type":"ContainerDied","Data":"62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69"}
Jul 27 19:58:36.811208 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:36.811192    2563 scope.go:117] "RemoveContainer" containerID="62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69"
Jul 27 19:58:36.812198 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:36.812170    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:58:36.812270 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:36.812237    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:58:36.812307 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:36.812267    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:58:37.817318 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:37.817283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z" event={"ID":"02d70341-7d64-4412-a196-ad7d7347a5e0","Type":"ContainerStarted","Data":"42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53"}
Jul 27 19:58:38.811850 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:38.811811    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:38.812862 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:38.812838    2563 patch_prober.go:28] interesting pod/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 27 19:58:38.812969 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:38.812885    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z" podUID="02d70341-7d64-4412-a196-ad7d7347a5e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 27 19:58:39.748095 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:39.748032    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:39.811645 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:39.811610    2563 patch_prober.go:28] interesting pod/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 27 19:58:39.811828 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:39.811678    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z" podUID="02d70341-7d64-4412-a196-ad7d7347a5e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 27 19:58:40.811869 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:40.811831    2563 patch_prober.go:28] interesting pod/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 27 19:58:40.812299 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:40.811887    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z" podUID="02d70341-7d64-4412-a196-ad7d7347a5e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 27 19:58:41.815958 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:41.815926    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 19:58:41.817010 ip-10-0-134-17 kubenswrapper[2563]: I0727 19:58:41.816992    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 20:01:48.043962 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.043919    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"]
Jul 27 20:01:48.044445 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.044207    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z" podUID="02d70341-7d64-4412-a196-ad7d7347a5e0" containerName="istio-proxy" containerID="cri-o://42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53" gracePeriod=30
Jul 27 20:01:48.802695 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.802653    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"]
Jul 27 20:01:48.803468 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.803437    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e89544a1-575e-4a80-8782-4596455f39d8" containerName="istio-proxy"
Jul 27 20:01:48.803468 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.803470    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e89544a1-575e-4a80-8782-4596455f39d8" containerName="istio-proxy"
Jul 27 20:01:48.803686 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.803671    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e89544a1-575e-4a80-8782-4596455f39d8" containerName="istio-proxy"
Jul 27 20:01:48.803741 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.803698    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e89544a1-575e-4a80-8782-4596455f39d8" containerName="istio-proxy"
Jul 27 20:01:48.807257 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.807234    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:48.810315 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.810296    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-554d51aa-openshift-default-dockercfg-q849j\""
Jul 27 20:01:48.819064 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.819014    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"]
Jul 27 20:01:48.917629 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.917597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40104624-db2f-482d-874f-e8c1c78c0296-istiod-ca-cert\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:48.917807 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.917647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-credential-socket\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:48.917807 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.917672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-workload-certs\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:48.917807 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.917725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-workload-socket\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:48.917917 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.917794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40104624-db2f-482d-874f-e8c1c78c0296-istio-podinfo\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:48.917917 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.917843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-istio-data\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:48.917917 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.917902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-istio-envoy\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:48.918019 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.917933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40104624-db2f-482d-874f-e8c1c78c0296-istio-token\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:48.918019 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:48.917964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hfnm\" (UniqueName: \"kubernetes.io/projected/40104624-db2f-482d-874f-e8c1c78c0296-kube-api-access-9hfnm\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.018677 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.018640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-istio-envoy\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.018677 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.018676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40104624-db2f-482d-874f-e8c1c78c0296-istio-token\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.018915 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.018702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfnm\" (UniqueName: \"kubernetes.io/projected/40104624-db2f-482d-874f-e8c1c78c0296-kube-api-access-9hfnm\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.018915 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.018745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40104624-db2f-482d-874f-e8c1c78c0296-istiod-ca-cert\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.018915 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.018791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-credential-socket\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.018915 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.018823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-workload-certs\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.018915 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.018852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-workload-socket\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.018915 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.018886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40104624-db2f-482d-874f-e8c1c78c0296-istio-podinfo\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.019258 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.018917    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-istio-data\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.019258 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.019238    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-credential-socket\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.019367 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.019340    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-workload-socket\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.019367 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.019359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-istio-data\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.019490 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.019418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-workload-certs\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.019614 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.019592    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40104624-db2f-482d-874f-e8c1c78c0296-istiod-ca-cert\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.021150 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.021132    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-istio-envoy\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.021512 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.021495    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40104624-db2f-482d-874f-e8c1c78c0296-istio-podinfo\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.031518 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.031473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40104624-db2f-482d-874f-e8c1c78c0296-istio-token\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.033131 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.033111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hfnm\" (UniqueName: \"kubernetes.io/projected/40104624-db2f-482d-874f-e8c1c78c0296-kube-api-access-9hfnm\") pod \"e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") " pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.118123 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.118049    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:49.258674 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.258615    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"]
Jul 27 20:01:49.260950 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:01:49.260924    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40104624_db2f_482d_874f_e8c1c78c0296.slice/crio-51cd962ce077d7bd2ac6fac501c553b051e781a562da483258d24c514910c357 WatchSource:0}: Error finding container 51cd962ce077d7bd2ac6fac501c553b051e781a562da483258d24c514910c357: Status 404 returned error can't find the container with id 51cd962ce077d7bd2ac6fac501c553b051e781a562da483258d24c514910c357
Jul 27 20:01:49.262890 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.262855    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:01:49.262986 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.262920    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:01:49.262986 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.262948    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:01:49.715479 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.715443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l" event={"ID":"40104624-db2f-482d-874f-e8c1c78c0296","Type":"ContainerStarted","Data":"86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5"}
Jul 27 20:01:49.715694 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.715492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l" event={"ID":"40104624-db2f-482d-874f-e8c1c78c0296","Type":"ContainerStarted","Data":"51cd962ce077d7bd2ac6fac501c553b051e781a562da483258d24c514910c357"}
Jul 27 20:01:49.743773 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:49.743717    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l" podStartSLOduration=1.743700924 podStartE2EDuration="1.743700924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:01:49.741423587 +0000 UTC m=+2270.884627966" watchObservedRunningTime="2026-07-27 20:01:49.743700924 +0000 UTC m=+2270.886905299"
Jul 27 20:01:50.119221 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:50.119186    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:50.124355 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:50.124333    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:50.720176 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:50.720146    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:50.720930 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:50.720911    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:01:53.311685 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.311623    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 20:01:53.361998 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.361969    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2zk8\" (UniqueName: \"kubernetes.io/projected/02d70341-7d64-4412-a196-ad7d7347a5e0-kube-api-access-t2zk8\") pod \"02d70341-7d64-4412-a196-ad7d7347a5e0\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") "
Jul 27 20:01:53.362205 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.362020    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-envoy\") pod \"02d70341-7d64-4412-a196-ad7d7347a5e0\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") "
Jul 27 20:01:53.362205 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.362074    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-workload-socket\") pod \"02d70341-7d64-4412-a196-ad7d7347a5e0\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") "
Jul 27 20:01:53.362205 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.362089    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-token\") pod \"02d70341-7d64-4412-a196-ad7d7347a5e0\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") "
Jul 27 20:01:53.362205 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.362129    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-podinfo\") pod \"02d70341-7d64-4412-a196-ad7d7347a5e0\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") "
Jul 27 20:01:53.362916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.362194    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-credential-socket\") pod \"02d70341-7d64-4412-a196-ad7d7347a5e0\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") "
Jul 27 20:01:53.362916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.362810    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02d70341-7d64-4412-a196-ad7d7347a5e0-istiod-ca-cert\") pod \"02d70341-7d64-4412-a196-ad7d7347a5e0\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") "
Jul 27 20:01:53.362916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.362839    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02d70341-7d64-4412-a196-ad7d7347a5e0" (UID: "02d70341-7d64-4412-a196-ad7d7347a5e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:01:53.362916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.362860    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02d70341-7d64-4412-a196-ad7d7347a5e0" (UID: "02d70341-7d64-4412-a196-ad7d7347a5e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:01:53.362916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.362875    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-workload-certs\") pod \"02d70341-7d64-4412-a196-ad7d7347a5e0\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") "
Jul 27 20:01:53.363255 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.362955    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-data\") pod \"02d70341-7d64-4412-a196-ad7d7347a5e0\" (UID: \"02d70341-7d64-4412-a196-ad7d7347a5e0\") "
Jul 27 20:01:53.363255 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.363087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02d70341-7d64-4412-a196-ad7d7347a5e0" (UID: "02d70341-7d64-4412-a196-ad7d7347a5e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:01:53.363255 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.363218    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02d70341-7d64-4412-a196-ad7d7347a5e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02d70341-7d64-4412-a196-ad7d7347a5e0" (UID: "02d70341-7d64-4412-a196-ad7d7347a5e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:01:53.364118 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.364088    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "02d70341-7d64-4412-a196-ad7d7347a5e0" (UID: "02d70341-7d64-4412-a196-ad7d7347a5e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:01:53.364944 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.364595    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:01:53.364944 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.364633    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:01:53.364944 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.364649    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:01:53.364944 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.364665    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02d70341-7d64-4412-a196-ad7d7347a5e0-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:01:53.364944 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.364680    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:01:53.367082 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.365665    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "02d70341-7d64-4412-a196-ad7d7347a5e0" (UID: "02d70341-7d64-4412-a196-ad7d7347a5e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:01:53.367082 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.365716    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02d70341-7d64-4412-a196-ad7d7347a5e0" (UID: "02d70341-7d64-4412-a196-ad7d7347a5e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:01:53.371970 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.371910    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02d70341-7d64-4412-a196-ad7d7347a5e0" (UID: "02d70341-7d64-4412-a196-ad7d7347a5e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:01:53.372335 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.372306    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02d70341-7d64-4412-a196-ad7d7347a5e0-kube-api-access-t2zk8" (OuterVolumeSpecName: "kube-api-access-t2zk8") pod "02d70341-7d64-4412-a196-ad7d7347a5e0" (UID: "02d70341-7d64-4412-a196-ad7d7347a5e0"). InnerVolumeSpecName "kube-api-access-t2zk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:01:53.466183 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.466155    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2zk8\" (UniqueName: \"kubernetes.io/projected/02d70341-7d64-4412-a196-ad7d7347a5e0-kube-api-access-t2zk8\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:01:53.466183 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.466183    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:01:53.466183 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.466197    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:01:53.466407 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.466210    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02d70341-7d64-4412-a196-ad7d7347a5e0-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:01:53.737292 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.737204    2563 generic.go:356] "Generic (PLEG): container finished" podID="02d70341-7d64-4412-a196-ad7d7347a5e0" containerID="42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53" exitCode=0
Jul 27 20:01:53.737292 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.737273    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"
Jul 27 20:01:53.737533 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.737284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z" event={"ID":"02d70341-7d64-4412-a196-ad7d7347a5e0","Type":"ContainerDied","Data":"42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53"}
Jul 27 20:01:53.737533 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.737353    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z" event={"ID":"02d70341-7d64-4412-a196-ad7d7347a5e0","Type":"ContainerDied","Data":"9da80b63a79f282c2202aec08f910a65df255a3c11001ac4366802f2e902610f"}
Jul 27 20:01:53.737533 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.737382    2563 scope.go:117] "RemoveContainer" containerID="42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53"
Jul 27 20:01:53.746362 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.746345    2563 scope.go:117] "RemoveContainer" containerID="62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69"
Jul 27 20:01:53.754131 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.754115    2563 scope.go:117] "RemoveContainer" containerID="42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53"
Jul 27 20:01:53.754381 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:01:53.754363    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53\": container with ID starting with 42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53 not found: ID does not exist" containerID="42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53"
Jul 27 20:01:53.754442 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.754389    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53"} err="failed to get container status \"42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53\": rpc error: code = NotFound desc = could not find container \"42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53\": container with ID starting with 42d6cb6ef7662c9564514528f466d70fee69d5e19e6a11c6f51332f6a5ec9c53 not found: ID does not exist"
Jul 27 20:01:53.754442 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.754405    2563 scope.go:117] "RemoveContainer" containerID="62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69"
Jul 27 20:01:53.754671 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:01:53.754653    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69\": container with ID starting with 62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69 not found: ID does not exist" containerID="62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69"
Jul 27 20:01:53.754721 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.754684    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69"} err="failed to get container status \"62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69\": rpc error: code = NotFound desc = could not find container \"62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69\": container with ID starting with 62e88dd2b284658a2516ab5255eac5878c58b63900f0db55a71c3db7610f0a69 not found: ID does not exist"
Jul 27 20:01:53.759741 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.759719    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"]
Jul 27 20:01:53.764512 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:53.764492    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-4369fd46-gw-openshift-default-7f5f6f5bdd-pqv8z"]
Jul 27 20:01:55.373788 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:01:55.373757    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02d70341-7d64-4412-a196-ad7d7347a5e0" path="/var/lib/kubelet/pods/02d70341-7d64-4412-a196-ad7d7347a5e0/volumes"
Jul 27 20:02:04.801062 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:04.800948    2563 generic.go:356] "Generic (PLEG): container finished" podID="40104624-db2f-482d-874f-e8c1c78c0296" containerID="86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5" exitCode=0
Jul 27 20:02:04.801062 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:04.801023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l" event={"ID":"40104624-db2f-482d-874f-e8c1c78c0296","Type":"ContainerDied","Data":"86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5"}
Jul 27 20:02:04.801503 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:04.801445    2563 scope.go:117] "RemoveContainer" containerID="86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5"
Jul 27 20:02:04.802488 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:04.802453    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:02:04.802603 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:04.802543    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:02:04.802603 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:04.802592    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:02:05.720943 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:05.720904    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:02:05.810849 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:05.810805    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l" event={"ID":"40104624-db2f-482d-874f-e8c1c78c0296","Type":"ContainerStarted","Data":"3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09"}
Jul 27 20:02:06.118424 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:06.118388    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:02:06.119572 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:06.119539    2563 patch_prober.go:28] interesting pod/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 27 20:02:06.119719 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:06.119598    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l" podUID="40104624-db2f-482d-874f-e8c1c78c0296" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 27 20:02:07.119024 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:07.118990    2563 patch_prober.go:28] interesting pod/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 27 20:02:07.119420 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:07.119068    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l" podUID="40104624-db2f-482d-874f-e8c1c78c0296" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 27 20:02:08.119095 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:08.119025    2563 patch_prober.go:28] interesting pod/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 27 20:02:08.119574 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:08.119118    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l" podUID="40104624-db2f-482d-874f-e8c1c78c0296" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 27 20:02:09.118678 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:09.118643    2563 patch_prober.go:28] interesting pod/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 27 20:02:09.118887 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:09.118714    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l" podUID="40104624-db2f-482d-874f-e8c1c78c0296" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 27 20:02:10.123320 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:10.123288    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:02:10.123726 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:10.123543    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:02:10.124179 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:02:10.124163    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:07:12.843455 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:12.843422    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"]
Jul 27 20:07:12.843879 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:12.843632    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l" podUID="40104624-db2f-482d-874f-e8c1c78c0296" containerName="istio-proxy" containerID="cri-o://3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09" gracePeriod=30
Jul 27 20:07:13.639604 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.639573    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"]
Jul 27 20:07:13.639923 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.639910    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02d70341-7d64-4412-a196-ad7d7347a5e0" containerName="istio-proxy"
Jul 27 20:07:13.639969 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.639949    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="02d70341-7d64-4412-a196-ad7d7347a5e0" containerName="istio-proxy"
Jul 27 20:07:13.639969 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.639958    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02d70341-7d64-4412-a196-ad7d7347a5e0" containerName="istio-proxy"
Jul 27 20:07:13.639969 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.639963    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="02d70341-7d64-4412-a196-ad7d7347a5e0" containerName="istio-proxy"
Jul 27 20:07:13.640112 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.639980    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e89544a1-575e-4a80-8782-4596455f39d8" containerName="istio-proxy"
Jul 27 20:07:13.640112 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.639986    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e89544a1-575e-4a80-8782-4596455f39d8" containerName="istio-proxy"
Jul 27 20:07:13.640112 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.640072    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="02d70341-7d64-4412-a196-ad7d7347a5e0" containerName="istio-proxy"
Jul 27 20:07:13.640112 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.640079    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="02d70341-7d64-4412-a196-ad7d7347a5e0" containerName="istio-proxy"
Jul 27 20:07:13.642085 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.642068    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.645387 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.645368    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a56cb698-openshift-default-dockercfg-lbzvn\""
Jul 27 20:07:13.656235 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.656209    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"]
Jul 27 20:07:13.733952 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.733915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-workload-socket\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.734190 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.733979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-workload-certs\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.734190 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.734013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-data\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.734190 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.734055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istiod-ca-cert\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.734190 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.734121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r82zs\" (UniqueName: \"kubernetes.io/projected/5474bf8c-e191-4239-bdcd-5e7ad11901d2-kube-api-access-r82zs\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.734190 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.734160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-podinfo\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.734190 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.734192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-credential-socket\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.734577 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.734259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-token\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.734577 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.734356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-envoy\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835122 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-token\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835288 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-envoy\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835288 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-workload-socket\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835288 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-workload-certs\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835288 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-data\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835488 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istiod-ca-cert\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835488 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r82zs\" (UniqueName: \"kubernetes.io/projected/5474bf8c-e191-4239-bdcd-5e7ad11901d2-kube-api-access-r82zs\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835488 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835363    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-podinfo\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835488 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-credential-socket\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835717 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-workload-socket\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835781 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835712    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-workload-certs\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835870 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835849    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-data\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.835987 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.835971    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-credential-socket\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.836388 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.836324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istiod-ca-cert\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.837962 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.837939    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-envoy\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.838355 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.838340    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-podinfo\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.847248 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.847225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r82zs\" (UniqueName: \"kubernetes.io/projected/5474bf8c-e191-4239-bdcd-5e7ad11901d2-kube-api-access-r82zs\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.847553 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.847394    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-token\") pod \"e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") " pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:13.952490 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:13.952396    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:14.096556 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:14.096522    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"]
Jul 27 20:07:14.099810 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:07:14.099781    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5474bf8c_e191_4239_bdcd_5e7ad11901d2.slice/crio-82cd65aca2094dc2b751a7ac5cdead34a15e089420015632ced9975f60cc40c4 WatchSource:0}: Error finding container 82cd65aca2094dc2b751a7ac5cdead34a15e089420015632ced9975f60cc40c4: Status 404 returned error can't find the container with id 82cd65aca2094dc2b751a7ac5cdead34a15e089420015632ced9975f60cc40c4
Jul 27 20:07:14.101901 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:14.101869    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:07:14.101983 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:14.101935    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:07:14.101983 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:14.101966    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:07:14.267068 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:14.266950    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn" event={"ID":"5474bf8c-e191-4239-bdcd-5e7ad11901d2","Type":"ContainerStarted","Data":"fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148"}
Jul 27 20:07:14.267068 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:14.267013    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn" event={"ID":"5474bf8c-e191-4239-bdcd-5e7ad11901d2","Type":"ContainerStarted","Data":"82cd65aca2094dc2b751a7ac5cdead34a15e089420015632ced9975f60cc40c4"}
Jul 27 20:07:14.289848 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:14.289802    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn" podStartSLOduration=1.289786385 podStartE2EDuration="1.289786385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:07:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:07:14.289564096 +0000 UTC m=+2595.432768472" watchObservedRunningTime="2026-07-27 20:07:14.289786385 +0000 UTC m=+2595.432990752"
Jul 27 20:07:14.952774 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:14.952739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:15.958299 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:15.958269    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:16.276447 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:16.276355    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:16.277249 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:16.277225    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:18.098941 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.098917    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:07:18.176431 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.176352    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-istio-data\") pod \"40104624-db2f-482d-874f-e8c1c78c0296\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") "
Jul 27 20:07:18.176431 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.176435    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hfnm\" (UniqueName: \"kubernetes.io/projected/40104624-db2f-482d-874f-e8c1c78c0296-kube-api-access-9hfnm\") pod \"40104624-db2f-482d-874f-e8c1c78c0296\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") "
Jul 27 20:07:18.176680 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.176482    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-workload-certs\") pod \"40104624-db2f-482d-874f-e8c1c78c0296\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") "
Jul 27 20:07:18.176680 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.176516    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40104624-db2f-482d-874f-e8c1c78c0296-istio-podinfo\") pod \"40104624-db2f-482d-874f-e8c1c78c0296\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") "
Jul 27 20:07:18.176680 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.176545    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-workload-socket\") pod \"40104624-db2f-482d-874f-e8c1c78c0296\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") "
Jul 27 20:07:18.176680 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.176587    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-credential-socket\") pod \"40104624-db2f-482d-874f-e8c1c78c0296\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") "
Jul 27 20:07:18.176880 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.176696    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40104624-db2f-482d-874f-e8c1c78c0296-istiod-ca-cert\") pod \"40104624-db2f-482d-874f-e8c1c78c0296\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") "
Jul 27 20:07:18.176880 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.176704    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "40104624-db2f-482d-874f-e8c1c78c0296" (UID: "40104624-db2f-482d-874f-e8c1c78c0296"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:07:18.176880 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.176754    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40104624-db2f-482d-874f-e8c1c78c0296-istio-token\") pod \"40104624-db2f-482d-874f-e8c1c78c0296\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") "
Jul 27 20:07:18.176880 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.176805    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-istio-envoy\") pod \"40104624-db2f-482d-874f-e8c1c78c0296\" (UID: \"40104624-db2f-482d-874f-e8c1c78c0296\") "
Jul 27 20:07:18.177101 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.177000    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "40104624-db2f-482d-874f-e8c1c78c0296" (UID: "40104624-db2f-482d-874f-e8c1c78c0296"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:07:18.177101 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.177082    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "40104624-db2f-482d-874f-e8c1c78c0296" (UID: "40104624-db2f-482d-874f-e8c1c78c0296"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:07:18.177222 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.177150    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40104624-db2f-482d-874f-e8c1c78c0296-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "40104624-db2f-482d-874f-e8c1c78c0296" (UID: "40104624-db2f-482d-874f-e8c1c78c0296"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:07:18.177222 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.177176    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:07:18.177222 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.177196    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:07:18.177222 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.177212    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:07:18.177400 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.177361    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-istio-data" (OuterVolumeSpecName: "istio-data") pod "40104624-db2f-482d-874f-e8c1c78c0296" (UID: "40104624-db2f-482d-874f-e8c1c78c0296"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:07:18.181223 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.181198    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "40104624-db2f-482d-874f-e8c1c78c0296" (UID: "40104624-db2f-482d-874f-e8c1c78c0296"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:07:18.181387 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.181212    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40104624-db2f-482d-874f-e8c1c78c0296-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "40104624-db2f-482d-874f-e8c1c78c0296" (UID: "40104624-db2f-482d-874f-e8c1c78c0296"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:07:18.182279 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.182250    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40104624-db2f-482d-874f-e8c1c78c0296-istio-token" (OuterVolumeSpecName: "istio-token") pod "40104624-db2f-482d-874f-e8c1c78c0296" (UID: "40104624-db2f-482d-874f-e8c1c78c0296"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:07:18.182384 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.182333    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40104624-db2f-482d-874f-e8c1c78c0296-kube-api-access-9hfnm" (OuterVolumeSpecName: "kube-api-access-9hfnm") pod "40104624-db2f-482d-874f-e8c1c78c0296" (UID: "40104624-db2f-482d-874f-e8c1c78c0296"). InnerVolumeSpecName "kube-api-access-9hfnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:07:18.278122 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.278079    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hfnm\" (UniqueName: \"kubernetes.io/projected/40104624-db2f-482d-874f-e8c1c78c0296-kube-api-access-9hfnm\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:07:18.278122 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.278119    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40104624-db2f-482d-874f-e8c1c78c0296-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:07:18.278122 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.278129    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40104624-db2f-482d-874f-e8c1c78c0296-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:07:18.278364 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.278143    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40104624-db2f-482d-874f-e8c1c78c0296-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:07:18.278364 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.278155    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:07:18.278364 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.278162    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40104624-db2f-482d-874f-e8c1c78c0296-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:07:18.297911 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.297880    2563 generic.go:356] "Generic (PLEG): container finished" podID="40104624-db2f-482d-874f-e8c1c78c0296" containerID="3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09" exitCode=0
Jul 27 20:07:18.298136 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.297926    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"
Jul 27 20:07:18.298136 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.297968    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l" event={"ID":"40104624-db2f-482d-874f-e8c1c78c0296","Type":"ContainerDied","Data":"3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09"}
Jul 27 20:07:18.298136 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.298024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l" event={"ID":"40104624-db2f-482d-874f-e8c1c78c0296","Type":"ContainerDied","Data":"51cd962ce077d7bd2ac6fac501c553b051e781a562da483258d24c514910c357"}
Jul 27 20:07:18.298136 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.298062    2563 scope.go:117] "RemoveContainer" containerID="3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09"
Jul 27 20:07:18.307462 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.307435    2563 scope.go:117] "RemoveContainer" containerID="86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5"
Jul 27 20:07:18.316169 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.316145    2563 scope.go:117] "RemoveContainer" containerID="3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09"
Jul 27 20:07:18.316414 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:07:18.316398    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09\": container with ID starting with 3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09 not found: ID does not exist" containerID="3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09"
Jul 27 20:07:18.316466 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.316421    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09"} err="failed to get container status \"3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09\": rpc error: code = NotFound desc = could not find container \"3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09\": container with ID starting with 3d2aa6d0f9aef5a34c1bb99c8fde6d51a858dce652b08d4d3544bb12a802de09 not found: ID does not exist"
Jul 27 20:07:18.316466 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.316439    2563 scope.go:117] "RemoveContainer" containerID="86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5"
Jul 27 20:07:18.316704 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:07:18.316687    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5\": container with ID starting with 86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5 not found: ID does not exist" containerID="86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5"
Jul 27 20:07:18.316760 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.316707    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5"} err="failed to get container status \"86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5\": rpc error: code = NotFound desc = could not find container \"86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5\": container with ID starting with 86e0bf0dfde2a5ebd643313183db9796491eb92d13b2a159636b40d10560a6a5 not found: ID does not exist"
Jul 27 20:07:18.322982 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.322961    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"]
Jul 27 20:07:18.329963 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:18.329944    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-554d51aa-openshift-default-588d666d4d-9d82l"]
Jul 27 20:07:19.371945 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:19.371909    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40104624-db2f-482d-874f-e8c1c78c0296" path="/var/lib/kubelet/pods/40104624-db2f-482d-874f-e8c1c78c0296/volumes"
Jul 27 20:07:30.362996 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:30.362913    2563 generic.go:356] "Generic (PLEG): container finished" podID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerID="fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148" exitCode=0
Jul 27 20:07:30.363399 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:30.362990    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn" event={"ID":"5474bf8c-e191-4239-bdcd-5e7ad11901d2","Type":"ContainerDied","Data":"fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148"}
Jul 27 20:07:30.363399 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:30.363386    2563 scope.go:117] "RemoveContainer" containerID="fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148"
Jul 27 20:07:30.364395 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:30.364366    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:07:30.364486 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:30.364434    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:07:30.364486 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:30.364469    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:07:31.276711 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:31.276677    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:31.372617 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:31.372589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn" event={"ID":"5474bf8c-e191-4239-bdcd-5e7ad11901d2","Type":"ContainerStarted","Data":"d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d"}
Jul 27 20:07:31.953108 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:31.953073    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:31.954150 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:31.954111    2563 patch_prober.go:28] interesting pod/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 27 20:07:31.954287 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:31.954173    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn" podUID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 27 20:07:32.952990 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:32.952953    2563 patch_prober.go:28] interesting pod/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 27 20:07:32.953392 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:32.953010    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn" podUID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 27 20:07:33.953782 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:33.953744    2563 patch_prober.go:28] interesting pod/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 27 20:07:33.954221 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:33.953799    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn" podUID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 27 20:07:34.953091 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:34.953031    2563 patch_prober.go:28] interesting pod/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 27 20:07:34.953268 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:34.953110    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn" podUID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 27 20:07:35.956771 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:35.956741    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:35.957273 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:35.957146    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:07:35.957761 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:07:35.957744    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:12:37.274477 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:37.274447    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"]
Jul 27 20:12:37.274902 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:37.274692    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn" podUID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerName="istio-proxy" containerID="cri-o://d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d" gracePeriod=30
Jul 27 20:12:42.522127 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.522102    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:12:42.704982 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.704953    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-data\") pod \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") "
Jul 27 20:12:42.705203 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.704999    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-podinfo\") pod \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") "
Jul 27 20:12:42.705203 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.705062    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-token\") pod \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") "
Jul 27 20:12:42.705203 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.705093    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-workload-socket\") pod \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") "
Jul 27 20:12:42.705203 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.705138    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-workload-certs\") pod \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") "
Jul 27 20:12:42.705203 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.705159    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-envoy\") pod \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") "
Jul 27 20:12:42.705203 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.705185    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r82zs\" (UniqueName: \"kubernetes.io/projected/5474bf8c-e191-4239-bdcd-5e7ad11901d2-kube-api-access-r82zs\") pod \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") "
Jul 27 20:12:42.705530 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.705471    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5474bf8c-e191-4239-bdcd-5e7ad11901d2" (UID: "5474bf8c-e191-4239-bdcd-5e7ad11901d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:12:42.705530 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.705485    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5474bf8c-e191-4239-bdcd-5e7ad11901d2" (UID: "5474bf8c-e191-4239-bdcd-5e7ad11901d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:12:42.705635 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.705209    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-credential-socket\") pod \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") "
Jul 27 20:12:42.705694 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.705676    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istiod-ca-cert\") pod \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\" (UID: \"5474bf8c-e191-4239-bdcd-5e7ad11901d2\") "
Jul 27 20:12:42.705794 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.705759    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5474bf8c-e191-4239-bdcd-5e7ad11901d2" (UID: "5474bf8c-e191-4239-bdcd-5e7ad11901d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:12:42.706134 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.706016    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:12:42.706134 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.706052    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5474bf8c-e191-4239-bdcd-5e7ad11901d2" (UID: "5474bf8c-e191-4239-bdcd-5e7ad11901d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:12:42.706134 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.706075    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:12:42.706134 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.706091    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:12:42.706134 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.705834    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "5474bf8c-e191-4239-bdcd-5e7ad11901d2" (UID: "5474bf8c-e191-4239-bdcd-5e7ad11901d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:12:42.707619 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.707589    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5474bf8c-e191-4239-bdcd-5e7ad11901d2-kube-api-access-r82zs" (OuterVolumeSpecName: "kube-api-access-r82zs") pod "5474bf8c-e191-4239-bdcd-5e7ad11901d2" (UID: "5474bf8c-e191-4239-bdcd-5e7ad11901d2"). InnerVolumeSpecName "kube-api-access-r82zs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:12:42.707813 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.707789    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5474bf8c-e191-4239-bdcd-5e7ad11901d2" (UID: "5474bf8c-e191-4239-bdcd-5e7ad11901d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:12:42.707894 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.707841    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "5474bf8c-e191-4239-bdcd-5e7ad11901d2" (UID: "5474bf8c-e191-4239-bdcd-5e7ad11901d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:12:42.707937 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.707888    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5474bf8c-e191-4239-bdcd-5e7ad11901d2" (UID: "5474bf8c-e191-4239-bdcd-5e7ad11901d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:12:42.807014 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.806986    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:12:42.807014 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.807010    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:12:42.807014 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.807019    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:12:42.807268 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.807026    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:12:42.807268 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.807054    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5474bf8c-e191-4239-bdcd-5e7ad11901d2-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:12:42.807268 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.807062    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r82zs\" (UniqueName: \"kubernetes.io/projected/5474bf8c-e191-4239-bdcd-5e7ad11901d2-kube-api-access-r82zs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:12:42.838523 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.838494    2563 generic.go:356] "Generic (PLEG): container finished" podID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerID="d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d" exitCode=0
Jul 27 20:12:42.838641 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.838548    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn" event={"ID":"5474bf8c-e191-4239-bdcd-5e7ad11901d2","Type":"ContainerDied","Data":"d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d"}
Jul 27 20:12:42.838641 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.838555    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"
Jul 27 20:12:42.838641 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.838601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn" event={"ID":"5474bf8c-e191-4239-bdcd-5e7ad11901d2","Type":"ContainerDied","Data":"82cd65aca2094dc2b751a7ac5cdead34a15e089420015632ced9975f60cc40c4"}
Jul 27 20:12:42.838641 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.838624    2563 scope.go:117] "RemoveContainer" containerID="d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d"
Jul 27 20:12:42.848312 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.848294    2563 scope.go:117] "RemoveContainer" containerID="fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148"
Jul 27 20:12:42.856373 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.856358    2563 scope.go:117] "RemoveContainer" containerID="d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d"
Jul 27 20:12:42.856629 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:12:42.856612    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d\": container with ID starting with d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d not found: ID does not exist" containerID="d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d"
Jul 27 20:12:42.856680 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.856639    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d"} err="failed to get container status \"d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d\": rpc error: code = NotFound desc = could not find container \"d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d\": container with ID starting with d6886311e94a1b75ab05d28972f61620bd450166d53f65fab0e4bdfc2cbf624d not found: ID does not exist"
Jul 27 20:12:42.856680 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.856656    2563 scope.go:117] "RemoveContainer" containerID="fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148"
Jul 27 20:12:42.856897 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:12:42.856877    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148\": container with ID starting with fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148 not found: ID does not exist" containerID="fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148"
Jul 27 20:12:42.856957 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.856906    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148"} err="failed to get container status \"fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148\": rpc error: code = NotFound desc = could not find container \"fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148\": container with ID starting with fc8900dd5d65bc16201f50e2547e17e4eb12fe020f3437f0dcde75b51bcb6148 not found: ID does not exist"
Jul 27 20:12:42.863837 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.863814    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"]
Jul 27 20:12:42.868264 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:42.868244    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a56cb698-openshift-default-848c57597b-hr4rn"]
Jul 27 20:12:43.372092 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:12:43.372053    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" path="/var/lib/kubelet/pods/5474bf8c-e191-4239-bdcd-5e7ad11901d2/volumes"
Jul 27 20:14:24.580295 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.580256    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"]
Jul 27 20:14:24.580812 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.580786    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerName="istio-proxy"
Jul 27 20:14:24.580812 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.580805    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerName="istio-proxy"
Jul 27 20:14:24.580902 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.580816    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerName="istio-proxy"
Jul 27 20:14:24.580902 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.580824    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerName="istio-proxy"
Jul 27 20:14:24.580902 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.580849    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40104624-db2f-482d-874f-e8c1c78c0296" containerName="istio-proxy"
Jul 27 20:14:24.580902 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.580857    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="40104624-db2f-482d-874f-e8c1c78c0296" containerName="istio-proxy"
Jul 27 20:14:24.581079 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.580940    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerName="istio-proxy"
Jul 27 20:14:24.581079 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.580952    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="40104624-db2f-482d-874f-e8c1c78c0296" containerName="istio-proxy"
Jul 27 20:14:24.581079 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.580964    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="40104624-db2f-482d-874f-e8c1c78c0296" containerName="istio-proxy"
Jul 27 20:14:24.583472 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.583453    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.586609 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.586584    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0197ac0c-openshift-default-dockercfg-6lqnj\""
Jul 27 20:14:24.604028 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.604004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"]
Jul 27 20:14:24.640531 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.640504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-workload-socket\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.640531 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.640535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-workload-certs\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.640713 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.640564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istiod-ca-cert\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.640713 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.640633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-envoy\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.640713 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.640663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-data\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.640713 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.640698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-credential-socket\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.640846 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.640748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-podinfo\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.640846 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.640770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l76kz\" (UniqueName: \"kubernetes.io/projected/38b24402-3bd9-4d1a-8065-14e9a522c7a2-kube-api-access-l76kz\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.640846 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.640827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-token\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.741428 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.741373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-token\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.741428 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.741438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-workload-socket\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.741717 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.741456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-workload-certs\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.741717 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.741486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istiod-ca-cert\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.741717 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.741511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-envoy\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.741717 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.741532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-data\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.741717 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.741583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-credential-socket\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.741717 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.741621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-podinfo\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.741717 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.741652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76kz\" (UniqueName: \"kubernetes.io/projected/38b24402-3bd9-4d1a-8065-14e9a522c7a2-kube-api-access-l76kz\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.741993 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.741942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-workload-socket\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.742100 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.742000    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-workload-certs\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.742168 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.742095    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-data\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.742168 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.742119    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-credential-socket\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.742460 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.742438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istiod-ca-cert\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.744155 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.744137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-envoy\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.744440 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.744419    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-podinfo\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.753756 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.753729    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-token\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.754062 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.754029    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l76kz\" (UniqueName: \"kubernetes.io/projected/38b24402-3bd9-4d1a-8065-14e9a522c7a2-kube-api-access-l76kz\") pod \"e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") " pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:24.894867 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:24.894794    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:25.033523 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:25.033494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"]
Jul 27 20:14:25.035621 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:14:25.035595    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b24402_3bd9_4d1a_8065_14e9a522c7a2.slice/crio-b0acba8de06760492502fce0f4d2a61636838665d8e49b22c98aa45524c6a686 WatchSource:0}: Error finding container b0acba8de06760492502fce0f4d2a61636838665d8e49b22c98aa45524c6a686: Status 404 returned error can't find the container with id b0acba8de06760492502fce0f4d2a61636838665d8e49b22c98aa45524c6a686
Jul 27 20:14:25.037693 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:25.037661    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:14:25.037764 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:25.037733    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:14:25.037764 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:25.037760    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:14:25.341628 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:25.341598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx" event={"ID":"38b24402-3bd9-4d1a-8065-14e9a522c7a2","Type":"ContainerStarted","Data":"6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944"}
Jul 27 20:14:25.341779 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:25.341650    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx" event={"ID":"38b24402-3bd9-4d1a-8065-14e9a522c7a2","Type":"ContainerStarted","Data":"b0acba8de06760492502fce0f4d2a61636838665d8e49b22c98aa45524c6a686"}
Jul 27 20:14:25.366535 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:25.366462    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx" podStartSLOduration=1.3664429519999999 podStartE2EDuration="1.366442952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:14:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:14:25.365920499 +0000 UTC m=+3026.509124903" watchObservedRunningTime="2026-07-27 20:14:25.366442952 +0000 UTC m=+3026.509647329"
Jul 27 20:14:25.895549 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:25.895521    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:26.900256 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:26.900225    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:27.352648 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:27.352613    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:27.353606 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:27.353588    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:40.432152 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:40.432109    2563 generic.go:356] "Generic (PLEG): container finished" podID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerID="6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944" exitCode=0
Jul 27 20:14:40.432678 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:40.432163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx" event={"ID":"38b24402-3bd9-4d1a-8065-14e9a522c7a2","Type":"ContainerDied","Data":"6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944"}
Jul 27 20:14:40.432678 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:40.432630    2563 scope.go:117] "RemoveContainer" containerID="6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944"
Jul 27 20:14:40.433713 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:40.433679    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:14:40.433814 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:40.433752    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:14:40.433814 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:40.433787    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:14:41.439103 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:41.439061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx" event={"ID":"38b24402-3bd9-4d1a-8065-14e9a522c7a2","Type":"ContainerStarted","Data":"8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00"}
Jul 27 20:14:41.896801 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:41.896757    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:41.897017 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:41.896942    2563 patch_prober.go:28] interesting pod/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 27 20:14:41.897017 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:41.897003    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx" podUID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 27 20:14:42.352878 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:42.352848    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:42.895563 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:42.895514    2563 patch_prober.go:28] interesting pod/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 27 20:14:42.896118 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:42.895586    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx" podUID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 27 20:14:43.895642 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:43.895597    2563 patch_prober.go:28] interesting pod/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 27 20:14:43.896131 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:43.895679    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx" podUID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 27 20:14:44.895508 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:44.895473    2563 patch_prober.go:28] interesting pod/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 27 20:14:44.895806 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:44.895780    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx" podUID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 27 20:14:45.899834 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:45.899799    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:14:45.900807 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:14:45.900790    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:15:02.084024 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:02.083807    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"]
Jul 27 20:15:02.084894 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:02.084267    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx" podUID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerName="istio-proxy" containerID="cri-o://8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00" gracePeriod=30
Jul 27 20:15:07.339992 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.339970    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:15:07.538079 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.537955    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-token\") pod \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") "
Jul 27 20:15:07.538079 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538000    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-workload-socket\") pod \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") "
Jul 27 20:15:07.538079 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538020    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-envoy\") pod \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") "
Jul 27 20:15:07.538079 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538063    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istiod-ca-cert\") pod \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") "
Jul 27 20:15:07.538434 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538104    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-data\") pod \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") "
Jul 27 20:15:07.538434 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538127    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-credential-socket\") pod \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") "
Jul 27 20:15:07.538434 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538166    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l76kz\" (UniqueName: \"kubernetes.io/projected/38b24402-3bd9-4d1a-8065-14e9a522c7a2-kube-api-access-l76kz\") pod \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") "
Jul 27 20:15:07.538434 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538213    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-podinfo\") pod \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") "
Jul 27 20:15:07.538434 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538247    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-workload-certs\") pod \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\" (UID: \"38b24402-3bd9-4d1a-8065-14e9a522c7a2\") "
Jul 27 20:15:07.538434 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538301    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38b24402-3bd9-4d1a-8065-14e9a522c7a2" (UID: "38b24402-3bd9-4d1a-8065-14e9a522c7a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:15:07.538745 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538471    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:15:07.538745 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538494    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38b24402-3bd9-4d1a-8065-14e9a522c7a2" (UID: "38b24402-3bd9-4d1a-8065-14e9a522c7a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:15:07.538745 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538504    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38b24402-3bd9-4d1a-8065-14e9a522c7a2" (UID: "38b24402-3bd9-4d1a-8065-14e9a522c7a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:15:07.538745 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.538733    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38b24402-3bd9-4d1a-8065-14e9a522c7a2" (UID: "38b24402-3bd9-4d1a-8065-14e9a522c7a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:15:07.539331 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.539306    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-data" (OuterVolumeSpecName: "istio-data") pod "38b24402-3bd9-4d1a-8065-14e9a522c7a2" (UID: "38b24402-3bd9-4d1a-8065-14e9a522c7a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:15:07.540499 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.540472    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38b24402-3bd9-4d1a-8065-14e9a522c7a2-kube-api-access-l76kz" (OuterVolumeSpecName: "kube-api-access-l76kz") pod "38b24402-3bd9-4d1a-8065-14e9a522c7a2" (UID: "38b24402-3bd9-4d1a-8065-14e9a522c7a2"). InnerVolumeSpecName "kube-api-access-l76kz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:15:07.540499 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.540487    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "38b24402-3bd9-4d1a-8065-14e9a522c7a2" (UID: "38b24402-3bd9-4d1a-8065-14e9a522c7a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:15:07.540876 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.540861    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38b24402-3bd9-4d1a-8065-14e9a522c7a2" (UID: "38b24402-3bd9-4d1a-8065-14e9a522c7a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:15:07.540876 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.540856    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38b24402-3bd9-4d1a-8065-14e9a522c7a2" (UID: "38b24402-3bd9-4d1a-8065-14e9a522c7a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:15:07.564615 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.564589    2563 generic.go:356] "Generic (PLEG): container finished" podID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerID="8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00" exitCode=0
Jul 27 20:15:07.564736 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.564632    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx" event={"ID":"38b24402-3bd9-4d1a-8065-14e9a522c7a2","Type":"ContainerDied","Data":"8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00"}
Jul 27 20:15:07.564736 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.564654    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"
Jul 27 20:15:07.564736 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.564697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx" event={"ID":"38b24402-3bd9-4d1a-8065-14e9a522c7a2","Type":"ContainerDied","Data":"b0acba8de06760492502fce0f4d2a61636838665d8e49b22c98aa45524c6a686"}
Jul 27 20:15:07.564736 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.564719    2563 scope.go:117] "RemoveContainer" containerID="8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00"
Jul 27 20:15:07.573758 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.573740    2563 scope.go:117] "RemoveContainer" containerID="6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944"
Jul 27 20:15:07.581900 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.581884    2563 scope.go:117] "RemoveContainer" containerID="8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00"
Jul 27 20:15:07.582166 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:15:07.582147    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00\": container with ID starting with 8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00 not found: ID does not exist" containerID="8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00"
Jul 27 20:15:07.582246 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.582180    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00"} err="failed to get container status \"8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00\": rpc error: code = NotFound desc = could not find container \"8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00\": container with ID starting with 8fbf0dce1737e48010bbc43e0d2387122161880081f39f238db28b63ab25bf00 not found: ID does not exist"
Jul 27 20:15:07.582246 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.582206    2563 scope.go:117] "RemoveContainer" containerID="6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944"
Jul 27 20:15:07.582489 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:15:07.582472    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944\": container with ID starting with 6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944 not found: ID does not exist" containerID="6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944"
Jul 27 20:15:07.582537 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.582493    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944"} err="failed to get container status \"6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944\": rpc error: code = NotFound desc = could not find container \"6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944\": container with ID starting with 6ccd8e6d78ef904aaeec14b24b59af947bac718465aecae504c129abbb73a944 not found: ID does not exist"
Jul 27 20:15:07.588915 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.588893    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"]
Jul 27 20:15:07.595480 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.595460    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0197ac0c-openshift-default-684bbfb67b-hltkx"]
Jul 27 20:15:07.639284 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.639267    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:15:07.639399 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.639287    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:15:07.639399 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.639300    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:15:07.639399 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.639313    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:15:07.639399 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.639326    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l76kz\" (UniqueName: \"kubernetes.io/projected/38b24402-3bd9-4d1a-8065-14e9a522c7a2-kube-api-access-l76kz\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:15:07.639399 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.639339    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:15:07.639399 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.639352    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38b24402-3bd9-4d1a-8065-14e9a522c7a2-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:15:07.639399 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:07.639364    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38b24402-3bd9-4d1a-8065-14e9a522c7a2-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:15:09.372592 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:09.372560    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" path="/var/lib/kubelet/pods/38b24402-3bd9-4d1a-8065-14e9a522c7a2/volumes"
Jul 27 20:15:22.457603 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.457571    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"]
Jul 27 20:15:22.457978 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.457922    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerName="istio-proxy"
Jul 27 20:15:22.457978 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.457933    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerName="istio-proxy"
Jul 27 20:15:22.457978 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.457945    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40104624-db2f-482d-874f-e8c1c78c0296" containerName="istio-proxy"
Jul 27 20:15:22.457978 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.457951    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="40104624-db2f-482d-874f-e8c1c78c0296" containerName="istio-proxy"
Jul 27 20:15:22.457978 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.457959    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerName="istio-proxy"
Jul 27 20:15:22.457978 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.457965    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerName="istio-proxy"
Jul 27 20:15:22.458207 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.458032    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerName="istio-proxy"
Jul 27 20:15:22.458207 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.458056    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5474bf8c-e191-4239-bdcd-5e7ad11901d2" containerName="istio-proxy"
Jul 27 20:15:22.458207 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.458062    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b24402-3bd9-4d1a-8065-14e9a522c7a2" containerName="istio-proxy"
Jul 27 20:15:22.460176 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.460155    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.463650 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.463631    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1995ea52-openshift-default-dockercfg-89ngt\""
Jul 27 20:15:22.476586 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.476561    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"]
Jul 27 20:15:22.561785 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.561750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecfec36-7693-4228-a254-00d349d8e764-istio-podinfo\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.562103 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.561796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds5gg\" (UniqueName: \"kubernetes.io/projected/5ecfec36-7693-4228-a254-00d349d8e764-kube-api-access-ds5gg\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.562103 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.561825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-credential-socket\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.562103 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.561896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-workload-certs\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.562103 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.561943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-istio-envoy\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.562103 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.561973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecfec36-7693-4228-a254-00d349d8e764-istio-token\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.562103 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.562019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-workload-socket\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.562103 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.562073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecfec36-7693-4228-a254-00d349d8e764-istiod-ca-cert\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.562578 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.562124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-istio-data\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.663232 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecfec36-7693-4228-a254-00d349d8e764-istio-podinfo\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.663232 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds5gg\" (UniqueName: \"kubernetes.io/projected/5ecfec36-7693-4228-a254-00d349d8e764-kube-api-access-ds5gg\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.663442 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-credential-socket\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.663442 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-workload-certs\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.663442 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-istio-envoy\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.663442 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecfec36-7693-4228-a254-00d349d8e764-istio-token\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.663442 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-workload-socket\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.663442 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecfec36-7693-4228-a254-00d349d8e764-istiod-ca-cert\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.663761 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-istio-data\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.663894 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663868    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-credential-socket\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.663956 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-workload-socket\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.663956 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663926    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-istio-data\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.664269 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.663997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-workload-certs\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.664269 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.664219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecfec36-7693-4228-a254-00d349d8e764-istiod-ca-cert\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.665850 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.665825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-istio-envoy\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.665946 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.665906    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecfec36-7693-4228-a254-00d349d8e764-istio-podinfo\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.676776 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.676747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds5gg\" (UniqueName: \"kubernetes.io/projected/5ecfec36-7693-4228-a254-00d349d8e764-kube-api-access-ds5gg\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.679938 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.679912    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecfec36-7693-4228-a254-00d349d8e764-istio-token\") pod \"e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") " pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.770868 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.770789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:22.915021 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.914991    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"]
Jul 27 20:15:22.917627 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:15:22.917603    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ecfec36_7693_4228_a254_00d349d8e764.slice/crio-b960a3387be1ed61c23482259bc0151d61754c96c4bb0811a07bfdeb2039570d WatchSource:0}: Error finding container b960a3387be1ed61c23482259bc0151d61754c96c4bb0811a07bfdeb2039570d: Status 404 returned error can't find the container with id b960a3387be1ed61c23482259bc0151d61754c96c4bb0811a07bfdeb2039570d
Jul 27 20:15:22.919758 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.919725    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:15:22.919820 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.919795    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:15:22.919858 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:22.919824    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:15:23.642028 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:23.641992    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" event={"ID":"5ecfec36-7693-4228-a254-00d349d8e764","Type":"ContainerStarted","Data":"72d5a7f0081106ace65a8fe7a2c4c1dad0425ee03fbccec3f81a789c0ac74047"}
Jul 27 20:15:23.642486 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:23.642064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" event={"ID":"5ecfec36-7693-4228-a254-00d349d8e764","Type":"ContainerStarted","Data":"b960a3387be1ed61c23482259bc0151d61754c96c4bb0811a07bfdeb2039570d"}
Jul 27 20:15:23.667662 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:23.667607    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" podStartSLOduration=1.667591697 podStartE2EDuration="1.667591697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:15:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:15:23.666006655 +0000 UTC m=+3084.809211032" watchObservedRunningTime="2026-07-27 20:15:23.667591697 +0000 UTC m=+3084.810796073"
Jul 27 20:15:23.770941 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:23.770915    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:23.780916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:23.780887    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:24.646682 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:24.646648    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:24.647415 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:24.647394    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:40.166319 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:40.165827    2563 patch_prober.go:28] interesting pod/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": read tcp 10.133.0.2:57000->10.133.0.52:15021: read: connection reset by peer" start-of-body=
Jul 27 20:15:40.166319 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:40.165903    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" podUID="5ecfec36-7693-4228-a254-00d349d8e764" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": read tcp 10.133.0.2:57000->10.133.0.52:15021: read: connection reset by peer"
Jul 27 20:15:40.734473 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:40.734437    2563 generic.go:356] "Generic (PLEG): container finished" podID="5ecfec36-7693-4228-a254-00d349d8e764" containerID="72d5a7f0081106ace65a8fe7a2c4c1dad0425ee03fbccec3f81a789c0ac74047" exitCode=0
Jul 27 20:15:40.734642 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:40.734514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" event={"ID":"5ecfec36-7693-4228-a254-00d349d8e764","Type":"ContainerDied","Data":"72d5a7f0081106ace65a8fe7a2c4c1dad0425ee03fbccec3f81a789c0ac74047"}
Jul 27 20:15:40.734911 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:40.734890    2563 scope.go:117] "RemoveContainer" containerID="72d5a7f0081106ace65a8fe7a2c4c1dad0425ee03fbccec3f81a789c0ac74047"
Jul 27 20:15:40.735921 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:40.735888    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:15:40.735976 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:40.735957    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:15:40.736012 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:40.735993    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:15:41.740766 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:41.740732    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" event={"ID":"5ecfec36-7693-4228-a254-00d349d8e764","Type":"ContainerStarted","Data":"271b334a57d03dd9e08233a0e8346278aa50af8d3241f0ad42c67c2b4eb8fbb7"}
Jul 27 20:15:41.770992 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:41.770962    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:41.771184 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:41.771115    2563 patch_prober.go:28] interesting pod/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 27 20:15:41.771184 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:41.771154    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" podUID="5ecfec36-7693-4228-a254-00d349d8e764" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 27 20:15:42.771990 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:42.771955    2563 patch_prober.go:28] interesting pod/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 27 20:15:42.772404 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:42.772019    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" podUID="5ecfec36-7693-4228-a254-00d349d8e764" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 27 20:15:43.771128 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:43.771097    2563 patch_prober.go:28] interesting pod/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 27 20:15:43.771306 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:43.771146    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" podUID="5ecfec36-7693-4228-a254-00d349d8e764" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 27 20:15:44.771231 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:44.771200    2563 patch_prober.go:28] interesting pod/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 27 20:15:44.771636 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:44.771256    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" podUID="5ecfec36-7693-4228-a254-00d349d8e764" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 27 20:15:45.774743 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:45.774717    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:45.775145 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:45.774959    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:15:45.775674 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:15:45.775656    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:17:17.094438 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:17.094405    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"]
Jul 27 20:17:17.094953 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:17.094624    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" podUID="5ecfec36-7693-4228-a254-00d349d8e764" containerName="istio-proxy" containerID="cri-o://271b334a57d03dd9e08233a0e8346278aa50af8d3241f0ad42c67c2b4eb8fbb7" gracePeriod=30
Jul 27 20:17:22.239498 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.239458    2563 generic.go:356] "Generic (PLEG): container finished" podID="5ecfec36-7693-4228-a254-00d349d8e764" containerID="271b334a57d03dd9e08233a0e8346278aa50af8d3241f0ad42c67c2b4eb8fbb7" exitCode=0
Jul 27 20:17:22.239912 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.239531    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" event={"ID":"5ecfec36-7693-4228-a254-00d349d8e764","Type":"ContainerDied","Data":"271b334a57d03dd9e08233a0e8346278aa50af8d3241f0ad42c67c2b4eb8fbb7"}
Jul 27 20:17:22.239912 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.239609    2563 scope.go:117] "RemoveContainer" containerID="72d5a7f0081106ace65a8fe7a2c4c1dad0425ee03fbccec3f81a789c0ac74047"
Jul 27 20:17:22.361649 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.361586    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:17:22.488185 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488153    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-credential-socket\") pod \"5ecfec36-7693-4228-a254-00d349d8e764\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") "
Jul 27 20:17:22.488328 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488198    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-istio-data\") pod \"5ecfec36-7693-4228-a254-00d349d8e764\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") "
Jul 27 20:17:22.488328 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488259    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecfec36-7693-4228-a254-00d349d8e764-istio-podinfo\") pod \"5ecfec36-7693-4228-a254-00d349d8e764\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") "
Jul 27 20:17:22.488328 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488288    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-workload-socket\") pod \"5ecfec36-7693-4228-a254-00d349d8e764\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") "
Jul 27 20:17:22.488328 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488319    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds5gg\" (UniqueName: \"kubernetes.io/projected/5ecfec36-7693-4228-a254-00d349d8e764-kube-api-access-ds5gg\") pod \"5ecfec36-7693-4228-a254-00d349d8e764\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") "
Jul 27 20:17:22.488548 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488411    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecfec36-7693-4228-a254-00d349d8e764-istiod-ca-cert\") pod \"5ecfec36-7693-4228-a254-00d349d8e764\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") "
Jul 27 20:17:22.488548 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488448    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-workload-certs\") pod \"5ecfec36-7693-4228-a254-00d349d8e764\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") "
Jul 27 20:17:22.488548 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488453    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ecfec36-7693-4228-a254-00d349d8e764" (UID: "5ecfec36-7693-4228-a254-00d349d8e764"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:17:22.488548 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488475    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-istio-envoy\") pod \"5ecfec36-7693-4228-a254-00d349d8e764\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") "
Jul 27 20:17:22.488548 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488499    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecfec36-7693-4228-a254-00d349d8e764-istio-token\") pod \"5ecfec36-7693-4228-a254-00d349d8e764\" (UID: \"5ecfec36-7693-4228-a254-00d349d8e764\") "
Jul 27 20:17:22.488812 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488579    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ecfec36-7693-4228-a254-00d349d8e764" (UID: "5ecfec36-7693-4228-a254-00d349d8e764"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:17:22.488812 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488791    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:17:22.488812 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.488808    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:17:22.489234 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.489179    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ecfec36-7693-4228-a254-00d349d8e764" (UID: "5ecfec36-7693-4228-a254-00d349d8e764"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:17:22.489497 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.489201    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ecfec36-7693-4228-a254-00d349d8e764" (UID: "5ecfec36-7693-4228-a254-00d349d8e764"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:17:22.489497 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.489297    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ecfec36-7693-4228-a254-00d349d8e764-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ecfec36-7693-4228-a254-00d349d8e764" (UID: "5ecfec36-7693-4228-a254-00d349d8e764"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:17:22.490964 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.490922    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ecfec36-7693-4228-a254-00d349d8e764-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ecfec36-7693-4228-a254-00d349d8e764" (UID: "5ecfec36-7693-4228-a254-00d349d8e764"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:17:22.491131 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.491014    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ecfec36-7693-4228-a254-00d349d8e764-kube-api-access-ds5gg" (OuterVolumeSpecName: "kube-api-access-ds5gg") pod "5ecfec36-7693-4228-a254-00d349d8e764" (UID: "5ecfec36-7693-4228-a254-00d349d8e764"). InnerVolumeSpecName "kube-api-access-ds5gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:17:22.491225 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.491202    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ecfec36-7693-4228-a254-00d349d8e764-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ecfec36-7693-4228-a254-00d349d8e764" (UID: "5ecfec36-7693-4228-a254-00d349d8e764"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:17:22.491290 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.491265    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ecfec36-7693-4228-a254-00d349d8e764" (UID: "5ecfec36-7693-4228-a254-00d349d8e764"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:17:22.589727 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.589682    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:17:22.589727 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.589729    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecfec36-7693-4228-a254-00d349d8e764-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:17:22.589987 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.589744    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds5gg\" (UniqueName: \"kubernetes.io/projected/5ecfec36-7693-4228-a254-00d349d8e764-kube-api-access-ds5gg\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:17:22.589987 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.589759    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecfec36-7693-4228-a254-00d349d8e764-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:17:22.589987 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.589772    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:17:22.589987 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.589786    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecfec36-7693-4228-a254-00d349d8e764-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:17:22.589987 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:22.589799    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecfec36-7693-4228-a254-00d349d8e764-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:17:23.245202 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:23.245171    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"
Jul 27 20:17:23.245613 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:23.245208    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m" event={"ID":"5ecfec36-7693-4228-a254-00d349d8e764","Type":"ContainerDied","Data":"b960a3387be1ed61c23482259bc0151d61754c96c4bb0811a07bfdeb2039570d"}
Jul 27 20:17:23.245613 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:23.245260    2563 scope.go:117] "RemoveContainer" containerID="271b334a57d03dd9e08233a0e8346278aa50af8d3241f0ad42c67c2b4eb8fbb7"
Jul 27 20:17:23.284264 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:23.284213    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"]
Jul 27 20:17:23.286944 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:23.286922    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1995ea52-openshift-default-6dc4474f7b-2bn5m"]
Jul 27 20:17:23.372780 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:17:23.372751    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ecfec36-7693-4228-a254-00d349d8e764" path="/var/lib/kubelet/pods/5ecfec36-7693-4228-a254-00d349d8e764/volumes"
Jul 27 20:18:14.680879 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.680837    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"]
Jul 27 20:18:14.681505 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.681373    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ecfec36-7693-4228-a254-00d349d8e764" containerName="istio-proxy"
Jul 27 20:18:14.681505 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.681393    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ecfec36-7693-4228-a254-00d349d8e764" containerName="istio-proxy"
Jul 27 20:18:14.681505 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.681505    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ecfec36-7693-4228-a254-00d349d8e764" containerName="istio-proxy"
Jul 27 20:18:14.681641 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.681520    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ecfec36-7693-4228-a254-00d349d8e764" containerName="istio-proxy"
Jul 27 20:18:14.684939 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.684916    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.688086 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.688067    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-71745f-openshift-default-dockercfg-k9wm5\""
Jul 27 20:18:14.698267 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.698240    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"]
Jul 27 20:18:14.748892 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.748853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-istio-envoy\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.749085 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.748902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-workload-certs\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.749085 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.748930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-istio-data\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.749085 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.748993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660c5830-414e-4189-b38e-40fcfb907c08-istiod-ca-cert\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.749085 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.749073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k88w\" (UniqueName: \"kubernetes.io/projected/660c5830-414e-4189-b38e-40fcfb907c08-kube-api-access-2k88w\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.749238 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.749133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-workload-socket\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.749238 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.749156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660c5830-414e-4189-b38e-40fcfb907c08-istio-token\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.749238 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.749184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-credential-socket\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.749238 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.749203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660c5830-414e-4189-b38e-40fcfb907c08-istio-podinfo\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.850499 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.850463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k88w\" (UniqueName: \"kubernetes.io/projected/660c5830-414e-4189-b38e-40fcfb907c08-kube-api-access-2k88w\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.850499 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.850505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-workload-socket\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.850726 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.850528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660c5830-414e-4189-b38e-40fcfb907c08-istio-token\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.850726 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.850564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-credential-socket\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.850726 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.850592    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660c5830-414e-4189-b38e-40fcfb907c08-istio-podinfo\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.850726 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.850631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-istio-envoy\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.850726 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.850667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-workload-certs\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.850726 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.850704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-istio-data\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.851064 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.850743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660c5830-414e-4189-b38e-40fcfb907c08-istiod-ca-cert\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.851064 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.850941    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-credential-socket\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.851064 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.850973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-workload-socket\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.851200 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.851094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-workload-certs\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.851200 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.851181    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-istio-data\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.851470 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.851453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660c5830-414e-4189-b38e-40fcfb907c08-istiod-ca-cert\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.853175 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.853153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-istio-envoy\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.853324 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.853306    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660c5830-414e-4189-b38e-40fcfb907c08-istio-podinfo\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.860821 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.860798    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660c5830-414e-4189-b38e-40fcfb907c08-istio-token\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.861018 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.860995    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k88w\" (UniqueName: \"kubernetes.io/projected/660c5830-414e-4189-b38e-40fcfb907c08-kube-api-access-2k88w\") pod \"e2e-inf-a-71745f-openshift-default-78c484466-ts56l\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") " pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:14.995853 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:14.995771    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:15.138633 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:15.138609    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"]
Jul 27 20:18:15.140738 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:18:15.140712    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660c5830_414e_4189_b38e_40fcfb907c08.slice/crio-a76162e0c29e0dd922199936de8b0fdd1e41d39a17ffbe8918b95b5de4b8f727 WatchSource:0}: Error finding container a76162e0c29e0dd922199936de8b0fdd1e41d39a17ffbe8918b95b5de4b8f727: Status 404 returned error can't find the container with id a76162e0c29e0dd922199936de8b0fdd1e41d39a17ffbe8918b95b5de4b8f727
Jul 27 20:18:15.142937 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:15.142896    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:18:15.143023 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:15.142996    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:18:15.143098 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:15.143082    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:18:15.508746 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:15.508714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l" event={"ID":"660c5830-414e-4189-b38e-40fcfb907c08","Type":"ContainerStarted","Data":"250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c"}
Jul 27 20:18:15.508913 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:15.508767    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l" event={"ID":"660c5830-414e-4189-b38e-40fcfb907c08","Type":"ContainerStarted","Data":"a76162e0c29e0dd922199936de8b0fdd1e41d39a17ffbe8918b95b5de4b8f727"}
Jul 27 20:18:15.535404 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:15.535354    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l" podStartSLOduration=1.535342112 podStartE2EDuration="1.535342112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:15.534288671 +0000 UTC m=+3256.677493060" watchObservedRunningTime="2026-07-27 20:18:15.535342112 +0000 UTC m=+3256.678546487"
Jul 27 20:18:15.996434 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:15.996406    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:17.000933 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:17.000903    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:17.518509 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:17.518475    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:17.519415 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:17.519395    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:22.644700 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.644661    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"]
Jul 27 20:18:22.645283 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.645025    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ecfec36-7693-4228-a254-00d349d8e764" containerName="istio-proxy"
Jul 27 20:18:22.645283 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.645053    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ecfec36-7693-4228-a254-00d349d8e764" containerName="istio-proxy"
Jul 27 20:18:22.648316 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.648296    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.651490 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.651473    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-49ddd1-openshift-default-dockercfg-6nqtr\""
Jul 27 20:18:22.664394 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.664373    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"]
Jul 27 20:18:22.722872 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.722841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfrtc\" (UniqueName: \"kubernetes.io/projected/b9512a85-a960-4701-ad06-09cd2962204e-kube-api-access-cfrtc\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.723021 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.722893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9512a85-a960-4701-ad06-09cd2962204e-istiod-ca-cert\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.723021 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.722922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-workload-socket\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.723021 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.722963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-istio-envoy\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.723021 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.723017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-workload-certs\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.723277 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.723057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-istio-data\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.723277 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.723104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9512a85-a960-4701-ad06-09cd2962204e-istio-token\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.723277 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.723152    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-credential-socket\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.723277 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.723184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9512a85-a960-4701-ad06-09cd2962204e-istio-podinfo\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.823961 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.823927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-workload-socket\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.823961 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.823964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-istio-envoy\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.824198 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.824012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-workload-certs\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.824198 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.824063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-istio-data\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.824198 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.824093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9512a85-a960-4701-ad06-09cd2962204e-istio-token\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.824198 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.824128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-credential-socket\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.824198 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.824150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9512a85-a960-4701-ad06-09cd2962204e-istio-podinfo\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.824395 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.824208    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfrtc\" (UniqueName: \"kubernetes.io/projected/b9512a85-a960-4701-ad06-09cd2962204e-kube-api-access-cfrtc\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.824395 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.824281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9512a85-a960-4701-ad06-09cd2962204e-istiod-ca-cert\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.824465 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.824402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-workload-socket\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.824814 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.824786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-workload-certs\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.824948 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.824861    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-istio-data\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.824948 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.824885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9512a85-a960-4701-ad06-09cd2962204e-istiod-ca-cert\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.825242 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.825219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-credential-socket\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.826808 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.826790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-istio-envoy\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.826870 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.826797    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9512a85-a960-4701-ad06-09cd2962204e-istio-podinfo\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.834399 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.834378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9512a85-a960-4701-ad06-09cd2962204e-istio-token\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.834503 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.834428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfrtc\" (UniqueName: \"kubernetes.io/projected/b9512a85-a960-4701-ad06-09cd2962204e-kube-api-access-cfrtc\") pod \"e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") " pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:22.959002 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:22.958919    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:23.104346 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:23.104311    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"]
Jul 27 20:18:23.108126 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:18:23.108104    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9512a85_a960_4701_ad06_09cd2962204e.slice/crio-071d03f79ba6b4b549391e61221b9914fdbfc38ce7f651642c9bcb927ce8f75b WatchSource:0}: Error finding container 071d03f79ba6b4b549391e61221b9914fdbfc38ce7f651642c9bcb927ce8f75b: Status 404 returned error can't find the container with id 071d03f79ba6b4b549391e61221b9914fdbfc38ce7f651642c9bcb927ce8f75b
Jul 27 20:18:23.110684 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:23.110648    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:18:23.110787 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:23.110728    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:18:23.110787 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:23.110771    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:18:23.548228 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:23.548195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt" event={"ID":"b9512a85-a960-4701-ad06-09cd2962204e","Type":"ContainerStarted","Data":"46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2"}
Jul 27 20:18:23.548228 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:23.548246    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt" event={"ID":"b9512a85-a960-4701-ad06-09cd2962204e","Type":"ContainerStarted","Data":"071d03f79ba6b4b549391e61221b9914fdbfc38ce7f651642c9bcb927ce8f75b"}
Jul 27 20:18:23.571177 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:23.571133    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt" podStartSLOduration=1.571118421 podStartE2EDuration="1.571118421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:23.569515657 +0000 UTC m=+3264.712720033" watchObservedRunningTime="2026-07-27 20:18:23.571118421 +0000 UTC m=+3264.714322796"
Jul 27 20:18:23.959136 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:23.959104    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:24.964232 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:24.964202    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:25.560459 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:25.560430    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:25.561585 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:25.561560    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:31.599819 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:31.598525    2563 generic.go:356] "Generic (PLEG): container finished" podID="660c5830-414e-4189-b38e-40fcfb907c08" containerID="250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c" exitCode=0
Jul 27 20:18:31.599819 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:31.598645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l" event={"ID":"660c5830-414e-4189-b38e-40fcfb907c08","Type":"ContainerDied","Data":"250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c"}
Jul 27 20:18:31.599819 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:31.599186    2563 scope.go:117] "RemoveContainer" containerID="250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c"
Jul 27 20:18:31.607329 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:31.601909    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:18:31.607329 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:31.602003    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:18:31.607329 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:31.602071    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:18:32.518768 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:32.518718    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:32.609075 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:32.609014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l" event={"ID":"660c5830-414e-4189-b38e-40fcfb907c08","Type":"ContainerStarted","Data":"7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad"}
Jul 27 20:18:32.998223 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:32.998188    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:32.998617 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:32.998597    2563 patch_prober.go:28] interesting pod/e2e-inf-a-71745f-openshift-default-78c484466-ts56l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 27 20:18:32.998770 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:32.998747    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l" podUID="660c5830-414e-4189-b38e-40fcfb907c08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 27 20:18:33.380935 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.380899    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"]
Jul 27 20:18:33.384762 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.384733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.389404 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.389370    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-71745f\"/\"test-model-71745f-kserve-self-signed-certs\""
Jul 27 20:18:33.389592 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.389554    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-71745f\"/\"openshift-service-ca.crt\""
Jul 27 20:18:33.389904 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.389881    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-71745f\"/\"kube-root-ca.crt\""
Jul 27 20:18:33.393108 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.393081    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"]
Jul 27 20:18:33.393217 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.393160    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-71745f\"/\"default-dockercfg-v2h49\""
Jul 27 20:18:33.532742 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.532664    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204c2072-e7f8-4825-8927-8c788ad3cd6d-tls-certs\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.532977 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.532762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-dshm\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.532977 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.532942    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-model-cache\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.533152 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.533028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-tmp-dir\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.533152 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.533117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzmrq\" (UniqueName: \"kubernetes.io/projected/204c2072-e7f8-4825-8927-8c788ad3cd6d-kube-api-access-qzmrq\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.533508 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.533477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-home\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.635611 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.635507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-home\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.636631 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.636611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204c2072-e7f8-4825-8927-8c788ad3cd6d-tls-certs\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.637163 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.637134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-dshm\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.637269 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.637245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-model-cache\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.637332 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.637315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-tmp-dir\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.637388 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.637362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzmrq\" (UniqueName: \"kubernetes.io/projected/204c2072-e7f8-4825-8927-8c788ad3cd6d-kube-api-access-qzmrq\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.637741 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.636528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-home\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.637960 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.637935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-model-cache\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.638235 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.638189    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-tmp-dir\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.641461 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.641430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-dshm\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.641812 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.641789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204c2072-e7f8-4825-8927-8c788ad3cd6d-tls-certs\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.649508 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.649485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzmrq\" (UniqueName: \"kubernetes.io/projected/204c2072-e7f8-4825-8927-8c788ad3cd6d-kube-api-access-qzmrq\") pod \"test-model-71745f-kserve-665448dbd9-64gw9\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") " pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.703100 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.702249    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:33.952015 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.951982    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"]
Jul 27 20:18:33.955155 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:18:33.954898    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod204c2072_e7f8_4825_8927_8c788ad3cd6d.slice/crio-e27c19e78960abe4c6a028319304fcb5b8030953fd0f14e701c4c1e52f5ffaba WatchSource:0}: Error finding container e27c19e78960abe4c6a028319304fcb5b8030953fd0f14e701c4c1e52f5ffaba: Status 404 returned error can't find the container with id e27c19e78960abe4c6a028319304fcb5b8030953fd0f14e701c4c1e52f5ffaba
Jul 27 20:18:33.998922 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.998452    2563 patch_prober.go:28] interesting pod/e2e-inf-a-71745f-openshift-default-78c484466-ts56l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 27 20:18:33.998922 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:33.998513    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l" podUID="660c5830-414e-4189-b38e-40fcfb907c08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 27 20:18:34.629422 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:34.629372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9" event={"ID":"204c2072-e7f8-4825-8927-8c788ad3cd6d","Type":"ContainerStarted","Data":"906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d"}
Jul 27 20:18:34.629630 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:34.629434    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9" event={"ID":"204c2072-e7f8-4825-8927-8c788ad3cd6d","Type":"ContainerStarted","Data":"e27c19e78960abe4c6a028319304fcb5b8030953fd0f14e701c4c1e52f5ffaba"}
Jul 27 20:18:34.650621 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:34.650573    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9" podStartSLOduration=1.650556335 podStartE2EDuration="1.650556335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:34.649167946 +0000 UTC m=+3275.792372335" watchObservedRunningTime="2026-07-27 20:18:34.650556335 +0000 UTC m=+3275.793760712"
Jul 27 20:18:34.996963 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:34.996915    2563 patch_prober.go:28] interesting pod/e2e-inf-a-71745f-openshift-default-78c484466-ts56l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 27 20:18:34.997195 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:34.996984    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l" podUID="660c5830-414e-4189-b38e-40fcfb907c08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 27 20:18:35.996872 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:35.996433    2563 patch_prober.go:28] interesting pod/e2e-inf-a-71745f-openshift-default-78c484466-ts56l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 27 20:18:35.996872 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:35.996501    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l" podUID="660c5830-414e-4189-b38e-40fcfb907c08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 27 20:18:37.000212 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:37.000180    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:37.000678 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:37.000496    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:37.001217 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:37.001197    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:18:38.653117 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:38.653082    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9512a85-a960-4701-ad06-09cd2962204e" containerID="46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2" exitCode=0
Jul 27 20:18:38.653559 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:38.653154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt" event={"ID":"b9512a85-a960-4701-ad06-09cd2962204e","Type":"ContainerDied","Data":"46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2"}
Jul 27 20:18:38.653684 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:38.653667    2563 scope.go:117] "RemoveContainer" containerID="46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2"
Jul 27 20:18:38.654742 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:38.654713    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:18:38.654801 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:38.654787    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:18:38.654837 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:38.654820    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:18:39.660251 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:39.660215    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt" event={"ID":"b9512a85-a960-4701-ad06-09cd2962204e","Type":"ContainerStarted","Data":"8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3"}
Jul 27 20:18:39.959664 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:39.959587    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:39.960721 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:39.960694    2563 patch_prober.go:28] interesting pod/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 27 20:18:39.960849 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:39.960741    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt" podUID="b9512a85-a960-4701-ad06-09cd2962204e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 27 20:18:40.560925 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:40.560891    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:40.960089 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:40.959968    2563 patch_prober.go:28] interesting pod/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 27 20:18:40.960089 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:40.960026    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt" podUID="b9512a85-a960-4701-ad06-09cd2962204e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 27 20:18:41.960146 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:41.960110    2563 patch_prober.go:28] interesting pod/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 27 20:18:41.960530 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:41.960176    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt" podUID="b9512a85-a960-4701-ad06-09cd2962204e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 27 20:18:42.959982 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:42.959941    2563 patch_prober.go:28] interesting pod/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 27 20:18:42.960182 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:42.960018    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt" podUID="b9512a85-a960-4701-ad06-09cd2962204e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 27 20:18:43.703242 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:43.703207    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:43.703423 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:43.703253    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:43.715766 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:43.715740    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:18:43.963117 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:43.963023    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:43.963978 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:43.963960    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:18:44.694985 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:18:44.694959    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:19:49.440331 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:49.440296    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"]
Jul 27 20:19:50.630949 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:50.630914    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q"]
Jul 27 20:19:50.633634 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:50.633617    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q"
Jul 27 20:19:50.640565 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:50.640543    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pljl4\""
Jul 27 20:19:50.641852 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:50.641830    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 20:19:50.645395 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:50.645372    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q"]
Jul 27 20:19:50.728051 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:50.728015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00f51718-7952-4b72-a9bc-dfdb23c4643c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q\" (UID: \"00f51718-7952-4b72-a9bc-dfdb23c4643c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q"
Jul 27 20:19:50.828885 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:50.828851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00f51718-7952-4b72-a9bc-dfdb23c4643c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q\" (UID: \"00f51718-7952-4b72-a9bc-dfdb23c4643c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q"
Jul 27 20:19:50.829585 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:50.829562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00f51718-7952-4b72-a9bc-dfdb23c4643c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q\" (UID: \"00f51718-7952-4b72-a9bc-dfdb23c4643c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q"
Jul 27 20:19:50.944244 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:50.944175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q"
Jul 27 20:19:51.087766 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:51.087743    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q"]
Jul 27 20:19:51.090805 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:19:51.090777    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f51718_7952_4b72_a9bc_dfdb23c4643c.slice/crio-bb6761d011e06ed03b177454dd82938719a5f1d37694682338553207aaed190e WatchSource:0}: Error finding container bb6761d011e06ed03b177454dd82938719a5f1d37694682338553207aaed190e: Status 404 returned error can't find the container with id bb6761d011e06ed03b177454dd82938719a5f1d37694682338553207aaed190e
Jul 27 20:19:52.013663 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:52.013629    2563 generic.go:356] "Generic (PLEG): container finished" podID="00f51718-7952-4b72-a9bc-dfdb23c4643c" containerID="e61ede64e8e8045b882543ffa4c5b4c47198b24a711723313de6f2833ca6de17" exitCode=0
Jul 27 20:19:52.014018 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:52.013684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q" event={"ID":"00f51718-7952-4b72-a9bc-dfdb23c4643c","Type":"ContainerDied","Data":"e61ede64e8e8045b882543ffa4c5b4c47198b24a711723313de6f2833ca6de17"}
Jul 27 20:19:52.014018 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:52.013733    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q" event={"ID":"00f51718-7952-4b72-a9bc-dfdb23c4643c","Type":"ContainerStarted","Data":"bb6761d011e06ed03b177454dd82938719a5f1d37694682338553207aaed190e"}
Jul 27 20:19:53.154328 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:53.154304    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q"
Jul 27 20:19:53.250840 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:53.250803    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00f51718-7952-4b72-a9bc-dfdb23c4643c-maas-api-service-ca\") pod \"00f51718-7952-4b72-a9bc-dfdb23c4643c\" (UID: \"00f51718-7952-4b72-a9bc-dfdb23c4643c\") "
Jul 27 20:19:53.251202 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:53.251179    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00f51718-7952-4b72-a9bc-dfdb23c4643c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "00f51718-7952-4b72-a9bc-dfdb23c4643c" (UID: "00f51718-7952-4b72-a9bc-dfdb23c4643c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:19:53.351864 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:53.351837    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00f51718-7952-4b72-a9bc-dfdb23c4643c-maas-api-service-ca\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:19:54.025055 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:54.025006    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q" event={"ID":"00f51718-7952-4b72-a9bc-dfdb23c4643c","Type":"ContainerDied","Data":"bb6761d011e06ed03b177454dd82938719a5f1d37694682338553207aaed190e"}
Jul 27 20:19:54.025238 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:54.025060    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q"
Jul 27 20:19:54.025238 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:19:54.025095    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb6761d011e06ed03b177454dd82938719a5f1d37694682338553207aaed190e"
Jul 27 20:20:04.459389 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.459324    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9" podUID="204c2072-e7f8-4825-8927-8c788ad3cd6d" containerName="main" containerID="cri-o://906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d" gracePeriod=45
Jul 27 20:20:04.719568 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.719504    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:20:04.850292 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.850261    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-tmp-dir\") pod \"204c2072-e7f8-4825-8927-8c788ad3cd6d\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") "
Jul 27 20:20:04.850490 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.850302    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-dshm\") pod \"204c2072-e7f8-4825-8927-8c788ad3cd6d\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") "
Jul 27 20:20:04.850490 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.850334    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-model-cache\") pod \"204c2072-e7f8-4825-8927-8c788ad3cd6d\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") "
Jul 27 20:20:04.850490 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.850393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204c2072-e7f8-4825-8927-8c788ad3cd6d-tls-certs\") pod \"204c2072-e7f8-4825-8927-8c788ad3cd6d\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") "
Jul 27 20:20:04.850490 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.850429    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-home\") pod \"204c2072-e7f8-4825-8927-8c788ad3cd6d\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") "
Jul 27 20:20:04.850490 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.850479    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzmrq\" (UniqueName: \"kubernetes.io/projected/204c2072-e7f8-4825-8927-8c788ad3cd6d-kube-api-access-qzmrq\") pod \"204c2072-e7f8-4825-8927-8c788ad3cd6d\" (UID: \"204c2072-e7f8-4825-8927-8c788ad3cd6d\") "
Jul 27 20:20:04.850737 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.850577    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "204c2072-e7f8-4825-8927-8c788ad3cd6d" (UID: "204c2072-e7f8-4825-8927-8c788ad3cd6d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:04.850737 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.850657    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-model-cache" (OuterVolumeSpecName: "model-cache") pod "204c2072-e7f8-4825-8927-8c788ad3cd6d" (UID: "204c2072-e7f8-4825-8927-8c788ad3cd6d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:04.850737 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.850697    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-home" (OuterVolumeSpecName: "home") pod "204c2072-e7f8-4825-8927-8c788ad3cd6d" (UID: "204c2072-e7f8-4825-8927-8c788ad3cd6d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:04.850845 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.850808    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-home\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:04.850845 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.850829    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-tmp-dir\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:04.850906 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.850842    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-model-cache\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:04.852650 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.852624    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/204c2072-e7f8-4825-8927-8c788ad3cd6d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "204c2072-e7f8-4825-8927-8c788ad3cd6d" (UID: "204c2072-e7f8-4825-8927-8c788ad3cd6d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:20:04.852650 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.852628    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-dshm" (OuterVolumeSpecName: "dshm") pod "204c2072-e7f8-4825-8927-8c788ad3cd6d" (UID: "204c2072-e7f8-4825-8927-8c788ad3cd6d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:04.852801 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.852673    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/204c2072-e7f8-4825-8927-8c788ad3cd6d-kube-api-access-qzmrq" (OuterVolumeSpecName: "kube-api-access-qzmrq") pod "204c2072-e7f8-4825-8927-8c788ad3cd6d" (UID: "204c2072-e7f8-4825-8927-8c788ad3cd6d"). InnerVolumeSpecName "kube-api-access-qzmrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:20:04.951367 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.951344    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204c2072-e7f8-4825-8927-8c788ad3cd6d-dshm\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:04.951367 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.951366    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204c2072-e7f8-4825-8927-8c788ad3cd6d-tls-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:04.951541 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:04.951376    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzmrq\" (UniqueName: \"kubernetes.io/projected/204c2072-e7f8-4825-8927-8c788ad3cd6d-kube-api-access-qzmrq\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:05.079732 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:05.079701    2563 generic.go:356] "Generic (PLEG): container finished" podID="204c2072-e7f8-4825-8927-8c788ad3cd6d" containerID="906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d" exitCode=0
Jul 27 20:20:05.079928 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:05.079751    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"
Jul 27 20:20:05.079928 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:05.079792    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9" event={"ID":"204c2072-e7f8-4825-8927-8c788ad3cd6d","Type":"ContainerDied","Data":"906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d"}
Jul 27 20:20:05.079928 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:05.079839    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9" event={"ID":"204c2072-e7f8-4825-8927-8c788ad3cd6d","Type":"ContainerDied","Data":"e27c19e78960abe4c6a028319304fcb5b8030953fd0f14e701c4c1e52f5ffaba"}
Jul 27 20:20:05.079928 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:05.079864    2563 scope.go:117] "RemoveContainer" containerID="906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d"
Jul 27 20:20:05.090428 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:05.090413    2563 scope.go:117] "RemoveContainer" containerID="906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d"
Jul 27 20:20:05.090687 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:20:05.090662    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d\": container with ID starting with 906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d not found: ID does not exist" containerID="906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d"
Jul 27 20:20:05.090735 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:05.090698    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d"} err="failed to get container status \"906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d\": rpc error: code = NotFound desc = could not find container \"906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d\": container with ID starting with 906cfe6332f3e387977bdc800d1389a819b0a349d43a5e76577d6928423d362d not found: ID does not exist"
Jul 27 20:20:05.106159 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:05.106132    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"]
Jul 27 20:20:05.111622 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:05.111597    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9"]
Jul 27 20:20:05.378133 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:05.378028    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="204c2072-e7f8-4825-8927-8c788ad3cd6d" path="/var/lib/kubelet/pods/204c2072-e7f8-4825-8927-8c788ad3cd6d/volumes"
Jul 27 20:20:05.647347 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:05.647266    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q"]
Jul 27 20:20:05.650151 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:05.650120    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-71745f-9jl4q"]
Jul 27 20:20:07.372009 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:07.371969    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00f51718-7952-4b72-a9bc-dfdb23c4643c" path="/var/lib/kubelet/pods/00f51718-7952-4b72-a9bc-dfdb23c4643c/volumes"
Jul 27 20:20:09.685444 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:09.685404    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-a-71745f/test-model-71745f-kserve-665448dbd9-64gw9" podUID="204c2072-e7f8-4825-8927-8c788ad3cd6d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:20:12.563201 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:12.563160    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"]
Jul 27 20:20:12.563690 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:12.563388    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l" podUID="660c5830-414e-4189-b38e-40fcfb907c08" containerName="istio-proxy" containerID="cri-o://7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad" gracePeriod=30
Jul 27 20:20:17.826969 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.826913    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:20:17.867209 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867178    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-workload-certs\") pod \"660c5830-414e-4189-b38e-40fcfb907c08\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") "
Jul 27 20:20:17.867346 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867223    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-workload-socket\") pod \"660c5830-414e-4189-b38e-40fcfb907c08\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") "
Jul 27 20:20:17.867346 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867260    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-istio-data\") pod \"660c5830-414e-4189-b38e-40fcfb907c08\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") "
Jul 27 20:20:17.867346 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867295    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-credential-socket\") pod \"660c5830-414e-4189-b38e-40fcfb907c08\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") "
Jul 27 20:20:17.867346 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867335    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660c5830-414e-4189-b38e-40fcfb907c08-istiod-ca-cert\") pod \"660c5830-414e-4189-b38e-40fcfb907c08\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") "
Jul 27 20:20:17.867574 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867368    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k88w\" (UniqueName: \"kubernetes.io/projected/660c5830-414e-4189-b38e-40fcfb907c08-kube-api-access-2k88w\") pod \"660c5830-414e-4189-b38e-40fcfb907c08\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") "
Jul 27 20:20:17.867574 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867425    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "660c5830-414e-4189-b38e-40fcfb907c08" (UID: "660c5830-414e-4189-b38e-40fcfb907c08"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:17.867574 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867472    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660c5830-414e-4189-b38e-40fcfb907c08-istio-token\") pod \"660c5830-414e-4189-b38e-40fcfb907c08\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") "
Jul 27 20:20:17.867574 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867481    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "660c5830-414e-4189-b38e-40fcfb907c08" (UID: "660c5830-414e-4189-b38e-40fcfb907c08"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:17.867574 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867498    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660c5830-414e-4189-b38e-40fcfb907c08-istio-podinfo\") pod \"660c5830-414e-4189-b38e-40fcfb907c08\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") "
Jul 27 20:20:17.867574 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867529    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-istio-envoy\") pod \"660c5830-414e-4189-b38e-40fcfb907c08\" (UID: \"660c5830-414e-4189-b38e-40fcfb907c08\") "
Jul 27 20:20:17.867874 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867586    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "660c5830-414e-4189-b38e-40fcfb907c08" (UID: "660c5830-414e-4189-b38e-40fcfb907c08"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:17.867874 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867753    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/660c5830-414e-4189-b38e-40fcfb907c08-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "660c5830-414e-4189-b38e-40fcfb907c08" (UID: "660c5830-414e-4189-b38e-40fcfb907c08"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:20:17.867874 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867808    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:17.867874 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867835    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:17.867874 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.867852    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:17.868319 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.868284    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-istio-data" (OuterVolumeSpecName: "istio-data") pod "660c5830-414e-4189-b38e-40fcfb907c08" (UID: "660c5830-414e-4189-b38e-40fcfb907c08"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:17.870110 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.870011    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/660c5830-414e-4189-b38e-40fcfb907c08-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "660c5830-414e-4189-b38e-40fcfb907c08" (UID: "660c5830-414e-4189-b38e-40fcfb907c08"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:20:17.870283 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.870257    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/660c5830-414e-4189-b38e-40fcfb907c08-istio-token" (OuterVolumeSpecName: "istio-token") pod "660c5830-414e-4189-b38e-40fcfb907c08" (UID: "660c5830-414e-4189-b38e-40fcfb907c08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:20:17.870283 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.870268    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "660c5830-414e-4189-b38e-40fcfb907c08" (UID: "660c5830-414e-4189-b38e-40fcfb907c08"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:17.870447 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.870280    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/660c5830-414e-4189-b38e-40fcfb907c08-kube-api-access-2k88w" (OuterVolumeSpecName: "kube-api-access-2k88w") pod "660c5830-414e-4189-b38e-40fcfb907c08" (UID: "660c5830-414e-4189-b38e-40fcfb907c08"). InnerVolumeSpecName "kube-api-access-2k88w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:20:17.968849 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.968819    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660c5830-414e-4189-b38e-40fcfb907c08-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:17.968849 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.968845    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k88w\" (UniqueName: \"kubernetes.io/projected/660c5830-414e-4189-b38e-40fcfb907c08-kube-api-access-2k88w\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:17.968849 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.968855    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660c5830-414e-4189-b38e-40fcfb907c08-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:17.969073 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.968864    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660c5830-414e-4189-b38e-40fcfb907c08-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:17.969073 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.968872    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:17.969073 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:17.968879    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660c5830-414e-4189-b38e-40fcfb907c08-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:18.147378 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:18.147290    2563 generic.go:356] "Generic (PLEG): container finished" podID="660c5830-414e-4189-b38e-40fcfb907c08" containerID="7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad" exitCode=0
Jul 27 20:20:18.147378 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:18.147348    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"
Jul 27 20:20:18.147555 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:18.147385    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l" event={"ID":"660c5830-414e-4189-b38e-40fcfb907c08","Type":"ContainerDied","Data":"7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad"}
Jul 27 20:20:18.147555 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:18.147469    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l" event={"ID":"660c5830-414e-4189-b38e-40fcfb907c08","Type":"ContainerDied","Data":"a76162e0c29e0dd922199936de8b0fdd1e41d39a17ffbe8918b95b5de4b8f727"}
Jul 27 20:20:18.147555 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:18.147494    2563 scope.go:117] "RemoveContainer" containerID="7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad"
Jul 27 20:20:18.156966 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:18.156946    2563 scope.go:117] "RemoveContainer" containerID="250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c"
Jul 27 20:20:18.165530 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:18.165513    2563 scope.go:117] "RemoveContainer" containerID="7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad"
Jul 27 20:20:18.165757 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:20:18.165740    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad\": container with ID starting with 7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad not found: ID does not exist" containerID="7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad"
Jul 27 20:20:18.165807 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:18.165765    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad"} err="failed to get container status \"7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad\": rpc error: code = NotFound desc = could not find container \"7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad\": container with ID starting with 7f9237c518c1ab343e10e84895e2b572201078af282a8ad326f05fdf89f057ad not found: ID does not exist"
Jul 27 20:20:18.165807 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:18.165781    2563 scope.go:117] "RemoveContainer" containerID="250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c"
Jul 27 20:20:18.166065 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:20:18.166027    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c\": container with ID starting with 250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c not found: ID does not exist" containerID="250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c"
Jul 27 20:20:18.166120 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:18.166071    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c"} err="failed to get container status \"250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c\": rpc error: code = NotFound desc = could not find container \"250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c\": container with ID starting with 250d524708fa46f79b06d5a65e42daf9fdfcf5a78b23d7ebe35ca9eb8152090c not found: ID does not exist"
Jul 27 20:20:18.171653 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:18.171631    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"]
Jul 27 20:20:18.178472 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:18.178448    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-71745f-openshift-default-78c484466-ts56l"]
Jul 27 20:20:19.372700 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:19.372670    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="660c5830-414e-4189-b38e-40fcfb907c08" path="/var/lib/kubelet/pods/660c5830-414e-4189-b38e-40fcfb907c08/volumes"
Jul 27 20:20:35.305914 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:35.305878    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"]
Jul 27 20:20:35.306415 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:35.306174    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt" podUID="b9512a85-a960-4701-ad06-09cd2962204e" containerName="istio-proxy" containerID="cri-o://8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3" gracePeriod=30
Jul 27 20:20:36.151182 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151149    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"]
Jul 27 20:20:36.151628 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151606    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660c5830-414e-4189-b38e-40fcfb907c08" containerName="istio-proxy"
Jul 27 20:20:36.151628 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151629    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="660c5830-414e-4189-b38e-40fcfb907c08" containerName="istio-proxy"
Jul 27 20:20:36.151805 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151642    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660c5830-414e-4189-b38e-40fcfb907c08" containerName="istio-proxy"
Jul 27 20:20:36.151805 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151650    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="660c5830-414e-4189-b38e-40fcfb907c08" containerName="istio-proxy"
Jul 27 20:20:36.151805 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151668    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204c2072-e7f8-4825-8927-8c788ad3cd6d" containerName="main"
Jul 27 20:20:36.151805 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151676    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="204c2072-e7f8-4825-8927-8c788ad3cd6d" containerName="main"
Jul 27 20:20:36.151805 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151685    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00f51718-7952-4b72-a9bc-dfdb23c4643c" containerName="revoke-keys"
Jul 27 20:20:36.151805 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151693    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="00f51718-7952-4b72-a9bc-dfdb23c4643c" containerName="revoke-keys"
Jul 27 20:20:36.152131 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151809    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="00f51718-7952-4b72-a9bc-dfdb23c4643c" containerName="revoke-keys"
Jul 27 20:20:36.152131 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151820    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="660c5830-414e-4189-b38e-40fcfb907c08" containerName="istio-proxy"
Jul 27 20:20:36.152131 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151830    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="204c2072-e7f8-4825-8927-8c788ad3cd6d" containerName="main"
Jul 27 20:20:36.152131 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.151840    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="660c5830-414e-4189-b38e-40fcfb907c08" containerName="istio-proxy"
Jul 27 20:20:36.155464 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.155442    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.159349 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.159326    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c63843-openshift-default-dockercfg-fhbtq\""
Jul 27 20:20:36.169578 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.169552    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"]
Jul 27 20:20:36.224000 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.223976    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-token\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.224158 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.224005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-podinfo\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.224158 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.224031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f3bc829-eb2c-48b5-af6d-438d809ab769-istiod-ca-cert\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.224158 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.224100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-credential-socket\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.224158 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.224119    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-data\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.224308 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.224169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-workload-certs\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.224308 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.224229    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-workload-socket\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.224308 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.224263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-envoy\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.224308 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.224279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjjrl\" (UniqueName: \"kubernetes.io/projected/9f3bc829-eb2c-48b5-af6d-438d809ab769-kube-api-access-fjjrl\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.325747 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.325712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-workload-socket\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.325747 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.325750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-envoy\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.326302 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.325769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjjrl\" (UniqueName: \"kubernetes.io/projected/9f3bc829-eb2c-48b5-af6d-438d809ab769-kube-api-access-fjjrl\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.326302 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.325808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-token\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.326302 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.325828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-podinfo\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.326302 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.325852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f3bc829-eb2c-48b5-af6d-438d809ab769-istiod-ca-cert\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.326302 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.325887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-credential-socket\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.326302 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.325903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-data\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.326302 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.325930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-workload-certs\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.326302 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.326224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-workload-socket\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.326697 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.326311    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-workload-certs\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.326697 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.326441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-credential-socket\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.326697 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.326512    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-data\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.326697 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.326640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f3bc829-eb2c-48b5-af6d-438d809ab769-istiod-ca-cert\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.334365 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.328579    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-envoy\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.334365 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.328819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-podinfo\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.336864 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.336841    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-token\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.337454 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.337430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjjrl\" (UniqueName: \"kubernetes.io/projected/9f3bc829-eb2c-48b5-af6d-438d809ab769-kube-api-access-fjjrl\") pod \"e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") " pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.465743 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.465651    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:36.611511 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.611485    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"]
Jul 27 20:20:36.613968 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:20:36.613939    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3bc829_eb2c_48b5_af6d_438d809ab769.slice/crio-43db0332e73af8448fcd3ac9c0d92d25a3988c8dee11bb2c7aff71bdea680c0a WatchSource:0}: Error finding container 43db0332e73af8448fcd3ac9c0d92d25a3988c8dee11bb2c7aff71bdea680c0a: Status 404 returned error can't find the container with id 43db0332e73af8448fcd3ac9c0d92d25a3988c8dee11bb2c7aff71bdea680c0a
Jul 27 20:20:36.616565 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.616530    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:20:36.616647 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.616597    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:20:36.616647 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:36.616629    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:20:37.240868 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:37.240832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" event={"ID":"9f3bc829-eb2c-48b5-af6d-438d809ab769","Type":"ContainerStarted","Data":"0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557"}
Jul 27 20:20:37.241051 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:37.240894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" event={"ID":"9f3bc829-eb2c-48b5-af6d-438d809ab769","Type":"ContainerStarted","Data":"43db0332e73af8448fcd3ac9c0d92d25a3988c8dee11bb2c7aff71bdea680c0a"}
Jul 27 20:20:37.266179 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:37.266120    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" podStartSLOduration=1.266105853 podStartE2EDuration="1.266105853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:20:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:20:37.264896903 +0000 UTC m=+3398.408101281" watchObservedRunningTime="2026-07-27 20:20:37.266105853 +0000 UTC m=+3398.409310229"
Jul 27 20:20:37.466336 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:37.466305    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:37.467457 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:37.467427    2563 patch_prober.go:28] interesting pod/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 27 20:20:37.467574 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:37.467477    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 27 20:20:38.469972 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:38.469943    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:39.252176 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:39.252147    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:39.253117 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:39.253097    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:40.569446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.569386    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:20:40.665280 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665248    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-credential-socket\") pod \"b9512a85-a960-4701-ad06-09cd2962204e\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") "
Jul 27 20:20:40.665280 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665282    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfrtc\" (UniqueName: \"kubernetes.io/projected/b9512a85-a960-4701-ad06-09cd2962204e-kube-api-access-cfrtc\") pod \"b9512a85-a960-4701-ad06-09cd2962204e\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") "
Jul 27 20:20:40.665495 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665306    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-istio-data\") pod \"b9512a85-a960-4701-ad06-09cd2962204e\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") "
Jul 27 20:20:40.665495 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665343    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-istio-envoy\") pod \"b9512a85-a960-4701-ad06-09cd2962204e\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") "
Jul 27 20:20:40.665495 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665371    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9512a85-a960-4701-ad06-09cd2962204e-istiod-ca-cert\") pod \"b9512a85-a960-4701-ad06-09cd2962204e\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") "
Jul 27 20:20:40.665495 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665411    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9512a85-a960-4701-ad06-09cd2962204e-istio-token\") pod \"b9512a85-a960-4701-ad06-09cd2962204e\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") "
Jul 27 20:20:40.665495 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665454    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9512a85-a960-4701-ad06-09cd2962204e-istio-podinfo\") pod \"b9512a85-a960-4701-ad06-09cd2962204e\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") "
Jul 27 20:20:40.665495 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665482    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-workload-socket\") pod \"b9512a85-a960-4701-ad06-09cd2962204e\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") "
Jul 27 20:20:40.665984 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665521    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-workload-certs\") pod \"b9512a85-a960-4701-ad06-09cd2962204e\" (UID: \"b9512a85-a960-4701-ad06-09cd2962204e\") "
Jul 27 20:20:40.665984 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665544    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9512a85-a960-4701-ad06-09cd2962204e" (UID: "b9512a85-a960-4701-ad06-09cd2962204e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:40.665984 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665714    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9512a85-a960-4701-ad06-09cd2962204e" (UID: "b9512a85-a960-4701-ad06-09cd2962204e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:40.665984 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665799    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:40.665984 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665816    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:40.665984 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665870    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9512a85-a960-4701-ad06-09cd2962204e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9512a85-a960-4701-ad06-09cd2962204e" (UID: "b9512a85-a960-4701-ad06-09cd2962204e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:20:40.665984 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.665934    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9512a85-a960-4701-ad06-09cd2962204e" (UID: "b9512a85-a960-4701-ad06-09cd2962204e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:40.666378 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.666297    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9512a85-a960-4701-ad06-09cd2962204e" (UID: "b9512a85-a960-4701-ad06-09cd2962204e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:40.667824 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.667802    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9512a85-a960-4701-ad06-09cd2962204e" (UID: "b9512a85-a960-4701-ad06-09cd2962204e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:40.667977 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.667954    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9512a85-a960-4701-ad06-09cd2962204e-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9512a85-a960-4701-ad06-09cd2962204e" (UID: "b9512a85-a960-4701-ad06-09cd2962204e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:20:40.668214 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.668188    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9512a85-a960-4701-ad06-09cd2962204e-kube-api-access-cfrtc" (OuterVolumeSpecName: "kube-api-access-cfrtc") pod "b9512a85-a960-4701-ad06-09cd2962204e" (UID: "b9512a85-a960-4701-ad06-09cd2962204e"). InnerVolumeSpecName "kube-api-access-cfrtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:20:40.668214 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.668183    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9512a85-a960-4701-ad06-09cd2962204e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9512a85-a960-4701-ad06-09cd2962204e" (UID: "b9512a85-a960-4701-ad06-09cd2962204e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:20:40.767252 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.767225    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:40.767252 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.767247    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:40.767252 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.767255    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9512a85-a960-4701-ad06-09cd2962204e-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:40.767452 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.767264    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9512a85-a960-4701-ad06-09cd2962204e-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:40.767452 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.767272    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9512a85-a960-4701-ad06-09cd2962204e-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:40.767452 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.767281    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9512a85-a960-4701-ad06-09cd2962204e-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:40.767452 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:40.767289    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfrtc\" (UniqueName: \"kubernetes.io/projected/b9512a85-a960-4701-ad06-09cd2962204e-kube-api-access-cfrtc\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:20:41.263018 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.262983    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9512a85-a960-4701-ad06-09cd2962204e" containerID="8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3" exitCode=0
Jul 27 20:20:41.263228 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.263049    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"
Jul 27 20:20:41.263228 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.263069    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt" event={"ID":"b9512a85-a960-4701-ad06-09cd2962204e","Type":"ContainerDied","Data":"8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3"}
Jul 27 20:20:41.263228 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.263132    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt" event={"ID":"b9512a85-a960-4701-ad06-09cd2962204e","Type":"ContainerDied","Data":"071d03f79ba6b4b549391e61221b9914fdbfc38ce7f651642c9bcb927ce8f75b"}
Jul 27 20:20:41.263228 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.263163    2563 scope.go:117] "RemoveContainer" containerID="8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3"
Jul 27 20:20:41.272531 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.272515    2563 scope.go:117] "RemoveContainer" containerID="46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2"
Jul 27 20:20:41.280987 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.280969    2563 scope.go:117] "RemoveContainer" containerID="8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3"
Jul 27 20:20:41.281327 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:20:41.281308    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3\": container with ID starting with 8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3 not found: ID does not exist" containerID="8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3"
Jul 27 20:20:41.281394 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.281339    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3"} err="failed to get container status \"8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3\": rpc error: code = NotFound desc = could not find container \"8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3\": container with ID starting with 8a9cd591407ee93c43eba100d3d32e0c151aba8c418fc70bdeeffeb139661ad3 not found: ID does not exist"
Jul 27 20:20:41.281394 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.281361    2563 scope.go:117] "RemoveContainer" containerID="46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2"
Jul 27 20:20:41.281605 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:20:41.281591    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2\": container with ID starting with 46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2 not found: ID does not exist" containerID="46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2"
Jul 27 20:20:41.281653 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.281610    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2"} err="failed to get container status \"46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2\": rpc error: code = NotFound desc = could not find container \"46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2\": container with ID starting with 46c2d2c11915a87c85ae450d27724377c630ed787b8e112db1140b43d3871de2 not found: ID does not exist"
Jul 27 20:20:41.296158 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.296135    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"]
Jul 27 20:20:41.301952 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.301930    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-49ddd1-openshift-default-85d77586dd-hg6qt"]
Jul 27 20:20:41.371915 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:41.371878    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9512a85-a960-4701-ad06-09cd2962204e" path="/var/lib/kubelet/pods/b9512a85-a960-4701-ad06-09cd2962204e/volumes"
Jul 27 20:20:44.382995 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.382958    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"]
Jul 27 20:20:44.383375 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.383354    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9512a85-a960-4701-ad06-09cd2962204e" containerName="istio-proxy"
Jul 27 20:20:44.383375 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.383370    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9512a85-a960-4701-ad06-09cd2962204e" containerName="istio-proxy"
Jul 27 20:20:44.383461 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.383436    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9512a85-a960-4701-ad06-09cd2962204e" containerName="istio-proxy"
Jul 27 20:20:44.386681 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.386655    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.389535 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.389516    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6c1463-openshift-default-dockercfg-wnxrx\""
Jul 27 20:20:44.399960 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.399938    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"]
Jul 27 20:20:44.499280 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.499241    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-podinfo\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.499511 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.499361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-credential-socket\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.499511 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.499419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-envoy\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.499511 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.499457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-workload-socket\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.499511 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.499488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-data\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.499739 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.499515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-token\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.499739 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.499564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-workload-certs\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.499739 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.499590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istiod-ca-cert\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.499739 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.499610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpvxj\" (UniqueName: \"kubernetes.io/projected/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-kube-api-access-rpvxj\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.600731 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.600700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-podinfo\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.600901 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.600752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-credential-socket\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.600901 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.600795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-envoy\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.600901 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.600818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-workload-socket\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.600901 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.600841    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-data\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.600901 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.600868    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-token\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.600901 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.600902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-workload-certs\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.601283 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.601249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istiod-ca-cert\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.601353 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.601302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpvxj\" (UniqueName: \"kubernetes.io/projected/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-kube-api-access-rpvxj\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.601353 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.601302    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-workload-socket\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.601353 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.601334    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-workload-certs\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.601494 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.601377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-credential-socket\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.601494 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.601393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-data\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.601856 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.601838    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istiod-ca-cert\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.603365 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.603340    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-envoy\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.603466 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.603416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-podinfo\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.610411 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.610389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-token\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.610755 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.610725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpvxj\" (UniqueName: \"kubernetes.io/projected/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-kube-api-access-rpvxj\") pod \"e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") " pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.696781 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.696697    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:44.845229 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.845197    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"]
Jul 27 20:20:44.845920 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:20:44.845891    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d6e02e6_92e3_46de_bb3c_8c0e30fbf200.slice/crio-0cf64374cbd6a36cee60da176d3aeb2f0c9c8dd726a0a5dbae64ac64dc8b68ac WatchSource:0}: Error finding container 0cf64374cbd6a36cee60da176d3aeb2f0c9c8dd726a0a5dbae64ac64dc8b68ac: Status 404 returned error can't find the container with id 0cf64374cbd6a36cee60da176d3aeb2f0c9c8dd726a0a5dbae64ac64dc8b68ac
Jul 27 20:20:44.848515 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.848481    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:20:44.848605 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.848548    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:20:44.848605 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:44.848579    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:20:45.288914 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:45.288877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" event={"ID":"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200","Type":"ContainerStarted","Data":"ac9412b2c86be7a843ee811c5279a851654de488193fc83401cb9e14b5252a3f"}
Jul 27 20:20:45.289102 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:45.288939    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" event={"ID":"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200","Type":"ContainerStarted","Data":"0cf64374cbd6a36cee60da176d3aeb2f0c9c8dd726a0a5dbae64ac64dc8b68ac"}
Jul 27 20:20:45.312925 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:45.312881    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" podStartSLOduration=1.312864172 podStartE2EDuration="1.312864172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:20:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:20:45.311876718 +0000 UTC m=+3406.455081093" watchObservedRunningTime="2026-07-27 20:20:45.312864172 +0000 UTC m=+3406.456068549"
Jul 27 20:20:45.697013 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:45.696974    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:45.701732 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:45.701708    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:46.294249 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:46.294212    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:46.295196 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:46.295173    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:20:54.457065 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:54.456899    2563 patch_prober.go:28] interesting pod/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": read tcp 10.133.0.2:56410->10.133.0.57:15021: read: connection reset by peer" start-of-body=
Jul 27 20:20:54.457065 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:54.456967    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": read tcp 10.133.0.2:56410->10.133.0.57:15021: read: connection reset by peer"
Jul 27 20:20:55.348556 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:55.348519    2563 generic.go:356] "Generic (PLEG): container finished" podID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerID="0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557" exitCode=0
Jul 27 20:20:55.348721 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:55.348589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" event={"ID":"9f3bc829-eb2c-48b5-af6d-438d809ab769","Type":"ContainerDied","Data":"0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557"}
Jul 27 20:20:55.348998 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:55.348982    2563 scope.go:117] "RemoveContainer" containerID="0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557"
Jul 27 20:20:55.350177 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:55.350136    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:20:55.350276 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:55.350233    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:20:55.350317 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:55.350290    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:20:56.358230 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:56.358188    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" event={"ID":"9f3bc829-eb2c-48b5-af6d-438d809ab769","Type":"ContainerStarted","Data":"77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f"}
Jul 27 20:20:56.466155 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:56.466116    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:20:56.466435 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:56.466406    2563 patch_prober.go:28] interesting pod/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 27 20:20:56.466567 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:56.466457    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 27 20:20:57.466001 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:57.465962    2563 patch_prober.go:28] interesting pod/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 27 20:20:57.466434 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:57.466018    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 27 20:20:58.466765 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:58.466728    2563 patch_prober.go:28] interesting pod/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 27 20:20:58.467237 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:58.466791    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 27 20:20:59.466258 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.466227    2563 patch_prober.go:28] interesting pod/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 27 20:20:59.466426 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.466282    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 27 20:20:59.700271 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.700094    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq"]
Jul 27 20:20:59.701623 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.701598    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9512a85-a960-4701-ad06-09cd2962204e" containerName="istio-proxy"
Jul 27 20:20:59.701769 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.701756    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9512a85-a960-4701-ad06-09cd2962204e" containerName="istio-proxy"
Jul 27 20:20:59.702069 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.702029    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9512a85-a960-4701-ad06-09cd2962204e" containerName="istio-proxy"
Jul 27 20:20:59.706731 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.705292    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq"
Jul 27 20:20:59.708544 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.708517    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 20:20:59.708828 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.708804    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pljl4\""
Jul 27 20:20:59.716685 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.716600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq"]
Jul 27 20:20:59.847384 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.847340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72283eda-107d-4dbb-ba1f-a48ee755ec77-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c63843-jtjnq\" (UID: \"72283eda-107d-4dbb-ba1f-a48ee755ec77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq"
Jul 27 20:20:59.947961 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.947923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72283eda-107d-4dbb-ba1f-a48ee755ec77-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c63843-jtjnq\" (UID: \"72283eda-107d-4dbb-ba1f-a48ee755ec77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq"
Jul 27 20:20:59.948764 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:20:59.948742    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72283eda-107d-4dbb-ba1f-a48ee755ec77-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c63843-jtjnq\" (UID: \"72283eda-107d-4dbb-ba1f-a48ee755ec77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq"
Jul 27 20:21:00.025856 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:00.025728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq"
Jul 27 20:21:00.470721 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:00.470689    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:21:00.471099 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:00.471080    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:21:00.471289 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:00.471228    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq"]
Jul 27 20:21:00.471779 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:00.471763    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:21:00.474012 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:21:00.473990    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72283eda_107d_4dbb_ba1f_a48ee755ec77.slice/crio-b0d5310258fed25e25077aa26f4593205af9189157de0a3b8c9e5f52eea4ba73 WatchSource:0}: Error finding container b0d5310258fed25e25077aa26f4593205af9189157de0a3b8c9e5f52eea4ba73: Status 404 returned error can't find the container with id b0d5310258fed25e25077aa26f4593205af9189157de0a3b8c9e5f52eea4ba73
Jul 27 20:21:01.388032 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:01.387999    2563 generic.go:356] "Generic (PLEG): container finished" podID="72283eda-107d-4dbb-ba1f-a48ee755ec77" containerID="7df1045f74ce33e5a7f6839a307be9876d6972cc27d931bb33d249acdb33326a" exitCode=0
Jul 27 20:21:01.388483 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:01.388096    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq" event={"ID":"72283eda-107d-4dbb-ba1f-a48ee755ec77","Type":"ContainerDied","Data":"7df1045f74ce33e5a7f6839a307be9876d6972cc27d931bb33d249acdb33326a"}
Jul 27 20:21:01.388483 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:01.388159    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq" event={"ID":"72283eda-107d-4dbb-ba1f-a48ee755ec77","Type":"ContainerStarted","Data":"b0d5310258fed25e25077aa26f4593205af9189157de0a3b8c9e5f52eea4ba73"}
Jul 27 20:21:02.337191 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:02.337152    2563 patch_prober.go:28] interesting pod/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 20:21:02.337358 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:02.337264    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:21:02.540337 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:02.540314    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq"
Jul 27 20:21:02.567963 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:02.567935    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72283eda-107d-4dbb-ba1f-a48ee755ec77-maas-api-service-ca\") pod \"72283eda-107d-4dbb-ba1f-a48ee755ec77\" (UID: \"72283eda-107d-4dbb-ba1f-a48ee755ec77\") "
Jul 27 20:21:02.568299 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:02.568277    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72283eda-107d-4dbb-ba1f-a48ee755ec77-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "72283eda-107d-4dbb-ba1f-a48ee755ec77" (UID: "72283eda-107d-4dbb-ba1f-a48ee755ec77"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:21:02.668563 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:02.668492    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72283eda-107d-4dbb-ba1f-a48ee755ec77-maas-api-service-ca\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:03.399457 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:03.399434    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq"
Jul 27 20:21:03.399586 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:03.399462    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq" event={"ID":"72283eda-107d-4dbb-ba1f-a48ee755ec77","Type":"ContainerDied","Data":"b0d5310258fed25e25077aa26f4593205af9189157de0a3b8c9e5f52eea4ba73"}
Jul 27 20:21:03.399586 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:03.399500    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0d5310258fed25e25077aa26f4593205af9189157de0a3b8c9e5f52eea4ba73"
Jul 27 20:21:04.405259 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:04.405227    2563 generic.go:356] "Generic (PLEG): container finished" podID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerID="ac9412b2c86be7a843ee811c5279a851654de488193fc83401cb9e14b5252a3f" exitCode=0
Jul 27 20:21:04.405799 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:04.405284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" event={"ID":"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200","Type":"ContainerDied","Data":"ac9412b2c86be7a843ee811c5279a851654de488193fc83401cb9e14b5252a3f"}
Jul 27 20:21:04.405799 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:04.405787    2563 scope.go:117] "RemoveContainer" containerID="ac9412b2c86be7a843ee811c5279a851654de488193fc83401cb9e14b5252a3f"
Jul 27 20:21:04.406910 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:04.406879    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:21:04.407009 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:04.406946    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:21:04.407009 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:04.406977    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:21:05.413163 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:05.413131    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" event={"ID":"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200","Type":"ContainerStarted","Data":"25bf7165e2f0d2c9e67ef0ca68af475b6c9a463b39c339311921cb1db5012754"}
Jul 27 20:21:05.697926 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:05.697829    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:21:05.698341 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:05.698141    2563 patch_prober.go:28] interesting pod/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 27 20:21:05.698546 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:05.698513    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 27 20:21:06.697600 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:06.697555    2563 patch_prober.go:28] interesting pod/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 27 20:21:06.698129 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:06.697634    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 27 20:21:07.698098 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:07.698063    2563 patch_prober.go:28] interesting pod/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 27 20:21:07.698682 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:07.698649    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 27 20:21:08.698003 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:08.697967    2563 patch_prober.go:28] interesting pod/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 27 20:21:08.698313 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:08.698282    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 27 20:21:09.700953 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:09.700927    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:21:09.701443 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:09.701206    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:21:09.701838 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:09.701821    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:21:19.807152 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:19.807113    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq"]
Jul 27 20:21:19.811324 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:19.811300    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c63843-jtjnq"]
Jul 27 20:21:21.372804 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:21.372772    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72283eda-107d-4dbb-ba1f-a48ee755ec77" path="/var/lib/kubelet/pods/72283eda-107d-4dbb-ba1f-a48ee755ec77/volumes"
Jul 27 20:21:26.995671 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:26.995639    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"]
Jul 27 20:21:26.996089 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:26.995857    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy" containerID="cri-o://77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f" gracePeriod=30
Jul 27 20:21:30.473470 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:30.473431    2563 patch_prober.go:28] interesting pod/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 27 20:21:30.473848 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:30.473526    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 20:21:32.248690 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.248663    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:21:32.342596 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.342563    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-envoy\") pod \"9f3bc829-eb2c-48b5-af6d-438d809ab769\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") "
Jul 27 20:21:32.342776 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.342609    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f3bc829-eb2c-48b5-af6d-438d809ab769-istiod-ca-cert\") pod \"9f3bc829-eb2c-48b5-af6d-438d809ab769\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") "
Jul 27 20:21:32.342776 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.342634    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-credential-socket\") pod \"9f3bc829-eb2c-48b5-af6d-438d809ab769\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") "
Jul 27 20:21:32.342776 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.342672    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjjrl\" (UniqueName: \"kubernetes.io/projected/9f3bc829-eb2c-48b5-af6d-438d809ab769-kube-api-access-fjjrl\") pod \"9f3bc829-eb2c-48b5-af6d-438d809ab769\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") "
Jul 27 20:21:32.342776 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.342727    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-data\") pod \"9f3bc829-eb2c-48b5-af6d-438d809ab769\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") "
Jul 27 20:21:32.342776 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.342747    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-workload-certs\") pod \"9f3bc829-eb2c-48b5-af6d-438d809ab769\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") "
Jul 27 20:21:32.343085 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.342808    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-podinfo\") pod \"9f3bc829-eb2c-48b5-af6d-438d809ab769\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") "
Jul 27 20:21:32.343085 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.342834    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-token\") pod \"9f3bc829-eb2c-48b5-af6d-438d809ab769\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") "
Jul 27 20:21:32.343085 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.342858    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-workload-socket\") pod \"9f3bc829-eb2c-48b5-af6d-438d809ab769\" (UID: \"9f3bc829-eb2c-48b5-af6d-438d809ab769\") "
Jul 27 20:21:32.343085 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.342943    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f3bc829-eb2c-48b5-af6d-438d809ab769" (UID: "9f3bc829-eb2c-48b5-af6d-438d809ab769"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:32.343085 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.343061    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f3bc829-eb2c-48b5-af6d-438d809ab769" (UID: "9f3bc829-eb2c-48b5-af6d-438d809ab769"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:32.343363 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.343116    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f3bc829-eb2c-48b5-af6d-438d809ab769-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f3bc829-eb2c-48b5-af6d-438d809ab769" (UID: "9f3bc829-eb2c-48b5-af6d-438d809ab769"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:21:32.343363 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.343196    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f3bc829-eb2c-48b5-af6d-438d809ab769" (UID: "9f3bc829-eb2c-48b5-af6d-438d809ab769"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:32.343363 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.343287    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f3bc829-eb2c-48b5-af6d-438d809ab769-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:32.343363 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.343310    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:32.343363 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.343324    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:32.343948 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.343921    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f3bc829-eb2c-48b5-af6d-438d809ab769" (UID: "9f3bc829-eb2c-48b5-af6d-438d809ab769"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:32.344973 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.344943    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f3bc829-eb2c-48b5-af6d-438d809ab769-kube-api-access-fjjrl" (OuterVolumeSpecName: "kube-api-access-fjjrl") pod "9f3bc829-eb2c-48b5-af6d-438d809ab769" (UID: "9f3bc829-eb2c-48b5-af6d-438d809ab769"). InnerVolumeSpecName "kube-api-access-fjjrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:21:32.345175 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.345156    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f3bc829-eb2c-48b5-af6d-438d809ab769" (UID: "9f3bc829-eb2c-48b5-af6d-438d809ab769"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:21:32.345260 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.345243    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f3bc829-eb2c-48b5-af6d-438d809ab769" (UID: "9f3bc829-eb2c-48b5-af6d-438d809ab769"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:32.345479 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.345459    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f3bc829-eb2c-48b5-af6d-438d809ab769" (UID: "9f3bc829-eb2c-48b5-af6d-438d809ab769"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:21:32.444350 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.444318    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:32.444350 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.444346    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjjrl\" (UniqueName: \"kubernetes.io/projected/9f3bc829-eb2c-48b5-af6d-438d809ab769-kube-api-access-fjjrl\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:32.444521 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.444361    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:32.444521 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.444372    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:32.444521 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.444383    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f3bc829-eb2c-48b5-af6d-438d809ab769-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:32.444521 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.444393    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f3bc829-eb2c-48b5-af6d-438d809ab769-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:32.544378 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.544346    2563 generic.go:356] "Generic (PLEG): container finished" podID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerID="77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f" exitCode=0
Jul 27 20:21:32.544552 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.544394    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"
Jul 27 20:21:32.544552 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.544408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" event={"ID":"9f3bc829-eb2c-48b5-af6d-438d809ab769","Type":"ContainerDied","Data":"77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f"}
Jul 27 20:21:32.544552 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.544452    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv" event={"ID":"9f3bc829-eb2c-48b5-af6d-438d809ab769","Type":"ContainerDied","Data":"43db0332e73af8448fcd3ac9c0d92d25a3988c8dee11bb2c7aff71bdea680c0a"}
Jul 27 20:21:32.544552 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.544473    2563 scope.go:117] "RemoveContainer" containerID="77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f"
Jul 27 20:21:32.554462 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.554445    2563 scope.go:117] "RemoveContainer" containerID="0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557"
Jul 27 20:21:32.562963 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.562947    2563 scope.go:117] "RemoveContainer" containerID="77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f"
Jul 27 20:21:32.563300 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:21:32.563279    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f\": container with ID starting with 77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f not found: ID does not exist" containerID="77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f"
Jul 27 20:21:32.563370 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.563310    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f"} err="failed to get container status \"77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f\": rpc error: code = NotFound desc = could not find container \"77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f\": container with ID starting with 77858a180b73fc04cd6d8c541401856babe71c1ed0f2de666f97e4d5963b830f not found: ID does not exist"
Jul 27 20:21:32.563370 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.563329    2563 scope.go:117] "RemoveContainer" containerID="0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557"
Jul 27 20:21:32.563549 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:21:32.563531    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557\": container with ID starting with 0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557 not found: ID does not exist" containerID="0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557"
Jul 27 20:21:32.563589 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.563556    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557"} err="failed to get container status \"0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557\": rpc error: code = NotFound desc = could not find container \"0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557\": container with ID starting with 0264fbfc29114ff81a5ef38c529694c6789a9f7136a019441ee11dc43f764557 not found: ID does not exist"
Jul 27 20:21:32.569695 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.569671    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"]
Jul 27 20:21:32.577408 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:32.577388    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c63843-openshift-default-58fb47f74-8rjzv"]
Jul 27 20:21:33.372739 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:33.372703    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" path="/var/lib/kubelet/pods/9f3bc829-eb2c-48b5-af6d-438d809ab769/volumes"
Jul 27 20:21:54.460188 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:54.460153    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"]
Jul 27 20:21:54.460680 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:54.460425    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy" containerID="cri-o://25bf7165e2f0d2c9e67ef0ca68af475b6c9a463b39c339311921cb1db5012754" gracePeriod=30
Jul 27 20:21:54.703884 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:54.703850    2563 patch_prober.go:28] interesting pod/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 27 20:21:54.704071 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:54.703919    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 20:21:55.326437 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.326407    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"]
Jul 27 20:21:55.326809 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.326796    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy"
Jul 27 20:21:55.326809 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.326810    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy"
Jul 27 20:21:55.326916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.326826    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy"
Jul 27 20:21:55.326916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.326832    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy"
Jul 27 20:21:55.326916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.326849    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72283eda-107d-4dbb-ba1f-a48ee755ec77" containerName="revoke-keys"
Jul 27 20:21:55.326916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.326855    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="72283eda-107d-4dbb-ba1f-a48ee755ec77" containerName="revoke-keys"
Jul 27 20:21:55.326916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.326908    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy"
Jul 27 20:21:55.326916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.326914    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f3bc829-eb2c-48b5-af6d-438d809ab769" containerName="istio-proxy"
Jul 27 20:21:55.327173 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.326922    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="72283eda-107d-4dbb-ba1f-a48ee755ec77" containerName="revoke-keys"
Jul 27 20:21:55.328973 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.328957    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.331770 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.331748    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-a78f44-openshift-default-dockercfg-bfcd9\""
Jul 27 20:21:55.345392 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.345367    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"]
Jul 27 20:21:55.443716 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.443681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-workload-certs\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.443903 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.443732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-istio-data\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.443903 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.443787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-istio-envoy\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.443903 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.443815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-credential-socket\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.443903 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.443831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05907ba0-183d-4657-959e-03085b07020b-istiod-ca-cert\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.443903 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.443848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-workload-socket\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.443903 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.443870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twdpl\" (UniqueName: \"kubernetes.io/projected/05907ba0-183d-4657-959e-03085b07020b-kube-api-access-twdpl\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.443903 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.443899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05907ba0-183d-4657-959e-03085b07020b-istio-token\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.444241 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.443984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05907ba0-183d-4657-959e-03085b07020b-istio-podinfo\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545011 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.544984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-istio-data\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-istio-envoy\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-credential-socket\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05907ba0-183d-4657-959e-03085b07020b-istiod-ca-cert\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-workload-socket\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twdpl\" (UniqueName: \"kubernetes.io/projected/05907ba0-183d-4657-959e-03085b07020b-kube-api-access-twdpl\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05907ba0-183d-4657-959e-03085b07020b-istio-token\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05907ba0-183d-4657-959e-03085b07020b-istio-podinfo\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-workload-certs\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545399    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-istio-data\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545825 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-workload-socket\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545825 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545597    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-workload-certs\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545825 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-credential-socket\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.545825 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.545802    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05907ba0-183d-4657-959e-03085b07020b-istiod-ca-cert\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.547420 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.547402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-istio-envoy\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.547748 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.547733    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05907ba0-183d-4657-959e-03085b07020b-istio-podinfo\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.554359 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.554330    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05907ba0-183d-4657-959e-03085b07020b-istio-token\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.555055 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.555018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twdpl\" (UniqueName: \"kubernetes.io/projected/05907ba0-183d-4657-959e-03085b07020b-kube-api-access-twdpl\") pod \"e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") " pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.639975 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.639894    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:55.783160 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.783131    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"]
Jul 27 20:21:55.785664 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:21:55.785633    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05907ba0_183d_4657_959e_03085b07020b.slice/crio-106824cbd8e15d525589f47974baf76bb0817f7851d1df4816bc479a3b6186b5 WatchSource:0}: Error finding container 106824cbd8e15d525589f47974baf76bb0817f7851d1df4816bc479a3b6186b5: Status 404 returned error can't find the container with id 106824cbd8e15d525589f47974baf76bb0817f7851d1df4816bc479a3b6186b5
Jul 27 20:21:55.788446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.788404    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:21:55.788553 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.788493    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:21:55.788553 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:55.788534    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:21:56.669640 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:56.669601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" event={"ID":"05907ba0-183d-4657-959e-03085b07020b","Type":"ContainerStarted","Data":"8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59"}
Jul 27 20:21:56.670018 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:56.669666    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" event={"ID":"05907ba0-183d-4657-959e-03085b07020b","Type":"ContainerStarted","Data":"106824cbd8e15d525589f47974baf76bb0817f7851d1df4816bc479a3b6186b5"}
Jul 27 20:21:56.696477 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:56.696423    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" podStartSLOduration=1.69640746 podStartE2EDuration="1.69640746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:21:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:21:56.694535413 +0000 UTC m=+3477.837739799" watchObservedRunningTime="2026-07-27 20:21:56.69640746 +0000 UTC m=+3477.839611900"
Jul 27 20:21:57.640994 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:57.640964    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:57.646075 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:57.646029    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:57.674508 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:57.674477    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:57.675342 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:57.675323    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:21:59.691107 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.691064    2563 generic.go:356] "Generic (PLEG): container finished" podID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerID="25bf7165e2f0d2c9e67ef0ca68af475b6c9a463b39c339311921cb1db5012754" exitCode=0
Jul 27 20:21:59.691486 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.691071    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" event={"ID":"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200","Type":"ContainerDied","Data":"25bf7165e2f0d2c9e67ef0ca68af475b6c9a463b39c339311921cb1db5012754"}
Jul 27 20:21:59.691486 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.691216    2563 scope.go:117] "RemoveContainer" containerID="ac9412b2c86be7a843ee811c5279a851654de488193fc83401cb9e14b5252a3f"
Jul 27 20:21:59.721739 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.721705    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:21:59.790668 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.790141    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpvxj\" (UniqueName: \"kubernetes.io/projected/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-kube-api-access-rpvxj\") pod \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") "
Jul 27 20:21:59.790668 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.790199    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-token\") pod \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") "
Jul 27 20:21:59.790668 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.790473    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-credential-socket\") pod \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") "
Jul 27 20:21:59.790668 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.790532    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-data\") pod \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") "
Jul 27 20:21:59.790668 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.790595    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-envoy\") pod \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") "
Jul 27 20:21:59.791362 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.790805    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-podinfo\") pod \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") "
Jul 27 20:21:59.791362 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.790852    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-workload-certs\") pod \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") "
Jul 27 20:21:59.791362 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.790882    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-workload-socket\") pod \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") "
Jul 27 20:21:59.791362 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.790914    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istiod-ca-cert\") pod \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\" (UID: \"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200\") "
Jul 27 20:21:59.791362 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.790986    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" (UID: "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:59.791362 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.791284    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" (UID: "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:59.791690 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.791383    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" (UID: "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:21:59.791690 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.791467    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" (UID: "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:59.791690 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.791579    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" (UID: "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:59.791848 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.791699    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:59.792817 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.792787    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" (UID: "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:21:59.793180 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.793159    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-kube-api-access-rpvxj" (OuterVolumeSpecName: "kube-api-access-rpvxj") pod "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" (UID: "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200"). InnerVolumeSpecName "kube-api-access-rpvxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:21:59.793366 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.793345    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" (UID: "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:21:59.793775 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.793746    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" (UID: "7d6e02e6-92e3-46de-bb3c-8c0e30fbf200"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:59.892530 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.892492    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:59.892530 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.892524    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:59.892530 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.892533    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:59.892755 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.892541    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:59.892755 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.892550    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpvxj\" (UniqueName: \"kubernetes.io/projected/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-kube-api-access-rpvxj\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:59.892755 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.892560    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:59.892755 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.892568    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:21:59.892755 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:21:59.892575    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:22:00.698081 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:00.698021    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst" event={"ID":"7d6e02e6-92e3-46de-bb3c-8c0e30fbf200","Type":"ContainerDied","Data":"0cf64374cbd6a36cee60da176d3aeb2f0c9c8dd726a0a5dbae64ac64dc8b68ac"}
Jul 27 20:22:00.698573 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:00.698099    2563 scope.go:117] "RemoveContainer" containerID="25bf7165e2f0d2c9e67ef0ca68af475b6c9a463b39c339311921cb1db5012754"
Jul 27 20:22:00.698573 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:00.698060    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"
Jul 27 20:22:00.721907 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:00.721876    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"]
Jul 27 20:22:00.727700 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:00.727676    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6c1463-openshift-default-8fdd47fcb-n8wst"]
Jul 27 20:22:01.374213 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:01.374180    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" path="/var/lib/kubelet/pods/7d6e02e6-92e3-46de-bb3c-8c0e30fbf200/volumes"
Jul 27 20:22:03.638255 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.638221    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"]
Jul 27 20:22:03.638750 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.638694    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy"
Jul 27 20:22:03.638750 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.638708    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy"
Jul 27 20:22:03.638750 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.638721    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy"
Jul 27 20:22:03.638750 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.638726    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy"
Jul 27 20:22:03.638895 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.638788    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy"
Jul 27 20:22:03.638895 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.638799    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d6e02e6-92e3-46de-bb3c-8c0e30fbf200" containerName="istio-proxy"
Jul 27 20:22:03.642063 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.642003    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.644813 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.644794    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-43d589-openshift-default-dockercfg-p6226\""
Jul 27 20:22:03.657180 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.657145    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"]
Jul 27 20:22:03.728060 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.727989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-data\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.728281 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.728032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9592\" (UniqueName: \"kubernetes.io/projected/d3ba850c-ff65-478c-a1a0-563a0984bb4a-kube-api-access-l9592\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.728281 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.728204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-podinfo\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.728281 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.728247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-envoy\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.728474 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.728299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-credential-socket\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.728474 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.728383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-workload-certs\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.728474 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.728434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istiod-ca-cert\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.728629 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.728559    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-workload-socket\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.728683 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.728619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-token\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829131 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-workload-certs\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829131 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istiod-ca-cert\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829408 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-workload-socket\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829408 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-token\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829408 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-data\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829408 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9592\" (UniqueName: \"kubernetes.io/projected/d3ba850c-ff65-478c-a1a0-563a0984bb4a-kube-api-access-l9592\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829617 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-podinfo\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829617 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-workload-socket\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829617 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-envoy\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829617 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-credential-socket\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829617 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829576    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-workload-certs\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829876 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-data\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829876 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829847    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-credential-socket\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.829876 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.829848    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istiod-ca-cert\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.831814 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.831792    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-envoy\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.831954 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.831937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-podinfo\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.840611 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.840587    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9592\" (UniqueName: \"kubernetes.io/projected/d3ba850c-ff65-478c-a1a0-563a0984bb4a-kube-api-access-l9592\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.840762 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.840746    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-token\") pod \"e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") " pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:03.954016 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:03.953941    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:04.094267 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:04.094241    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"]
Jul 27 20:22:04.096312 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:22:04.096287    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ba850c_ff65_478c_a1a0_563a0984bb4a.slice/crio-c5e6193f2d65248d11477f3730b02d284a597d7b0fea83bb2e3ea12ccf21bb72 WatchSource:0}: Error finding container c5e6193f2d65248d11477f3730b02d284a597d7b0fea83bb2e3ea12ccf21bb72: Status 404 returned error can't find the container with id c5e6193f2d65248d11477f3730b02d284a597d7b0fea83bb2e3ea12ccf21bb72
Jul 27 20:22:04.098584 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:04.098552    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:22:04.098652 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:04.098622    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:22:04.098691 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:04.098651    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:22:04.720480 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:04.720441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" event={"ID":"d3ba850c-ff65-478c-a1a0-563a0984bb4a","Type":"ContainerStarted","Data":"cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19"}
Jul 27 20:22:04.720879 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:04.720498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" event={"ID":"d3ba850c-ff65-478c-a1a0-563a0984bb4a","Type":"ContainerStarted","Data":"c5e6193f2d65248d11477f3730b02d284a597d7b0fea83bb2e3ea12ccf21bb72"}
Jul 27 20:22:04.745521 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:04.745464    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" podStartSLOduration=1.745446762 podStartE2EDuration="1.745446762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:22:04.743628427 +0000 UTC m=+3485.886832804" watchObservedRunningTime="2026-07-27 20:22:04.745446762 +0000 UTC m=+3485.888651205"
Jul 27 20:22:04.954289 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:04.954253    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:05.959997 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:05.959964    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:06.731175 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:06.731141    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:06.732084 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:06.732063    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:13.717198 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:13.717158    2563 patch_prober.go:28] interesting pod/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 20:22:13.717598 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:13.717239    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" podUID="05907ba0-183d-4657-959e-03085b07020b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:22:14.773302 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:14.773222    2563 generic.go:356] "Generic (PLEG): container finished" podID="05907ba0-183d-4657-959e-03085b07020b" containerID="8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59" exitCode=0
Jul 27 20:22:14.773690 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:14.773294    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" event={"ID":"05907ba0-183d-4657-959e-03085b07020b","Type":"ContainerDied","Data":"8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59"}
Jul 27 20:22:14.773690 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:14.773676    2563 scope.go:117] "RemoveContainer" containerID="8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59"
Jul 27 20:22:14.774812 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:14.774778    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:22:14.774931 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:14.774841    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:22:14.774931 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:14.774878    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:22:15.781064 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:15.780158    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" event={"ID":"05907ba0-183d-4657-959e-03085b07020b","Type":"ContainerStarted","Data":"347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2"}
Jul 27 20:22:16.640982 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:16.640946    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:22:16.641194 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:16.641172    2563 patch_prober.go:28] interesting pod/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 20:22:16.641272 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:16.641222    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" podUID="05907ba0-183d-4657-959e-03085b07020b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 20:22:17.640921 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:17.640875    2563 patch_prober.go:28] interesting pod/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 20:22:17.641445 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:17.640931    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" podUID="05907ba0-183d-4657-959e-03085b07020b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 20:22:18.473265 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.473235    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"]
Jul 27 20:22:18.475627 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.475612    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.478625 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.478603    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a78f44\"/\"openshift-service-ca.crt\""
Jul 27 20:22:18.496964 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.496179    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a78f44\"/\"kube-root-ca.crt\""
Jul 27 20:22:18.496964 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.496331    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a78f44\"/\"default-dockercfg-qgzwl\""
Jul 27 20:22:18.496964 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.496611    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a78f44\"/\"auth-test-model-a78f44-kserve-self-signed-certs\""
Jul 27 20:22:18.497439 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.497400    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"]
Jul 27 20:22:18.586658 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.586624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-home\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.586980 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.586945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4cz5\" (UniqueName: \"kubernetes.io/projected/b04f57e6-70c5-44b1-9aac-609bcb42abee-kube-api-access-q4cz5\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.587185 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.587151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-model-cache\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.587380 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.587347    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b04f57e6-70c5-44b1-9aac-609bcb42abee-tls-certs\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.587527 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.587512    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-dshm\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.587678 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.587664    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-tmp-dir\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.640695 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.640660    2563 patch_prober.go:28] interesting pod/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 20:22:18.640876 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.640729    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" podUID="05907ba0-183d-4657-959e-03085b07020b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 20:22:18.689366 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.689322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-model-cache\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.689851 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.689412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b04f57e6-70c5-44b1-9aac-609bcb42abee-tls-certs\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.690272 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.690245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-model-cache\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.690375 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.690338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-dshm\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.690442 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.690389    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-tmp-dir\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.690502 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.690470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-home\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.690558 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.690516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4cz5\" (UniqueName: \"kubernetes.io/projected/b04f57e6-70c5-44b1-9aac-609bcb42abee-kube-api-access-q4cz5\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.690859 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.690836    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-home\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.692197 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.691115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-tmp-dir\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.693916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.692499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-dshm\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.694746 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.694719    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b04f57e6-70c5-44b1-9aac-609bcb42abee-tls-certs\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.701984 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.701937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4cz5\" (UniqueName: \"kubernetes.io/projected/b04f57e6-70c5-44b1-9aac-609bcb42abee-kube-api-access-q4cz5\") pod \"auth-test-model-a78f44-kserve-5757777cff-8gc6q\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") " pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:18.812369 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:18.812279    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:19.042078 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:19.036721    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"]
Jul 27 20:22:19.044800 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:22:19.044771    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb04f57e6_70c5_44b1_9aac_609bcb42abee.slice/crio-9ce42b7282aae8306e83cfdaa96d90d1ed77bde9782fed3d5e632285c71e04a1 WatchSource:0}: Error finding container 9ce42b7282aae8306e83cfdaa96d90d1ed77bde9782fed3d5e632285c71e04a1: Status 404 returned error can't find the container with id 9ce42b7282aae8306e83cfdaa96d90d1ed77bde9782fed3d5e632285c71e04a1
Jul 27 20:22:19.640621 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:19.640538    2563 patch_prober.go:28] interesting pod/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 20:22:19.640621 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:19.640594    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" podUID="05907ba0-183d-4657-959e-03085b07020b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 20:22:19.808368 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:19.808333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q" event={"ID":"b04f57e6-70c5-44b1-9aac-609bcb42abee","Type":"ContainerStarted","Data":"c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55"}
Jul 27 20:22:19.808820 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:19.808384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q" event={"ID":"b04f57e6-70c5-44b1-9aac-609bcb42abee","Type":"ContainerStarted","Data":"9ce42b7282aae8306e83cfdaa96d90d1ed77bde9782fed3d5e632285c71e04a1"}
Jul 27 20:22:19.829869 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:19.829820    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q" podStartSLOduration=1.82980473 podStartE2EDuration="1.82980473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:22:19.828119666 +0000 UTC m=+3500.971324042" watchObservedRunningTime="2026-07-27 20:22:19.82980473 +0000 UTC m=+3500.973009106"
Jul 27 20:22:20.644751 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:20.644721    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:22:20.645095 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:20.645069    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:22:20.645958 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:20.645941    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:22:22.619861 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:22.619765    2563 patch_prober.go:28] interesting pod/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": read tcp 10.133.0.2:35862->10.133.0.61:15021: read: connection reset by peer" start-of-body=
Jul 27 20:22:22.619861 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:22.619830    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" podUID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": read tcp 10.133.0.2:35862->10.133.0.61:15021: read: connection reset by peer"
Jul 27 20:22:22.833525 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:22.833491    2563 generic.go:356] "Generic (PLEG): container finished" podID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerID="cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19" exitCode=0
Jul 27 20:22:22.833681 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:22.833564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" event={"ID":"d3ba850c-ff65-478c-a1a0-563a0984bb4a","Type":"ContainerDied","Data":"cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19"}
Jul 27 20:22:22.833930 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:22.833916    2563 scope.go:117] "RemoveContainer" containerID="cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19"
Jul 27 20:22:22.835023 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:22.834989    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:22:22.835127 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:22.835109    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:22:22.835171 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:22.835154    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:22:23.840495 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:23.840460    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" event={"ID":"d3ba850c-ff65-478c-a1a0-563a0984bb4a","Type":"ContainerStarted","Data":"3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa"}
Jul 27 20:22:23.954918 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:23.954883    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:23.955131 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:23.955108    2563 patch_prober.go:28] interesting pod/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 27 20:22:23.955199 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:23.955159    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" podUID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 27 20:22:24.955008 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:24.954967    2563 patch_prober.go:28] interesting pod/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 27 20:22:24.955451 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:24.955075    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" podUID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 27 20:22:25.954426 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:25.954388    2563 patch_prober.go:28] interesting pod/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 27 20:22:25.954687 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:25.954450    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" podUID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 27 20:22:26.954364 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:26.954328    2563 patch_prober.go:28] interesting pod/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 27 20:22:26.954784 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:26.954385    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" podUID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 27 20:22:27.958349 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:27.958308    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:27.958812 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:27.958603    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:27.959401 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:27.959384    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:22:28.813370 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:28.813338    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:28.813571 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:28.813384    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:28.825794 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:28.825768    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:22:28.875364 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:22:28.875335    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:25:59.747361 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:25:59.747324    2563 scope.go:117] "RemoveContainer" containerID="e61ede64e8e8045b882543ffa4c5b4c47198b24a711723313de6f2833ca6de17"
Jul 27 20:27:27.147606 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:27.147574    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"]
Jul 27 20:27:42.167361 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.167302    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q" podUID="b04f57e6-70c5-44b1-9aac-609bcb42abee" containerName="main" containerID="cri-o://c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55" gracePeriod=45
Jul 27 20:27:42.431800 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.431736    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:27:42.458501 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.458472    2563 generic.go:356] "Generic (PLEG): container finished" podID="b04f57e6-70c5-44b1-9aac-609bcb42abee" containerID="c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55" exitCode=0
Jul 27 20:27:42.458652 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.458511    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"
Jul 27 20:27:42.458652 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.458552    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q" event={"ID":"b04f57e6-70c5-44b1-9aac-609bcb42abee","Type":"ContainerDied","Data":"c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55"}
Jul 27 20:27:42.458652 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.458596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q" event={"ID":"b04f57e6-70c5-44b1-9aac-609bcb42abee","Type":"ContainerDied","Data":"9ce42b7282aae8306e83cfdaa96d90d1ed77bde9782fed3d5e632285c71e04a1"}
Jul 27 20:27:42.458652 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.458614    2563 scope.go:117] "RemoveContainer" containerID="c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55"
Jul 27 20:27:42.467853 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.467824    2563 scope.go:117] "RemoveContainer" containerID="c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55"
Jul 27 20:27:42.468170 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:27:42.468149    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55\": container with ID starting with c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55 not found: ID does not exist" containerID="c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55"
Jul 27 20:27:42.468251 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.468183    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55"} err="failed to get container status \"c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55\": rpc error: code = NotFound desc = could not find container \"c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55\": container with ID starting with c5c72d6fe385431a5b3b020458e6e110fe0196f4e9f463f74a45bdbecb6e6c55 not found: ID does not exist"
Jul 27 20:27:42.511836 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.511806    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4cz5\" (UniqueName: \"kubernetes.io/projected/b04f57e6-70c5-44b1-9aac-609bcb42abee-kube-api-access-q4cz5\") pod \"b04f57e6-70c5-44b1-9aac-609bcb42abee\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") "
Jul 27 20:27:42.511987 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.511841    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-dshm\") pod \"b04f57e6-70c5-44b1-9aac-609bcb42abee\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") "
Jul 27 20:27:42.511987 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.511872    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-tmp-dir\") pod \"b04f57e6-70c5-44b1-9aac-609bcb42abee\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") "
Jul 27 20:27:42.511987 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.511966    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b04f57e6-70c5-44b1-9aac-609bcb42abee-tls-certs\") pod \"b04f57e6-70c5-44b1-9aac-609bcb42abee\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") "
Jul 27 20:27:42.512199 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.512022    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-home\") pod \"b04f57e6-70c5-44b1-9aac-609bcb42abee\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") "
Jul 27 20:27:42.512199 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.512063    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-model-cache\") pod \"b04f57e6-70c5-44b1-9aac-609bcb42abee\" (UID: \"b04f57e6-70c5-44b1-9aac-609bcb42abee\") "
Jul 27 20:27:42.512301 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.512199    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b04f57e6-70c5-44b1-9aac-609bcb42abee" (UID: "b04f57e6-70c5-44b1-9aac-609bcb42abee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:27:42.512390 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.512366    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-tmp-dir\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:27:42.512519 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.512375    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-home" (OuterVolumeSpecName: "home") pod "b04f57e6-70c5-44b1-9aac-609bcb42abee" (UID: "b04f57e6-70c5-44b1-9aac-609bcb42abee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:27:42.512519 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.512428    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-model-cache" (OuterVolumeSpecName: "model-cache") pod "b04f57e6-70c5-44b1-9aac-609bcb42abee" (UID: "b04f57e6-70c5-44b1-9aac-609bcb42abee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:27:42.514266 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.514239    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-dshm" (OuterVolumeSpecName: "dshm") pod "b04f57e6-70c5-44b1-9aac-609bcb42abee" (UID: "b04f57e6-70c5-44b1-9aac-609bcb42abee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:27:42.514355 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.514273    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b04f57e6-70c5-44b1-9aac-609bcb42abee-kube-api-access-q4cz5" (OuterVolumeSpecName: "kube-api-access-q4cz5") pod "b04f57e6-70c5-44b1-9aac-609bcb42abee" (UID: "b04f57e6-70c5-44b1-9aac-609bcb42abee"). InnerVolumeSpecName "kube-api-access-q4cz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:27:42.514355 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.514291    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b04f57e6-70c5-44b1-9aac-609bcb42abee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b04f57e6-70c5-44b1-9aac-609bcb42abee" (UID: "b04f57e6-70c5-44b1-9aac-609bcb42abee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:27:42.612823 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.612787    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-home\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:27:42.612994 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.612845    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-model-cache\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:27:42.612994 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.612860    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4cz5\" (UniqueName: \"kubernetes.io/projected/b04f57e6-70c5-44b1-9aac-609bcb42abee-kube-api-access-q4cz5\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:27:42.612994 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.612869    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b04f57e6-70c5-44b1-9aac-609bcb42abee-dshm\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:27:42.612994 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.612879    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b04f57e6-70c5-44b1-9aac-609bcb42abee-tls-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:27:42.782328 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.782243    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"]
Jul 27 20:27:42.784277 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:42.784252    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a78f44/auth-test-model-a78f44-kserve-5757777cff-8gc6q"]
Jul 27 20:27:43.372155 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:43.372126    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b04f57e6-70c5-44b1-9aac-609bcb42abee" path="/var/lib/kubelet/pods/b04f57e6-70c5-44b1-9aac-609bcb42abee/volumes"
Jul 27 20:27:59.777259 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:27:59.777222    2563 scope.go:117] "RemoveContainer" containerID="7df1045f74ce33e5a7f6839a307be9876d6972cc27d931bb33d249acdb33326a"
Jul 27 20:28:04.846583 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.846547    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"]
Jul 27 20:28:04.846951 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.846910    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04f57e6-70c5-44b1-9aac-609bcb42abee" containerName="main"
Jul 27 20:28:04.846951 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.846920    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04f57e6-70c5-44b1-9aac-609bcb42abee" containerName="main"
Jul 27 20:28:04.847028 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.847010    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04f57e6-70c5-44b1-9aac-609bcb42abee" containerName="main"
Jul 27 20:28:04.849788 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.849772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:04.854241 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.854220    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-43d589\"/\"kube-root-ca.crt\""
Jul 27 20:28:04.854382 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.854221    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-43d589\"/\"default-dockercfg-8mh6d\""
Jul 27 20:28:04.854382 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.854221    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-43d589\"/\"sub-test-model-43d589-kserve-self-signed-certs\""
Jul 27 20:28:04.854382 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.854223    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-43d589\"/\"openshift-service-ca.crt\""
Jul 27 20:28:04.860457 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.860424    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"]
Jul 27 20:28:04.906344 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.906312    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-dshm\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:04.906344 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.906345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns6vr\" (UniqueName: \"kubernetes.io/projected/d02774c4-b76b-4e6c-9ca6-6a8b243766da-kube-api-access-ns6vr\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:04.906544 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.906399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-home\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:04.906544 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.906430    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d02774c4-b76b-4e6c-9ca6-6a8b243766da-tls-certs\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:04.906544 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.906450    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-tmp-dir\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:04.906544 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:04.906518    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-model-cache\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.007633 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.007603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-tmp-dir\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.007804 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.007648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-model-cache\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.007804 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.007716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-dshm\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.007804 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.007741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns6vr\" (UniqueName: \"kubernetes.io/projected/d02774c4-b76b-4e6c-9ca6-6a8b243766da-kube-api-access-ns6vr\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.007804 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.007799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-home\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.008012 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.007847    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d02774c4-b76b-4e6c-9ca6-6a8b243766da-tls-certs\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.008206 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.008171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-tmp-dir\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.008206 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.008199    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-model-cache\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.008350 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.008241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-home\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.010235 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.010218    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-dshm\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.010485 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.010468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d02774c4-b76b-4e6c-9ca6-6a8b243766da-tls-certs\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.020667 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.019905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns6vr\" (UniqueName: \"kubernetes.io/projected/d02774c4-b76b-4e6c-9ca6-6a8b243766da-kube-api-access-ns6vr\") pod \"sub-test-model-43d589-kserve-658db85797-ggtzl\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") " pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.160656 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.160570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:05.307703 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.307677    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"]
Jul 27 20:28:05.309907 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:28:05.309882    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd02774c4_b76b_4e6c_9ca6_6a8b243766da.slice/crio-c03b03d7ba966f1e4d2472c3c6e4aaa270847665a857428ef88dac258ec8c20b WatchSource:0}: Error finding container c03b03d7ba966f1e4d2472c3c6e4aaa270847665a857428ef88dac258ec8c20b: Status 404 returned error can't find the container with id c03b03d7ba966f1e4d2472c3c6e4aaa270847665a857428ef88dac258ec8c20b
Jul 27 20:28:05.582158 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.582115    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl" event={"ID":"d02774c4-b76b-4e6c-9ca6-6a8b243766da","Type":"ContainerStarted","Data":"14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7"}
Jul 27 20:28:05.582352 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.582168    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl" event={"ID":"d02774c4-b76b-4e6c-9ca6-6a8b243766da","Type":"ContainerStarted","Data":"c03b03d7ba966f1e4d2472c3c6e4aaa270847665a857428ef88dac258ec8c20b"}
Jul 27 20:28:05.602436 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:05.602368    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl" podStartSLOduration=1.602346613 podStartE2EDuration="1.602346613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:28:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:28:05.599873179 +0000 UTC m=+3846.743077568" watchObservedRunningTime="2026-07-27 20:28:05.602346613 +0000 UTC m=+3846.745550990"
Jul 27 20:28:15.160761 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:15.160717    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:15.161187 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:15.160776    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:15.172984 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:15.172955    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:28:15.644690 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:28:15.644663    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:29:12.673975 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:12.673936    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"]
Jul 27 20:29:27.694598 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.694547    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl" podUID="d02774c4-b76b-4e6c-9ca6-6a8b243766da" containerName="main" containerID="cri-o://14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7" gracePeriod=45
Jul 27 20:29:27.945077 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.945002    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:29:27.954842 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.954826    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns6vr\" (UniqueName: \"kubernetes.io/projected/d02774c4-b76b-4e6c-9ca6-6a8b243766da-kube-api-access-ns6vr\") pod \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") "
Jul 27 20:29:27.954923 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.954892    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-home\") pod \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") "
Jul 27 20:29:27.954971 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.954937    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d02774c4-b76b-4e6c-9ca6-6a8b243766da-tls-certs\") pod \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") "
Jul 27 20:29:27.954971 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.954952    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-tmp-dir\") pod \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") "
Jul 27 20:29:27.955112 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.954978    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-model-cache\") pod \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") "
Jul 27 20:29:27.955112 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.955005    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-dshm\") pod \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\" (UID: \"d02774c4-b76b-4e6c-9ca6-6a8b243766da\") "
Jul 27 20:29:27.955206 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.955145    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-home" (OuterVolumeSpecName: "home") pod "d02774c4-b76b-4e6c-9ca6-6a8b243766da" (UID: "d02774c4-b76b-4e6c-9ca6-6a8b243766da"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:29:27.955310 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.955279    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-model-cache" (OuterVolumeSpecName: "model-cache") pod "d02774c4-b76b-4e6c-9ca6-6a8b243766da" (UID: "d02774c4-b76b-4e6c-9ca6-6a8b243766da"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:29:27.955371 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.955349    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-home\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:29:27.955466 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.955445    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d02774c4-b76b-4e6c-9ca6-6a8b243766da" (UID: "d02774c4-b76b-4e6c-9ca6-6a8b243766da"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:29:27.957266 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.957233    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d02774c4-b76b-4e6c-9ca6-6a8b243766da-kube-api-access-ns6vr" (OuterVolumeSpecName: "kube-api-access-ns6vr") pod "d02774c4-b76b-4e6c-9ca6-6a8b243766da" (UID: "d02774c4-b76b-4e6c-9ca6-6a8b243766da"). InnerVolumeSpecName "kube-api-access-ns6vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:29:27.957266 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.957261    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d02774c4-b76b-4e6c-9ca6-6a8b243766da-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d02774c4-b76b-4e6c-9ca6-6a8b243766da" (UID: "d02774c4-b76b-4e6c-9ca6-6a8b243766da"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:29:27.957440 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:27.957281    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-dshm" (OuterVolumeSpecName: "dshm") pod "d02774c4-b76b-4e6c-9ca6-6a8b243766da" (UID: "d02774c4-b76b-4e6c-9ca6-6a8b243766da"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:29:28.000293 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.000256    2563 generic.go:356] "Generic (PLEG): container finished" podID="d02774c4-b76b-4e6c-9ca6-6a8b243766da" containerID="14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7" exitCode=0
Jul 27 20:29:28.000441 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.000298    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"
Jul 27 20:29:28.000441 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.000301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl" event={"ID":"d02774c4-b76b-4e6c-9ca6-6a8b243766da","Type":"ContainerDied","Data":"14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7"}
Jul 27 20:29:28.000441 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.000339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl" event={"ID":"d02774c4-b76b-4e6c-9ca6-6a8b243766da","Type":"ContainerDied","Data":"c03b03d7ba966f1e4d2472c3c6e4aaa270847665a857428ef88dac258ec8c20b"}
Jul 27 20:29:28.000441 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.000363    2563 scope.go:117] "RemoveContainer" containerID="14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7"
Jul 27 20:29:28.012358 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.010589    2563 scope.go:117] "RemoveContainer" containerID="14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7"
Jul 27 20:29:28.012358 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:29:28.012031    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7\": container with ID starting with 14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7 not found: ID does not exist" containerID="14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7"
Jul 27 20:29:28.012358 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.012089    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7"} err="failed to get container status \"14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7\": rpc error: code = NotFound desc = could not find container \"14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7\": container with ID starting with 14bdbf59167a3a23c6dd10a3690d918887fe7f3ce37138be8aebee9bf7c28bd7 not found: ID does not exist"
Jul 27 20:29:28.032472 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.032448    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"]
Jul 27 20:29:28.041032 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.041010    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-43d589/sub-test-model-43d589-kserve-658db85797-ggtzl"]
Jul 27 20:29:28.056251 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.056231    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-dshm\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:29:28.056251 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.056251    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns6vr\" (UniqueName: \"kubernetes.io/projected/d02774c4-b76b-4e6c-9ca6-6a8b243766da-kube-api-access-ns6vr\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:29:28.056384 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.056261    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d02774c4-b76b-4e6c-9ca6-6a8b243766da-tls-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:29:28.056384 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.056290    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-tmp-dir\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:29:28.056384 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:28.056302    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d02774c4-b76b-4e6c-9ca6-6a8b243766da-model-cache\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:29:29.373002 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:29.372972    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d02774c4-b76b-4e6c-9ca6-6a8b243766da" path="/var/lib/kubelet/pods/d02774c4-b76b-4e6c-9ca6-6a8b243766da/volumes"
Jul 27 20:29:52.246326 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.246235    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"]
Jul 27 20:29:52.246801 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.246661    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d02774c4-b76b-4e6c-9ca6-6a8b243766da" containerName="main"
Jul 27 20:29:52.246801 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.246672    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d02774c4-b76b-4e6c-9ca6-6a8b243766da" containerName="main"
Jul 27 20:29:52.246801 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.246740    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d02774c4-b76b-4e6c-9ca6-6a8b243766da" containerName="main"
Jul 27 20:29:52.249643 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.249629    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.254126 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.254102    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-43d589\"/\"kube-root-ca.crt\""
Jul 27 20:29:52.254267 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.254153    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-43d589\"/\"default-dockercfg-8mh6d\""
Jul 27 20:29:52.254267 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.254177    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-43d589\"/\"openshift-service-ca.crt\""
Jul 27 20:29:52.254267 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.254239    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-43d589\"/\"rate-test-model-43d589-kserve-self-signed-certs\""
Jul 27 20:29:52.259185 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.259166    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"]
Jul 27 20:29:52.372974 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.372937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-dshm\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.373164 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.372988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-tmp-dir\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.373164 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.373072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-model-cache\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.373164 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.373103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htszk\" (UniqueName: \"kubernetes.io/projected/22b68f0f-5116-4d83-8c82-95d0a2d25f87-kube-api-access-htszk\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.373164 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.373136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22b68f0f-5116-4d83-8c82-95d0a2d25f87-tls-certs\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.373309 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.373172    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-home\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.474183 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.474151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-home\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.474347 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.474191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-dshm\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.474347 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.474219    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-tmp-dir\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.474347 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.474250    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-model-cache\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.474347 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.474271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htszk\" (UniqueName: \"kubernetes.io/projected/22b68f0f-5116-4d83-8c82-95d0a2d25f87-kube-api-access-htszk\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.474347 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.474305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22b68f0f-5116-4d83-8c82-95d0a2d25f87-tls-certs\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.474670 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.474644    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-home\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.474670 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.474662    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-tmp-dir\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.474810 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.474703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-model-cache\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.476484 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.476462    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-dshm\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.476806 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.476789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22b68f0f-5116-4d83-8c82-95d0a2d25f87-tls-certs\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.484514 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.484491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htszk\" (UniqueName: \"kubernetes.io/projected/22b68f0f-5116-4d83-8c82-95d0a2d25f87-kube-api-access-htszk\") pod \"rate-test-model-43d589-kserve-585c556b7-528dp\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") " pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.560498 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.560468    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:29:52.704386 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:52.704357    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"]
Jul 27 20:29:53.130560 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:53.130524    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp" event={"ID":"22b68f0f-5116-4d83-8c82-95d0a2d25f87","Type":"ContainerStarted","Data":"c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8"}
Jul 27 20:29:53.130560 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:53.130563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp" event={"ID":"22b68f0f-5116-4d83-8c82-95d0a2d25f87","Type":"ContainerStarted","Data":"9dd6c1aaea8b3022ca2b65fdf00f035816821ac5c1c002e530c0f12cf61d8529"}
Jul 27 20:29:53.151094 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:29:53.151029    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp" podStartSLOduration=1.151014558 podStartE2EDuration="1.151014558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:29:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:29:53.150206075 +0000 UTC m=+3954.293410451" watchObservedRunningTime="2026-07-27 20:29:53.151014558 +0000 UTC m=+3954.294218933"
Jul 27 20:30:00.134896 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:00.134809    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h"]
Jul 27 20:30:00.139618 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:00.139597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h"
Jul 27 20:30:00.142423 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:00.142394    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pljl4\""
Jul 27 20:30:00.146398 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:00.146376    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h"]
Jul 27 20:30:00.154294 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:00.154269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h"
Jul 27 20:30:00.305276 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:00.305171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h"]
Jul 27 20:30:00.307704 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:30:00.307662    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9abf55f_f724_4997_b741_2d689f0994e2.slice/crio-1ce0e2318e3f720574f1ddc0ddf3abaa401d4e464320921da89f6c0b4e0f4a00 WatchSource:0}: Error finding container 1ce0e2318e3f720574f1ddc0ddf3abaa401d4e464320921da89f6c0b4e0f4a00: Status 404 returned error can't find the container with id 1ce0e2318e3f720574f1ddc0ddf3abaa401d4e464320921da89f6c0b4e0f4a00
Jul 27 20:30:01.173893 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:01.173859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h" event={"ID":"b9abf55f-f724-4997-b741-2d689f0994e2","Type":"ContainerStarted","Data":"ffcf413d21ddb57c50072464abfa59e69ea9e6f7baec091f43935d91510e6ac7"}
Jul 27 20:30:01.174301 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:01.173915    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h" event={"ID":"b9abf55f-f724-4997-b741-2d689f0994e2","Type":"ContainerStarted","Data":"1ce0e2318e3f720574f1ddc0ddf3abaa401d4e464320921da89f6c0b4e0f4a00"}
Jul 27 20:30:01.191411 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:01.191356    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h" podStartSLOduration=1.191336315 podStartE2EDuration="1.191336315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:30:01.188851699 +0000 UTC m=+3962.332056080" watchObservedRunningTime="2026-07-27 20:30:01.191336315 +0000 UTC m=+3962.334540692"
Jul 27 20:30:02.180545 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:02.180507    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9abf55f-f724-4997-b741-2d689f0994e2" containerID="ffcf413d21ddb57c50072464abfa59e69ea9e6f7baec091f43935d91510e6ac7" exitCode=0
Jul 27 20:30:02.180949 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:02.180600    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h" event={"ID":"b9abf55f-f724-4997-b741-2d689f0994e2","Type":"ContainerDied","Data":"ffcf413d21ddb57c50072464abfa59e69ea9e6f7baec091f43935d91510e6ac7"}
Jul 27 20:30:02.561458 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:02.561422    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:30:02.561672 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:02.561479    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:30:02.573999 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:02.573974    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:30:03.199272 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:03.199244    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:30:03.342992 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:03.342957    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h"
Jul 27 20:30:04.193707 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:04.193679    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h"
Jul 27 20:30:04.193888 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:04.193718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h" event={"ID":"b9abf55f-f724-4997-b741-2d689f0994e2","Type":"ContainerDied","Data":"1ce0e2318e3f720574f1ddc0ddf3abaa401d4e464320921da89f6c0b4e0f4a00"}
Jul 27 20:30:04.193888 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:04.193760    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ce0e2318e3f720574f1ddc0ddf3abaa401d4e464320921da89f6c0b4e0f4a00"
Jul 27 20:30:04.310484 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:04.310453    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753025-679ml"]
Jul 27 20:30:04.316621 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:04.316600    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753025-679ml"]
Jul 27 20:30:05.372089 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:05.372032    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34f3ad2d-7b45-4199-a950-be745b313a35" path="/var/lib/kubelet/pods/34f3ad2d-7b45-4199-a950-be745b313a35/volumes"
Jul 27 20:30:59.823178 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:30:59.823146    2563 scope.go:117] "RemoveContainer" containerID="0c9bdd0f9bd1d12fc8ea2f749976acd174f1bc151eb6bab57986da94dfd96dbd"
Jul 27 20:31:19.128447 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:19.128411    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"]
Jul 27 20:31:34.147833 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.147712    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp" podUID="22b68f0f-5116-4d83-8c82-95d0a2d25f87" containerName="main" containerID="cri-o://c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8" gracePeriod=45
Jul 27 20:31:34.411224 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.411167    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:31:34.502118 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.502088    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-dshm\") pod \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") "
Jul 27 20:31:34.502118 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.502122    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-home\") pod \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") "
Jul 27 20:31:34.502308 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.502150    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htszk\" (UniqueName: \"kubernetes.io/projected/22b68f0f-5116-4d83-8c82-95d0a2d25f87-kube-api-access-htszk\") pod \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") "
Jul 27 20:31:34.502308 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.502194    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22b68f0f-5116-4d83-8c82-95d0a2d25f87-tls-certs\") pod \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") "
Jul 27 20:31:34.502308 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.502261    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-model-cache\") pod \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") "
Jul 27 20:31:34.502308 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.502290    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-tmp-dir\") pod \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\" (UID: \"22b68f0f-5116-4d83-8c82-95d0a2d25f87\") "
Jul 27 20:31:34.502475 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.502378    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-home" (OuterVolumeSpecName: "home") pod "22b68f0f-5116-4d83-8c82-95d0a2d25f87" (UID: "22b68f0f-5116-4d83-8c82-95d0a2d25f87"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:31:34.502574 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.502550    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-model-cache" (OuterVolumeSpecName: "model-cache") pod "22b68f0f-5116-4d83-8c82-95d0a2d25f87" (UID: "22b68f0f-5116-4d83-8c82-95d0a2d25f87"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:31:34.502662 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.502634    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "22b68f0f-5116-4d83-8c82-95d0a2d25f87" (UID: "22b68f0f-5116-4d83-8c82-95d0a2d25f87"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:31:34.502715 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.502674    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-model-cache\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:31:34.502715 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.502694    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-home\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:31:34.504430 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.504398    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22b68f0f-5116-4d83-8c82-95d0a2d25f87-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "22b68f0f-5116-4d83-8c82-95d0a2d25f87" (UID: "22b68f0f-5116-4d83-8c82-95d0a2d25f87"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:31:34.504532 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.504445    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-dshm" (OuterVolumeSpecName: "dshm") pod "22b68f0f-5116-4d83-8c82-95d0a2d25f87" (UID: "22b68f0f-5116-4d83-8c82-95d0a2d25f87"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:31:34.504532 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.504481    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22b68f0f-5116-4d83-8c82-95d0a2d25f87-kube-api-access-htszk" (OuterVolumeSpecName: "kube-api-access-htszk") pod "22b68f0f-5116-4d83-8c82-95d0a2d25f87" (UID: "22b68f0f-5116-4d83-8c82-95d0a2d25f87"). InnerVolumeSpecName "kube-api-access-htszk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:31:34.603869 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.603842    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-tmp-dir\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:31:34.603869 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.603866    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22b68f0f-5116-4d83-8c82-95d0a2d25f87-dshm\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:31:34.603869 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.603875    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htszk\" (UniqueName: \"kubernetes.io/projected/22b68f0f-5116-4d83-8c82-95d0a2d25f87-kube-api-access-htszk\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:31:34.604104 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.603884    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22b68f0f-5116-4d83-8c82-95d0a2d25f87-tls-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:31:34.669284 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.669213    2563 generic.go:356] "Generic (PLEG): container finished" podID="22b68f0f-5116-4d83-8c82-95d0a2d25f87" containerID="c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8" exitCode=0
Jul 27 20:31:34.669284 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.669251    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"
Jul 27 20:31:34.669432 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.669308    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp" event={"ID":"22b68f0f-5116-4d83-8c82-95d0a2d25f87","Type":"ContainerDied","Data":"c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8"}
Jul 27 20:31:34.669432 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.669348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp" event={"ID":"22b68f0f-5116-4d83-8c82-95d0a2d25f87","Type":"ContainerDied","Data":"9dd6c1aaea8b3022ca2b65fdf00f035816821ac5c1c002e530c0f12cf61d8529"}
Jul 27 20:31:34.669432 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.669366    2563 scope.go:117] "RemoveContainer" containerID="c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8"
Jul 27 20:31:34.678564 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.678545    2563 scope.go:117] "RemoveContainer" containerID="c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8"
Jul 27 20:31:34.678812 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:31:34.678793    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8\": container with ID starting with c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8 not found: ID does not exist" containerID="c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8"
Jul 27 20:31:34.678888 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.678821    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8"} err="failed to get container status \"c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8\": rpc error: code = NotFound desc = could not find container \"c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8\": container with ID starting with c5552430869ca401354218c7cab031adaa7b5ca765f16bbd06715bddd0988db8 not found: ID does not exist"
Jul 27 20:31:34.692338 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.692311    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"]
Jul 27 20:31:34.696859 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.696824    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-43d589/rate-test-model-43d589-kserve-585c556b7-528dp"]
Jul 27 20:31:34.866935 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.866900    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7350-140181158098816"]
Jul 27 20:31:34.867344 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.867328    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22b68f0f-5116-4d83-8c82-95d0a2d25f87" containerName="main"
Jul 27 20:31:34.867423 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.867346    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="22b68f0f-5116-4d83-8c82-95d0a2d25f87" containerName="main"
Jul 27 20:31:34.867423 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.867366    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9abf55f-f724-4997-b741-2d689f0994e2" containerName="cleanup"
Jul 27 20:31:34.867423 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.867374    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9abf55f-f724-4997-b741-2d689f0994e2" containerName="cleanup"
Jul 27 20:31:34.867594 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.867481    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9abf55f-f724-4997-b741-2d689f0994e2" containerName="cleanup"
Jul 27 20:31:34.867594 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.867494    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="22b68f0f-5116-4d83-8c82-95d0a2d25f87" containerName="main"
Jul 27 20:31:34.871915 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.871895    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158098816"
Jul 27 20:31:34.874519 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.874503    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2wsq4\""
Jul 27 20:31:34.878310 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:34.878288    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140181158098816"]
Jul 27 20:31:35.009003 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:35.008919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2885g\" (UniqueName: \"kubernetes.io/projected/0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658-kube-api-access-2885g\") pod \"test-curl-7350-140181158098816\" (UID: \"0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658\") " pod="opendatahub/test-curl-7350-140181158098816"
Jul 27 20:31:35.110002 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:35.109970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2885g\" (UniqueName: \"kubernetes.io/projected/0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658-kube-api-access-2885g\") pod \"test-curl-7350-140181158098816\" (UID: \"0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658\") " pod="opendatahub/test-curl-7350-140181158098816"
Jul 27 20:31:35.118993 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:35.118961    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2885g\" (UniqueName: \"kubernetes.io/projected/0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658-kube-api-access-2885g\") pod \"test-curl-7350-140181158098816\" (UID: \"0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658\") " pod="opendatahub/test-curl-7350-140181158098816"
Jul 27 20:31:35.182768 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:35.182737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158098816"
Jul 27 20:31:35.318660 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:35.318625    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140181158098816"]
Jul 27 20:31:35.321353 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:31:35.321327    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ebb0c8a_f1eb_4b18_9ba5_dbff881ef658.slice/crio-34bf3ba5c63b14a7154c69f8ed6cbda175766e3ab0280811754d075d57780116 WatchSource:0}: Error finding container 34bf3ba5c63b14a7154c69f8ed6cbda175766e3ab0280811754d075d57780116: Status 404 returned error can't find the container with id 34bf3ba5c63b14a7154c69f8ed6cbda175766e3ab0280811754d075d57780116
Jul 27 20:31:35.322602 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:35.322584    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:31:35.372310 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:35.372279    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22b68f0f-5116-4d83-8c82-95d0a2d25f87" path="/var/lib/kubelet/pods/22b68f0f-5116-4d83-8c82-95d0a2d25f87/volumes"
Jul 27 20:31:35.677827 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:35.677789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140181158098816" event={"ID":"0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658","Type":"ContainerStarted","Data":"34bf3ba5c63b14a7154c69f8ed6cbda175766e3ab0280811754d075d57780116"}
Jul 27 20:31:36.685180 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:36.685148    2563 generic.go:356] "Generic (PLEG): container finished" podID="0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658" containerID="1bb00001365f54fb0d942c75f258e954177cd8c7773824e19e7d5c11ac9d40c2" exitCode=0
Jul 27 20:31:36.685576 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:36.685226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140181158098816" event={"ID":"0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658","Type":"ContainerDied","Data":"1bb00001365f54fb0d942c75f258e954177cd8c7773824e19e7d5c11ac9d40c2"}
Jul 27 20:31:37.832551 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:37.832526    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158098816"
Jul 27 20:31:37.864930 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:37.864888    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7350-140181158098816_0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658/test-curl-7350-140181158098816/0.log"
Jul 27 20:31:37.887652 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:37.887616    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7350-140181158098816"]
Jul 27 20:31:37.891999 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:37.891976    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7350-140181158098816"]
Jul 27 20:31:37.937527 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:37.937498    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2885g\" (UniqueName: \"kubernetes.io/projected/0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658-kube-api-access-2885g\") pod \"0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658\" (UID: \"0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658\") "
Jul 27 20:31:37.939820 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:37.939794    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658-kube-api-access-2885g" (OuterVolumeSpecName: "kube-api-access-2885g") pod "0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658" (UID: "0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658"). InnerVolumeSpecName "kube-api-access-2885g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:31:38.038607 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.038563    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2885g\" (UniqueName: \"kubernetes.io/projected/0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658-kube-api-access-2885g\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:31:38.646446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.646404    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"]
Jul 27 20:31:38.646789 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.646777    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658" containerName="test-curl-7350-140181158098816"
Jul 27 20:31:38.646836 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.646791    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658" containerName="test-curl-7350-140181158098816"
Jul 27 20:31:38.646872 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.646854    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658" containerName="test-curl-7350-140181158098816"
Jul 27 20:31:38.649976 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.649956    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.652645 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.652624    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-4ac78b-openshift-default-dockercfg-qrpj5\""
Jul 27 20:31:38.663004 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.662978    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"]
Jul 27 20:31:38.698113 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.698088    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158098816"
Jul 27 20:31:38.698277 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.698085    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34bf3ba5c63b14a7154c69f8ed6cbda175766e3ab0280811754d075d57780116"
Jul 27 20:31:38.708424 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:31:38.708394    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7350-140181158098816\" is forbidden: User \"system:node:ip-10-0-134-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-17.ec2.internal' and this object" podUID="0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658" pod="opendatahub/test-curl-7350-140181158098816"
Jul 27 20:31:38.745533 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.745502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-credential-socket\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.745703 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.745556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85470f85-351c-4959-ad61-37e85067df1f-istio-token\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.745703 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.745631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-workload-socket\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.745703 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.745661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-istio-envoy\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.745703 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.745686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4248h\" (UniqueName: \"kubernetes.io/projected/85470f85-351c-4959-ad61-37e85067df1f-kube-api-access-4248h\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.745884 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.745711    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-istio-data\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.745884 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.745766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-workload-certs\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.745884 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.745786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85470f85-351c-4959-ad61-37e85067df1f-istiod-ca-cert\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.745884 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.745815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85470f85-351c-4959-ad61-37e85067df1f-istio-podinfo\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.846346 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.846313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-workload-socket\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.846346 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.846356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-istio-envoy\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.846896 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.846483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4248h\" (UniqueName: \"kubernetes.io/projected/85470f85-351c-4959-ad61-37e85067df1f-kube-api-access-4248h\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.846896 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.846521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-istio-data\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.846896 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.846569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-workload-certs\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.846896 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.846588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85470f85-351c-4959-ad61-37e85067df1f-istiod-ca-cert\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.846896 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.846608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85470f85-351c-4959-ad61-37e85067df1f-istio-podinfo\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.846896 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.846648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-credential-socket\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.846896 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.846700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85470f85-351c-4959-ad61-37e85067df1f-istio-token\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.847461 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.846940    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-workload-certs\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.847461 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.846973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-workload-socket\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.847461 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.846974    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-istio-data\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.847461 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.847196    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-credential-socket\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.847461 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.847269    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85470f85-351c-4959-ad61-37e85067df1f-istiod-ca-cert\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.848913 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.848889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-istio-envoy\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.849122 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.849103    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85470f85-351c-4959-ad61-37e85067df1f-istio-podinfo\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.855227 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.855208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85470f85-351c-4959-ad61-37e85067df1f-istio-token\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.855320 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.855269    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4248h\" (UniqueName: \"kubernetes.io/projected/85470f85-351c-4959-ad61-37e85067df1f-kube-api-access-4248h\") pod \"e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") " pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:38.961313 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:38.961228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:39.110672 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:39.110647    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"]
Jul 27 20:31:39.113345 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:31:39.113302    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85470f85_351c_4959_ad61_37e85067df1f.slice/crio-a0933bf7c66409328b729e196acd4a5b1fffdce34f2f7ae9d118aa12b4eee80e WatchSource:0}: Error finding container a0933bf7c66409328b729e196acd4a5b1fffdce34f2f7ae9d118aa12b4eee80e: Status 404 returned error can't find the container with id a0933bf7c66409328b729e196acd4a5b1fffdce34f2f7ae9d118aa12b4eee80e
Jul 27 20:31:39.115724 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:39.115691    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:31:39.115804 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:39.115756    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:31:39.115804 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:39.115786    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:31:39.372318 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:31:39.372280    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7350-140181158098816\" is forbidden: User \"system:node:ip-10-0-134-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-17.ec2.internal' and this object" podUID="0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658" pod="opendatahub/test-curl-7350-140181158098816"
Jul 27 20:31:39.373612 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:39.373578    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658" path="/var/lib/kubelet/pods/0ebb0c8a-f1eb-4b18-9ba5-dbff881ef658/volumes"
Jul 27 20:31:39.705549 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:39.705459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" event={"ID":"85470f85-351c-4959-ad61-37e85067df1f","Type":"ContainerStarted","Data":"41ad8f61d9b4a86c5629d120e401864fef47b779977c66e3b4c6377aa0ff6742"}
Jul 27 20:31:39.705549 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:39.705516    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" event={"ID":"85470f85-351c-4959-ad61-37e85067df1f","Type":"ContainerStarted","Data":"a0933bf7c66409328b729e196acd4a5b1fffdce34f2f7ae9d118aa12b4eee80e"}
Jul 27 20:31:39.728013 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:39.727951    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" podStartSLOduration=1.7279325779999999 podStartE2EDuration="1.727932578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:31:39.725779822 +0000 UTC m=+4060.868984211" watchObservedRunningTime="2026-07-27 20:31:39.727932578 +0000 UTC m=+4060.871136953"
Jul 27 20:31:39.961793 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:39.961696    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:40.966917 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:40.966882    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:41.715894 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:41.715858    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:41.716768 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:41.716747    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:31:57.759232 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:57.759184    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 20:31:57.759707 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:57.759279    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:31:59.811572 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:59.811537    2563 generic.go:356] "Generic (PLEG): container finished" podID="85470f85-351c-4959-ad61-37e85067df1f" containerID="41ad8f61d9b4a86c5629d120e401864fef47b779977c66e3b4c6377aa0ff6742" exitCode=0
Jul 27 20:31:59.811995 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:59.811609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" event={"ID":"85470f85-351c-4959-ad61-37e85067df1f","Type":"ContainerDied","Data":"41ad8f61d9b4a86c5629d120e401864fef47b779977c66e3b4c6377aa0ff6742"}
Jul 27 20:31:59.812073 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:59.812016    2563 scope.go:117] "RemoveContainer" containerID="41ad8f61d9b4a86c5629d120e401864fef47b779977c66e3b4c6377aa0ff6742"
Jul 27 20:31:59.813200 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:59.813173    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:31:59.813277 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:59.813243    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:31:59.813317 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:31:59.813283    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:32:00.819016 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:00.818978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" event={"ID":"85470f85-351c-4959-ad61-37e85067df1f","Type":"ContainerStarted","Data":"23a0da52bd229315c628e1ac9be0cb790ba63ee3e07303251978161cf46c2604"}
Jul 27 20:32:00.961602 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:00.961566    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:32:00.961818 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:00.961796    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 20:32:00.961873 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:00.961850    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 20:32:01.962061 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:01.962005    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 20:32:01.962464 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:01.962082    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 20:32:02.961727 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:02.961690    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 20:32:02.961922 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:02.961744    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 20:32:03.961714 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:03.961680    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 20:32:03.962150 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:03.961736    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 20:32:04.962471 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:04.962430    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 20:32:04.963052 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:04.962503    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 20:32:05.530429 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.530384    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"]
Jul 27 20:32:05.534569 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.534553    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"
Jul 27 20:32:05.537282 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.537256    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-d68d13-dockercfg-88ch4\""
Jul 27 20:32:05.537452 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.537439    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-d68d13\""
Jul 27 20:32:05.545355 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.545331    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"]
Jul 27 20:32:05.631092 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.631020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9snm\" (UniqueName: \"kubernetes.io/projected/42b5d709-05c4-44f8-bc64-175a48ed8c0f-kube-api-access-f9snm\") pod \"payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc\" (UID: \"42b5d709-05c4-44f8-bc64-175a48ed8c0f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"
Jul 27 20:32:05.631309 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.631119    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b5d709-05c4-44f8-bc64-175a48ed8c0f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc\" (UID: \"42b5d709-05c4-44f8-bc64-175a48ed8c0f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"
Jul 27 20:32:05.732100 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.732062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9snm\" (UniqueName: \"kubernetes.io/projected/42b5d709-05c4-44f8-bc64-175a48ed8c0f-kube-api-access-f9snm\") pod \"payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc\" (UID: \"42b5d709-05c4-44f8-bc64-175a48ed8c0f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"
Jul 27 20:32:05.732259 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.732123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b5d709-05c4-44f8-bc64-175a48ed8c0f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc\" (UID: \"42b5d709-05c4-44f8-bc64-175a48ed8c0f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"
Jul 27 20:32:05.732818 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.732800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b5d709-05c4-44f8-bc64-175a48ed8c0f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc\" (UID: \"42b5d709-05c4-44f8-bc64-175a48ed8c0f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"
Jul 27 20:32:05.742115 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.742080    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9snm\" (UniqueName: \"kubernetes.io/projected/42b5d709-05c4-44f8-bc64-175a48ed8c0f-kube-api-access-f9snm\") pod \"payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc\" (UID: \"42b5d709-05c4-44f8-bc64-175a48ed8c0f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"
Jul 27 20:32:05.846786 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.846756    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"
Jul 27 20:32:05.966372 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.966341    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:32:05.966727 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.966618    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:32:05.967509 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:05.967494    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:32:06.190507 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:06.190486    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"]
Jul 27 20:32:06.193077 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:32:06.193018    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b5d709_05c4_44f8_bc64_175a48ed8c0f.slice/crio-e07afae89cf9369e0cbd89f76919f98872ebc56c2df2546fe1dfa08e647c66b8 WatchSource:0}: Error finding container e07afae89cf9369e0cbd89f76919f98872ebc56c2df2546fe1dfa08e647c66b8: Status 404 returned error can't find the container with id e07afae89cf9369e0cbd89f76919f98872ebc56c2df2546fe1dfa08e647c66b8
Jul 27 20:32:06.850341 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:06.850306    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc" event={"ID":"42b5d709-05c4-44f8-bc64-175a48ed8c0f","Type":"ContainerStarted","Data":"ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962"}
Jul 27 20:32:06.850525 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:06.850360    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc" event={"ID":"42b5d709-05c4-44f8-bc64-175a48ed8c0f","Type":"ContainerStarted","Data":"e07afae89cf9369e0cbd89f76919f98872ebc56c2df2546fe1dfa08e647c66b8"}
Jul 27 20:32:06.850525 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:06.850391    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"
Jul 27 20:32:06.867654 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:06.867603    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc" podStartSLOduration=1.8675883020000001 podStartE2EDuration="1.867588302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:32:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:32:06.866949321 +0000 UTC m=+4088.010153702" watchObservedRunningTime="2026-07-27 20:32:06.867588302 +0000 UTC m=+4088.010792677"
Jul 27 20:32:17.857632 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:17.857599    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"
Jul 27 20:32:29.564606 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:29.564567    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc_42b5d709-05c4-44f8-bc64-175a48ed8c0f/payload-processing/0.log"
Jul 27 20:32:44.639728 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.639698    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"]
Jul 27 20:32:44.642622 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.642602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.645520 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.645498    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-4ac78b\"/\"openshift-service-ca.crt\""
Jul 27 20:32:44.645631 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.645559    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-4ac78b\"/\"kube-root-ca.crt\""
Jul 27 20:32:44.646954 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.646935    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-4ac78b\"/\"default-dockercfg-5b4zf\""
Jul 27 20:32:44.646954 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.646954    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-4ac78b\"/\"ipp-route-4ac78b-kserve-self-signed-certs\""
Jul 27 20:32:44.652834 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.652806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"]
Jul 27 20:32:44.698107 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.698070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-model-cache\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.698295 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.698188    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-home\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.698295 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.698239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-tmp-dir\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.698295 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.698266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fwjd\" (UniqueName: \"kubernetes.io/projected/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-kube-api-access-9fwjd\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.698295 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.698286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-dshm\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.698455 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.698335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-tls-certs\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.799778 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.799746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-tmp-dir\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.799979 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.799794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwjd\" (UniqueName: \"kubernetes.io/projected/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-kube-api-access-9fwjd\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.799979 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.799828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-dshm\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.799979 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.799853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-tls-certs\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.799979 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.799927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-model-cache\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.800284 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.800020    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-home\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.800284 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.800250    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-tmp-dir\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.800446 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.800424    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-home\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.800864 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.800835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-model-cache\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.803807 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.803780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-dshm\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.803939 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.803859    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-tls-certs\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.811062 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.811013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fwjd\" (UniqueName: \"kubernetes.io/projected/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-kube-api-access-9fwjd\") pod \"ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") " pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:44.953324 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:44.953225    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:45.092857 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:45.092831    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"]
Jul 27 20:32:45.095336 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:32:45.095307    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80ac4596_b8f2_415c_a28d_8fbd448f1c3a.slice/crio-30b717bf5ccf2404cde7cd5934baa0ca2321f0d5e9dfc5649d8a73ca1f98ebf1 WatchSource:0}: Error finding container 30b717bf5ccf2404cde7cd5934baa0ca2321f0d5e9dfc5649d8a73ca1f98ebf1: Status 404 returned error can't find the container with id 30b717bf5ccf2404cde7cd5934baa0ca2321f0d5e9dfc5649d8a73ca1f98ebf1
Jul 27 20:32:46.071856 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:46.071811    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2" event={"ID":"80ac4596-b8f2-415c-a28d-8fbd448f1c3a","Type":"ContainerStarted","Data":"da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722"}
Jul 27 20:32:46.071856 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:46.071863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2" event={"ID":"80ac4596-b8f2-415c-a28d-8fbd448f1c3a","Type":"ContainerStarted","Data":"30b717bf5ccf2404cde7cd5934baa0ca2321f0d5e9dfc5649d8a73ca1f98ebf1"}
Jul 27 20:32:46.090202 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:46.090142    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2" podStartSLOduration=2.090124598 podStartE2EDuration="2.090124598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:32:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:32:46.089071887 +0000 UTC m=+4127.232276263" watchObservedRunningTime="2026-07-27 20:32:46.090124598 +0000 UTC m=+4127.233329020"
Jul 27 20:32:54.954364 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:54.954274    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:54.954364 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:54.954337    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:54.966448 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:54.966422    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:32:55.129330 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:32:55.129301    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:33:26.811563 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:33:26.811536    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc_42b5d709-05c4-44f8-bc64-175a48ed8c0f/payload-processing/0.log"
Jul 27 20:34:47.475516 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:34:47.475477    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"]
Jul 27 20:35:02.495633 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.495593    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2" podUID="80ac4596-b8f2-415c-a28d-8fbd448f1c3a" containerName="main" containerID="cri-o://da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722" gracePeriod=45
Jul 27 20:35:02.749894 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.749837    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:35:02.787073 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.787015    2563 generic.go:356] "Generic (PLEG): container finished" podID="80ac4596-b8f2-415c-a28d-8fbd448f1c3a" containerID="da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722" exitCode=0
Jul 27 20:35:02.787235 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.787104    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"
Jul 27 20:35:02.787235 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.787101    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2" event={"ID":"80ac4596-b8f2-415c-a28d-8fbd448f1c3a","Type":"ContainerDied","Data":"da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722"}
Jul 27 20:35:02.787235 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.787195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2" event={"ID":"80ac4596-b8f2-415c-a28d-8fbd448f1c3a","Type":"ContainerDied","Data":"30b717bf5ccf2404cde7cd5934baa0ca2321f0d5e9dfc5649d8a73ca1f98ebf1"}
Jul 27 20:35:02.787235 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.787222    2563 scope.go:117] "RemoveContainer" containerID="da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722"
Jul 27 20:35:02.796860 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.796827    2563 scope.go:117] "RemoveContainer" containerID="da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722"
Jul 27 20:35:02.797203 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:35:02.797179    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722\": container with ID starting with da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722 not found: ID does not exist" containerID="da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722"
Jul 27 20:35:02.797287 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.797220    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722"} err="failed to get container status \"da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722\": rpc error: code = NotFound desc = could not find container \"da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722\": container with ID starting with da960c6716f635fe83fad5188a78ba6fd7fe72f6fad6405b2dfaed8a994d3722 not found: ID does not exist"
Jul 27 20:35:02.900968 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.900941    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fwjd\" (UniqueName: \"kubernetes.io/projected/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-kube-api-access-9fwjd\") pod \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") "
Jul 27 20:35:02.901167 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.901004    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-model-cache\") pod \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") "
Jul 27 20:35:02.901167 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.901079    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-dshm\") pod \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") "
Jul 27 20:35:02.901167 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.901111    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-tls-certs\") pod \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") "
Jul 27 20:35:02.901295 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.901184    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-tmp-dir\") pod \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") "
Jul 27 20:35:02.901295 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.901215    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-home\") pod \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\" (UID: \"80ac4596-b8f2-415c-a28d-8fbd448f1c3a\") "
Jul 27 20:35:02.901386 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.901298    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-model-cache" (OuterVolumeSpecName: "model-cache") pod "80ac4596-b8f2-415c-a28d-8fbd448f1c3a" (UID: "80ac4596-b8f2-415c-a28d-8fbd448f1c3a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:35:02.901474 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.901431    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "80ac4596-b8f2-415c-a28d-8fbd448f1c3a" (UID: "80ac4596-b8f2-415c-a28d-8fbd448f1c3a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:35:02.901538 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.901493    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-home" (OuterVolumeSpecName: "home") pod "80ac4596-b8f2-415c-a28d-8fbd448f1c3a" (UID: "80ac4596-b8f2-415c-a28d-8fbd448f1c3a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:35:02.901593 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.901581    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-model-cache\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:02.901654 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.901601    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-tmp-dir\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:02.901654 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.901614    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-home\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:02.903372 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.903345    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-dshm" (OuterVolumeSpecName: "dshm") pod "80ac4596-b8f2-415c-a28d-8fbd448f1c3a" (UID: "80ac4596-b8f2-415c-a28d-8fbd448f1c3a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:35:02.903477 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.903404    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-kube-api-access-9fwjd" (OuterVolumeSpecName: "kube-api-access-9fwjd") pod "80ac4596-b8f2-415c-a28d-8fbd448f1c3a" (UID: "80ac4596-b8f2-415c-a28d-8fbd448f1c3a"). InnerVolumeSpecName "kube-api-access-9fwjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:35:02.903477 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:02.903412    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "80ac4596-b8f2-415c-a28d-8fbd448f1c3a" (UID: "80ac4596-b8f2-415c-a28d-8fbd448f1c3a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:35:03.002351 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:03.002280    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-dshm\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:03.002351 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:03.002306    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-tls-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:03.002351 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:03.002317    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fwjd\" (UniqueName: \"kubernetes.io/projected/80ac4596-b8f2-415c-a28d-8fbd448f1c3a-kube-api-access-9fwjd\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:03.110560 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:03.110518    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"]
Jul 27 20:35:03.112939 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:03.112910    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-4ac78b/ipp-route-4ac78b-kserve-7f9f9745d7-rnlj2"]
Jul 27 20:35:03.372546 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:03.372510    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80ac4596-b8f2-415c-a28d-8fbd448f1c3a" path="/var/lib/kubelet/pods/80ac4596-b8f2-415c-a28d-8fbd448f1c3a/volumes"
Jul 27 20:35:40.803354 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:40.803317    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"]
Jul 27 20:35:40.803841 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:40.803621    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy" containerID="cri-o://23a0da52bd229315c628e1ac9be0cb790ba63ee3e07303251978161cf46c2604" gracePeriod=30
Jul 27 20:35:46.008089 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.008051    2563 generic.go:356] "Generic (PLEG): container finished" podID="85470f85-351c-4959-ad61-37e85067df1f" containerID="23a0da52bd229315c628e1ac9be0cb790ba63ee3e07303251978161cf46c2604" exitCode=0
Jul 27 20:35:46.008473 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.008093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" event={"ID":"85470f85-351c-4959-ad61-37e85067df1f","Type":"ContainerDied","Data":"23a0da52bd229315c628e1ac9be0cb790ba63ee3e07303251978161cf46c2604"}
Jul 27 20:35:46.008473 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.008143    2563 scope.go:117] "RemoveContainer" containerID="41ad8f61d9b4a86c5629d120e401864fef47b779977c66e3b4c6377aa0ff6742"
Jul 27 20:35:46.066027 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.065977    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:35:46.197328 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.197296    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-workload-certs\") pod \"85470f85-351c-4959-ad61-37e85067df1f\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") "
Jul 27 20:35:46.197480 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.197353    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85470f85-351c-4959-ad61-37e85067df1f-istio-podinfo\") pod \"85470f85-351c-4959-ad61-37e85067df1f\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") "
Jul 27 20:35:46.197480 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.197412    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-istio-data\") pod \"85470f85-351c-4959-ad61-37e85067df1f\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") "
Jul 27 20:35:46.197480 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.197462    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85470f85-351c-4959-ad61-37e85067df1f-istio-token\") pod \"85470f85-351c-4959-ad61-37e85067df1f\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") "
Jul 27 20:35:46.197655 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.197494    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85470f85-351c-4959-ad61-37e85067df1f-istiod-ca-cert\") pod \"85470f85-351c-4959-ad61-37e85067df1f\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") "
Jul 27 20:35:46.197655 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.197582    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-istio-envoy\") pod \"85470f85-351c-4959-ad61-37e85067df1f\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") "
Jul 27 20:35:46.197655 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.197618    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-credential-socket\") pod \"85470f85-351c-4959-ad61-37e85067df1f\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") "
Jul 27 20:35:46.197655 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.197652    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-workload-socket\") pod \"85470f85-351c-4959-ad61-37e85067df1f\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") "
Jul 27 20:35:46.197869 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.197708    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4248h\" (UniqueName: \"kubernetes.io/projected/85470f85-351c-4959-ad61-37e85067df1f-kube-api-access-4248h\") pod \"85470f85-351c-4959-ad61-37e85067df1f\" (UID: \"85470f85-351c-4959-ad61-37e85067df1f\") "
Jul 27 20:35:46.197869 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.197617    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85470f85-351c-4959-ad61-37e85067df1f" (UID: "85470f85-351c-4959-ad61-37e85067df1f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:35:46.197971 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.197930    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85470f85-351c-4959-ad61-37e85067df1f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85470f85-351c-4959-ad61-37e85067df1f" (UID: "85470f85-351c-4959-ad61-37e85067df1f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:35:46.198188 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.198124    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:46.198188 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.198148    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85470f85-351c-4959-ad61-37e85067df1f-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:46.198403 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.198202    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85470f85-351c-4959-ad61-37e85067df1f" (UID: "85470f85-351c-4959-ad61-37e85067df1f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:35:46.198403 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.198270    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85470f85-351c-4959-ad61-37e85067df1f" (UID: "85470f85-351c-4959-ad61-37e85067df1f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:35:46.198522 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.198450    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-istio-data" (OuterVolumeSpecName: "istio-data") pod "85470f85-351c-4959-ad61-37e85067df1f" (UID: "85470f85-351c-4959-ad61-37e85067df1f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:35:46.200078 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.200054    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85470f85-351c-4959-ad61-37e85067df1f" (UID: "85470f85-351c-4959-ad61-37e85067df1f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:35:46.200387 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.200128    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85470f85-351c-4959-ad61-37e85067df1f-kube-api-access-4248h" (OuterVolumeSpecName: "kube-api-access-4248h") pod "85470f85-351c-4959-ad61-37e85067df1f" (UID: "85470f85-351c-4959-ad61-37e85067df1f"). InnerVolumeSpecName "kube-api-access-4248h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:35:46.200387 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.200247    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85470f85-351c-4959-ad61-37e85067df1f-istio-token" (OuterVolumeSpecName: "istio-token") pod "85470f85-351c-4959-ad61-37e85067df1f" (UID: "85470f85-351c-4959-ad61-37e85067df1f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:35:46.200387 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.200251    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85470f85-351c-4959-ad61-37e85067df1f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85470f85-351c-4959-ad61-37e85067df1f" (UID: "85470f85-351c-4959-ad61-37e85067df1f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:35:46.298910 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.298875    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:46.298910 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.298906    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4248h\" (UniqueName: \"kubernetes.io/projected/85470f85-351c-4959-ad61-37e85067df1f-kube-api-access-4248h\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:46.298910 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.298920    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85470f85-351c-4959-ad61-37e85067df1f-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:46.299173 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.298931    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:46.299173 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.298942    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85470f85-351c-4959-ad61-37e85067df1f-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:46.299173 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.298952    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:46.299173 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:46.298963    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85470f85-351c-4959-ad61-37e85067df1f-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:47.014872 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:47.014838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq" event={"ID":"85470f85-351c-4959-ad61-37e85067df1f","Type":"ContainerDied","Data":"a0933bf7c66409328b729e196acd4a5b1fffdce34f2f7ae9d118aa12b4eee80e"}
Jul 27 20:35:47.015326 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:47.014882    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"
Jul 27 20:35:47.015326 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:47.014922    2563 scope.go:117] "RemoveContainer" containerID="23a0da52bd229315c628e1ac9be0cb790ba63ee3e07303251978161cf46c2604"
Jul 27 20:35:47.040088 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:47.040062    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"]
Jul 27 20:35:47.044961 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:47.044939    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-4ac78b-openshift-default-76b5bb98b8-9pvfq"]
Jul 27 20:35:47.372064 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:47.372023    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85470f85-351c-4959-ad61-37e85067df1f" path="/var/lib/kubelet/pods/85470f85-351c-4959-ad61-37e85067df1f/volumes"
Jul 27 20:35:52.383230 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:52.383145    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"]
Jul 27 20:35:52.383701 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:52.383473    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc" podUID="42b5d709-05c4-44f8-bc64-175a48ed8c0f" containerName="payload-processing" containerID="cri-o://ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962" gracePeriod=30
Jul 27 20:35:52.652711 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:52.652685    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"
Jul 27 20:35:52.755349 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:52.755313    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b5d709-05c4-44f8-bc64-175a48ed8c0f-plugins-config-volume\") pod \"42b5d709-05c4-44f8-bc64-175a48ed8c0f\" (UID: \"42b5d709-05c4-44f8-bc64-175a48ed8c0f\") "
Jul 27 20:35:52.755533 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:52.755457    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9snm\" (UniqueName: \"kubernetes.io/projected/42b5d709-05c4-44f8-bc64-175a48ed8c0f-kube-api-access-f9snm\") pod \"42b5d709-05c4-44f8-bc64-175a48ed8c0f\" (UID: \"42b5d709-05c4-44f8-bc64-175a48ed8c0f\") "
Jul 27 20:35:52.755724 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:52.755697    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42b5d709-05c4-44f8-bc64-175a48ed8c0f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "42b5d709-05c4-44f8-bc64-175a48ed8c0f" (UID: "42b5d709-05c4-44f8-bc64-175a48ed8c0f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:35:52.757655 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:52.757629    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42b5d709-05c4-44f8-bc64-175a48ed8c0f-kube-api-access-f9snm" (OuterVolumeSpecName: "kube-api-access-f9snm") pod "42b5d709-05c4-44f8-bc64-175a48ed8c0f" (UID: "42b5d709-05c4-44f8-bc64-175a48ed8c0f"). InnerVolumeSpecName "kube-api-access-f9snm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:35:52.856205 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:52.856176    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9snm\" (UniqueName: \"kubernetes.io/projected/42b5d709-05c4-44f8-bc64-175a48ed8c0f-kube-api-access-f9snm\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:52.856205 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:52.856202    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b5d709-05c4-44f8-bc64-175a48ed8c0f-plugins-config-volume\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:35:53.047535 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:53.047437    2563 generic.go:356] "Generic (PLEG): container finished" podID="42b5d709-05c4-44f8-bc64-175a48ed8c0f" containerID="ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962" exitCode=0
Jul 27 20:35:53.047535 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:53.047496    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"
Jul 27 20:35:53.047765 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:53.047537    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc" event={"ID":"42b5d709-05c4-44f8-bc64-175a48ed8c0f","Type":"ContainerDied","Data":"ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962"}
Jul 27 20:35:53.047765 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:53.047632    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc" event={"ID":"42b5d709-05c4-44f8-bc64-175a48ed8c0f","Type":"ContainerDied","Data":"e07afae89cf9369e0cbd89f76919f98872ebc56c2df2546fe1dfa08e647c66b8"}
Jul 27 20:35:53.047765 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:53.047663    2563 scope.go:117] "RemoveContainer" containerID="ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962"
Jul 27 20:35:53.056916 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:53.056895    2563 scope.go:117] "RemoveContainer" containerID="ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962"
Jul 27 20:35:53.057184 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:35:53.057164    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962\": container with ID starting with ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962 not found: ID does not exist" containerID="ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962"
Jul 27 20:35:53.057265 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:53.057192    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962"} err="failed to get container status \"ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962\": rpc error: code = NotFound desc = could not find container \"ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962\": container with ID starting with ccda064406a0ff685895c9af87ce33fdab074984a7de21d08c7afe85d2d9d962 not found: ID does not exist"
Jul 27 20:35:53.070395 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:53.070372    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"]
Jul 27 20:35:53.074825 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:53.074803    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d68d13-7d695dffb4-hfpfc"]
Jul 27 20:35:53.372954 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:35:53.372917    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42b5d709-05c4-44f8-bc64-175a48ed8c0f" path="/var/lib/kubelet/pods/42b5d709-05c4-44f8-bc64-175a48ed8c0f/volumes"
Jul 27 20:36:03.769473 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769435    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh"]
Jul 27 20:36:03.769844 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769814    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80ac4596-b8f2-415c-a28d-8fbd448f1c3a" containerName="main"
Jul 27 20:36:03.769844 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769828    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="80ac4596-b8f2-415c-a28d-8fbd448f1c3a" containerName="main"
Jul 27 20:36:03.769926 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769848    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy"
Jul 27 20:36:03.769926 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769853    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy"
Jul 27 20:36:03.769926 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769869    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy"
Jul 27 20:36:03.769926 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769875    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy"
Jul 27 20:36:03.769926 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769885    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b5d709-05c4-44f8-bc64-175a48ed8c0f" containerName="payload-processing"
Jul 27 20:36:03.769926 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769892    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b5d709-05c4-44f8-bc64-175a48ed8c0f" containerName="payload-processing"
Jul 27 20:36:03.770147 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769954    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42b5d709-05c4-44f8-bc64-175a48ed8c0f" containerName="payload-processing"
Jul 27 20:36:03.770147 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769962    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="80ac4596-b8f2-415c-a28d-8fbd448f1c3a" containerName="main"
Jul 27 20:36:03.770147 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769970    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy"
Jul 27 20:36:03.770147 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.769978    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="85470f85-351c-4959-ad61-37e85067df1f" containerName="istio-proxy"
Jul 27 20:36:03.774421 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.774401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh"
Jul 27 20:36:03.777285 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.777262    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 20:36:03.777406 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.777325    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pljl4\""
Jul 27 20:36:03.782069 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.781706    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh"]
Jul 27 20:36:03.958066 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:03.958008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea952d0-7dbc-4d38-9bc7-4d9abe173da7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh\" (UID: \"cea952d0-7dbc-4d38-9bc7-4d9abe173da7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh"
Jul 27 20:36:04.058681 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:04.058651    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea952d0-7dbc-4d38-9bc7-4d9abe173da7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh\" (UID: \"cea952d0-7dbc-4d38-9bc7-4d9abe173da7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh"
Jul 27 20:36:04.059315 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:04.059290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea952d0-7dbc-4d38-9bc7-4d9abe173da7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh\" (UID: \"cea952d0-7dbc-4d38-9bc7-4d9abe173da7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh"
Jul 27 20:36:04.087678 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:04.087647    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh"
Jul 27 20:36:04.430598 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:04.430574    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh"]
Jul 27 20:36:04.432746 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:36:04.432712    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea952d0_7dbc_4d38_9bc7_4d9abe173da7.slice/crio-6da06eb0c57f5228a42550402c9284eb2df77649b3b784f7ac08d4ea82573a27 WatchSource:0}: Error finding container 6da06eb0c57f5228a42550402c9284eb2df77649b3b784f7ac08d4ea82573a27: Status 404 returned error can't find the container with id 6da06eb0c57f5228a42550402c9284eb2df77649b3b784f7ac08d4ea82573a27
Jul 27 20:36:05.111502 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:05.111466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh" event={"ID":"cea952d0-7dbc-4d38-9bc7-4d9abe173da7","Type":"ContainerStarted","Data":"551cd2813df1a6bc13ead9e676640b8b5d453dc6f5bfc60398ee51601b07e202"}
Jul 27 20:36:05.111890 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:05.111524    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh" event={"ID":"cea952d0-7dbc-4d38-9bc7-4d9abe173da7","Type":"ContainerStarted","Data":"6da06eb0c57f5228a42550402c9284eb2df77649b3b784f7ac08d4ea82573a27"}
Jul 27 20:36:05.129264 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:05.129213    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh" podStartSLOduration=2.129197277 podStartE2EDuration="2.129197277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:36:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:05.127864844 +0000 UTC m=+4326.271069232" watchObservedRunningTime="2026-07-27 20:36:05.129197277 +0000 UTC m=+4326.272401652"
Jul 27 20:36:06.118676 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:06.118635    2563 generic.go:356] "Generic (PLEG): container finished" podID="cea952d0-7dbc-4d38-9bc7-4d9abe173da7" containerID="551cd2813df1a6bc13ead9e676640b8b5d453dc6f5bfc60398ee51601b07e202" exitCode=0
Jul 27 20:36:06.119070 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:06.118720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh" event={"ID":"cea952d0-7dbc-4d38-9bc7-4d9abe173da7","Type":"ContainerDied","Data":"551cd2813df1a6bc13ead9e676640b8b5d453dc6f5bfc60398ee51601b07e202"}
Jul 27 20:36:07.263546 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:07.263520    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh"
Jul 27 20:36:07.285369 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:07.284468    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea952d0-7dbc-4d38-9bc7-4d9abe173da7-maas-api-service-ca\") pod \"cea952d0-7dbc-4d38-9bc7-4d9abe173da7\" (UID: \"cea952d0-7dbc-4d38-9bc7-4d9abe173da7\") "
Jul 27 20:36:07.285369 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:07.285138    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cea952d0-7dbc-4d38-9bc7-4d9abe173da7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cea952d0-7dbc-4d38-9bc7-4d9abe173da7" (UID: "cea952d0-7dbc-4d38-9bc7-4d9abe173da7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:07.385841 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:07.385817    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea952d0-7dbc-4d38-9bc7-4d9abe173da7-maas-api-service-ca\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:08.131425 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:08.131391    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh"
Jul 27 20:36:08.131576 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:08.131424    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh" event={"ID":"cea952d0-7dbc-4d38-9bc7-4d9abe173da7","Type":"ContainerDied","Data":"6da06eb0c57f5228a42550402c9284eb2df77649b3b784f7ac08d4ea82573a27"}
Jul 27 20:36:08.131576 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:08.131474    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6da06eb0c57f5228a42550402c9284eb2df77649b3b784f7ac08d4ea82573a27"
Jul 27 20:36:18.905731 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:18.905682    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh"]
Jul 27 20:36:18.911848 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:18.911816    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a78f44-cwzxh"]
Jul 27 20:36:19.373837 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:19.373804    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cea952d0-7dbc-4d38-9bc7-4d9abe173da7" path="/var/lib/kubelet/pods/cea952d0-7dbc-4d38-9bc7-4d9abe173da7/volumes"
Jul 27 20:36:26.829387 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:26.829355    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"]
Jul 27 20:36:26.829774 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:26.829563    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" podUID="05907ba0-183d-4657-959e-03085b07020b" containerName="istio-proxy" containerID="cri-o://347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2" gracePeriod=30
Jul 27 20:36:32.097255 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.097196    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:36:32.220449 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.220413    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-workload-socket\") pod \"05907ba0-183d-4657-959e-03085b07020b\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") "
Jul 27 20:36:32.220642 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.220480    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-istio-data\") pod \"05907ba0-183d-4657-959e-03085b07020b\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") "
Jul 27 20:36:32.220642 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.220514    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-istio-envoy\") pod \"05907ba0-183d-4657-959e-03085b07020b\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") "
Jul 27 20:36:32.220642 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.220541    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-workload-certs\") pod \"05907ba0-183d-4657-959e-03085b07020b\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") "
Jul 27 20:36:32.220642 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.220568    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twdpl\" (UniqueName: \"kubernetes.io/projected/05907ba0-183d-4657-959e-03085b07020b-kube-api-access-twdpl\") pod \"05907ba0-183d-4657-959e-03085b07020b\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") "
Jul 27 20:36:32.220642 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.220598    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05907ba0-183d-4657-959e-03085b07020b-istio-token\") pod \"05907ba0-183d-4657-959e-03085b07020b\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") "
Jul 27 20:36:32.220642 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.220633    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05907ba0-183d-4657-959e-03085b07020b-istio-podinfo\") pod \"05907ba0-183d-4657-959e-03085b07020b\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") "
Jul 27 20:36:32.220954 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.220677    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05907ba0-183d-4657-959e-03085b07020b-istiod-ca-cert\") pod \"05907ba0-183d-4657-959e-03085b07020b\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") "
Jul 27 20:36:32.220954 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.220766    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05907ba0-183d-4657-959e-03085b07020b" (UID: "05907ba0-183d-4657-959e-03085b07020b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:32.220954 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.220863    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05907ba0-183d-4657-959e-03085b07020b" (UID: "05907ba0-183d-4657-959e-03085b07020b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:32.220954 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.220913    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-credential-socket\") pod \"05907ba0-183d-4657-959e-03085b07020b\" (UID: \"05907ba0-183d-4657-959e-03085b07020b\") "
Jul 27 20:36:32.221218 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.221159    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05907ba0-183d-4657-959e-03085b07020b" (UID: "05907ba0-183d-4657-959e-03085b07020b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:32.221218 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.221163    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05907ba0-183d-4657-959e-03085b07020b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05907ba0-183d-4657-959e-03085b07020b" (UID: "05907ba0-183d-4657-959e-03085b07020b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:32.221557 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.221530    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:32.221686 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.221660    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:32.221771 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.221691    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05907ba0-183d-4657-959e-03085b07020b-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:32.221771 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.221704    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:32.221873 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.221796    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-istio-data" (OuterVolumeSpecName: "istio-data") pod "05907ba0-183d-4657-959e-03085b07020b" (UID: "05907ba0-183d-4657-959e-03085b07020b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:32.223076 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.223008    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05907ba0-183d-4657-959e-03085b07020b-istio-token" (OuterVolumeSpecName: "istio-token") pod "05907ba0-183d-4657-959e-03085b07020b" (UID: "05907ba0-183d-4657-959e-03085b07020b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:32.223177 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.223120    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05907ba0-183d-4657-959e-03085b07020b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05907ba0-183d-4657-959e-03085b07020b" (UID: "05907ba0-183d-4657-959e-03085b07020b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:36:32.223341 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.223321    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05907ba0-183d-4657-959e-03085b07020b" (UID: "05907ba0-183d-4657-959e-03085b07020b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:32.223341 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.223328    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05907ba0-183d-4657-959e-03085b07020b-kube-api-access-twdpl" (OuterVolumeSpecName: "kube-api-access-twdpl") pod "05907ba0-183d-4657-959e-03085b07020b" (UID: "05907ba0-183d-4657-959e-03085b07020b"). InnerVolumeSpecName "kube-api-access-twdpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:32.255192 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.255165    2563 generic.go:356] "Generic (PLEG): container finished" podID="05907ba0-183d-4657-959e-03085b07020b" containerID="347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2" exitCode=0
Jul 27 20:36:32.255341 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.255232    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"
Jul 27 20:36:32.255341 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.255245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" event={"ID":"05907ba0-183d-4657-959e-03085b07020b","Type":"ContainerDied","Data":"347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2"}
Jul 27 20:36:32.255341 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.255310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t" event={"ID":"05907ba0-183d-4657-959e-03085b07020b","Type":"ContainerDied","Data":"106824cbd8e15d525589f47974baf76bb0817f7851d1df4816bc479a3b6186b5"}
Jul 27 20:36:32.255341 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.255331    2563 scope.go:117] "RemoveContainer" containerID="347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2"
Jul 27 20:36:32.264572 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.264554    2563 scope.go:117] "RemoveContainer" containerID="8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59"
Jul 27 20:36:32.273060 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.273025    2563 scope.go:117] "RemoveContainer" containerID="347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2"
Jul 27 20:36:32.273333 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:36:32.273313    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2\": container with ID starting with 347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2 not found: ID does not exist" containerID="347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2"
Jul 27 20:36:32.273384 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.273341    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2"} err="failed to get container status \"347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2\": rpc error: code = NotFound desc = could not find container \"347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2\": container with ID starting with 347160df909fc5eb80615b0b01f693c919d87455a3b497f530722852a728bcc2 not found: ID does not exist"
Jul 27 20:36:32.273384 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.273359    2563 scope.go:117] "RemoveContainer" containerID="8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59"
Jul 27 20:36:32.273582 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:36:32.273563    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59\": container with ID starting with 8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59 not found: ID does not exist" containerID="8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59"
Jul 27 20:36:32.273637 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.273593    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59"} err="failed to get container status \"8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59\": rpc error: code = NotFound desc = could not find container \"8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59\": container with ID starting with 8cc49e78d88342d1957d24cf7c59b82d06e1b2e1535915ed6f5978f6363d2d59 not found: ID does not exist"
Jul 27 20:36:32.278791 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.278768    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"]
Jul 27 20:36:32.280932 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.280912    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-a78f44-openshift-default-5cfdfd8684-xbp4t"]
Jul 27 20:36:32.322143 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.322111    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05907ba0-183d-4657-959e-03085b07020b-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:32.322143 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.322142    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:32.322143 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.322152    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05907ba0-183d-4657-959e-03085b07020b-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:32.322380 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.322161    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twdpl\" (UniqueName: \"kubernetes.io/projected/05907ba0-183d-4657-959e-03085b07020b-kube-api-access-twdpl\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:32.322380 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:32.322170    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05907ba0-183d-4657-959e-03085b07020b-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:33.371885 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:33.371850    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05907ba0-183d-4657-959e-03085b07020b" path="/var/lib/kubelet/pods/05907ba0-183d-4657-959e-03085b07020b/volumes"
Jul 27 20:36:37.856754 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:37.856719    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h"]
Jul 27 20:36:37.862078 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:37.862050    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-43d589-29753070-fjg7h"]
Jul 27 20:36:39.371943 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:39.371906    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9abf55f-f724-4997-b741-2d689f0994e2" path="/var/lib/kubelet/pods/b9abf55f-f724-4997-b741-2d689f0994e2/volumes"
Jul 27 20:36:49.484855 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:49.484816    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"]
Jul 27 20:36:49.485292 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:49.485110    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" podUID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerName="istio-proxy" containerID="cri-o://3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa" gracePeriod=30
Jul 27 20:36:50.131947 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:50.131915    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86c948ccc7-5v6hz_256052de-6d72-43c2-a1e1-ca7bf6c8d234/authorino/0.log"
Jul 27 20:36:54.740668 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.740638    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:36:54.825596 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.825564    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9592\" (UniqueName: \"kubernetes.io/projected/d3ba850c-ff65-478c-a1a0-563a0984bb4a-kube-api-access-l9592\") pod \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") "
Jul 27 20:36:54.825771 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.825615    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-workload-socket\") pod \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") "
Jul 27 20:36:54.825771 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.825659    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-podinfo\") pod \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") "
Jul 27 20:36:54.825771 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.825701    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-envoy\") pod \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") "
Jul 27 20:36:54.825771 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.825718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-data\") pod \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") "
Jul 27 20:36:54.825771 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.825744    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-workload-certs\") pod \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") "
Jul 27 20:36:54.826068 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.825799    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istiod-ca-cert\") pod \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") "
Jul 27 20:36:54.826068 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.825844    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-token\") pod \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") "
Jul 27 20:36:54.826068 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.825873    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-credential-socket\") pod \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\" (UID: \"d3ba850c-ff65-478c-a1a0-563a0984bb4a\") "
Jul 27 20:36:54.826260 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.826087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d3ba850c-ff65-478c-a1a0-563a0984bb4a" (UID: "d3ba850c-ff65-478c-a1a0-563a0984bb4a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:54.826260 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.826206    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-workload-certs\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:54.826260 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.826235    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d3ba850c-ff65-478c-a1a0-563a0984bb4a" (UID: "d3ba850c-ff65-478c-a1a0-563a0984bb4a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:54.826432 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.826324    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d3ba850c-ff65-478c-a1a0-563a0984bb4a" (UID: "d3ba850c-ff65-478c-a1a0-563a0984bb4a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:54.826432 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.826406    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d3ba850c-ff65-478c-a1a0-563a0984bb4a" (UID: "d3ba850c-ff65-478c-a1a0-563a0984bb4a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:54.826781 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.826695    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-data" (OuterVolumeSpecName: "istio-data") pod "d3ba850c-ff65-478c-a1a0-563a0984bb4a" (UID: "d3ba850c-ff65-478c-a1a0-563a0984bb4a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:54.828138 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.828109    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ba850c-ff65-478c-a1a0-563a0984bb4a-kube-api-access-l9592" (OuterVolumeSpecName: "kube-api-access-l9592") pod "d3ba850c-ff65-478c-a1a0-563a0984bb4a" (UID: "d3ba850c-ff65-478c-a1a0-563a0984bb4a"). InnerVolumeSpecName "kube-api-access-l9592". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:54.828138 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.828127    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d3ba850c-ff65-478c-a1a0-563a0984bb4a" (UID: "d3ba850c-ff65-478c-a1a0-563a0984bb4a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:54.828285 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.828190    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d3ba850c-ff65-478c-a1a0-563a0984bb4a" (UID: "d3ba850c-ff65-478c-a1a0-563a0984bb4a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:36:54.828285 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.828233    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-token" (OuterVolumeSpecName: "istio-token") pod "d3ba850c-ff65-478c-a1a0-563a0984bb4a" (UID: "d3ba850c-ff65-478c-a1a0-563a0984bb4a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:54.926894 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.926860    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-podinfo\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:54.926894 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.926891    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-envoy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:54.926894 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.926900    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:54.927174 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.926908    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istiod-ca-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:54.927174 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.926917    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ba850c-ff65-478c-a1a0-563a0984bb4a-istio-token\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:54.927174 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.926924    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-credential-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:54.927174 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.926933    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9592\" (UniqueName: \"kubernetes.io/projected/d3ba850c-ff65-478c-a1a0-563a0984bb4a-kube-api-access-l9592\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:54.927174 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:54.926943    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba850c-ff65-478c-a1a0-563a0984bb4a-workload-socket\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\""
Jul 27 20:36:55.277603 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.277518    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-x5ztz_85f9dc34-465d-4b46-8357-796fbd58e609/manager/0.log"
Jul 27 20:36:55.374102 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.374068    2563 generic.go:356] "Generic (PLEG): container finished" podID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerID="3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa" exitCode=0
Jul 27 20:36:55.374315 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.374113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" event={"ID":"d3ba850c-ff65-478c-a1a0-563a0984bb4a","Type":"ContainerDied","Data":"3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa"}
Jul 27 20:36:55.374315 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.374141    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"
Jul 27 20:36:55.374315 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.374167    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn" event={"ID":"d3ba850c-ff65-478c-a1a0-563a0984bb4a","Type":"ContainerDied","Data":"c5e6193f2d65248d11477f3730b02d284a597d7b0fea83bb2e3ea12ccf21bb72"}
Jul 27 20:36:55.374315 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.374190    2563 scope.go:117] "RemoveContainer" containerID="3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa"
Jul 27 20:36:55.384387 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.384360    2563 scope.go:117] "RemoveContainer" containerID="cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19"
Jul 27 20:36:55.393783 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.393767    2563 scope.go:117] "RemoveContainer" containerID="3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa"
Jul 27 20:36:55.394114 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:36:55.394092    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa\": container with ID starting with 3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa not found: ID does not exist" containerID="3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa"
Jul 27 20:36:55.394196 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.394131    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa"} err="failed to get container status \"3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa\": rpc error: code = NotFound desc = could not find container \"3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa\": container with ID starting with 3005343ffacfe170d7c71e7fad3c4f75e2a858bbf02dcb4511181be16972f1aa not found: ID does not exist"
Jul 27 20:36:55.394196 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.394150    2563 scope.go:117] "RemoveContainer" containerID="cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19"
Jul 27 20:36:55.394482 ip-10-0-134-17 kubenswrapper[2563]: E0727 20:36:55.394461    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19\": container with ID starting with cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19 not found: ID does not exist" containerID="cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19"
Jul 27 20:36:55.394550 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.394492    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19"} err="failed to get container status \"cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19\": rpc error: code = NotFound desc = could not find container \"cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19\": container with ID starting with cd3fec1eb87155fd2d0965db79516218c9eb8d0b87088ffd048b157c835f4e19 not found: ID does not exist"
Jul 27 20:36:55.396905 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.396889    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-pkz56_2d451838-3c69-45da-a7d3-8e133a81860d/manager/0.log"
Jul 27 20:36:55.399799 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.399780    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"]
Jul 27 20:36:55.404129 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.404109    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-43d589-openshift-default-bb85599fb-x4gpn"]
Jul 27 20:36:55.510751 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.510724    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79d876b7f6-ggmcj_3a450e62-1d76-4fdc-b2ab-b0d8661b9122/manager/0.log"
Jul 27 20:36:55.744159 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.744128    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xjj5p_16994ff5-ea9c-44af-8039-606d3e3c9273/manager/0.log"
Jul 27 20:36:55.968000 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.967973    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c5c9bc998-bkjjf_54ee2a04-8e0a-4398-8ee9-63550f4b9bdb/copy-manifests/0.log"
Jul 27 20:36:55.974813 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:55.974791    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c5c9bc998-bkjjf_54ee2a04-8e0a-4398-8ee9-63550f4b9bdb/manager/0.log"
Jul 27 20:36:57.373743 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:57.373709    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" path="/var/lib/kubelet/pods/d3ba850c-ff65-478c-a1a0-563a0984bb4a/volumes"
Jul 27 20:36:58.109648 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:58.109620    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86c948ccc7-5v6hz_256052de-6d72-43c2-a1e1-ca7bf6c8d234/authorino/0.log"
Jul 27 20:36:58.220821 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:58.220793    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4lnsq_0cc4e170-fc65-4df9-a246-341d9dbf0c5b/manager/0.log"
Jul 27 20:36:58.553161 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:58.553123    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ckm7x_1c976d66-b867-4430-9563-3e81eac77fdc/registry-server/0.log"
Jul 27 20:36:58.665447 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:58.665417    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-l6jqh_554f1663-d7c1-4693-ab72-9307cccb8fef/manager/0.log"
Jul 27 20:36:58.876348 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:58.876274    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zzbdn_a91f763d-e7c7-42b5-9730-aadd40c5d242/manager/0.log"
Jul 27 20:36:59.209577 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:59.209505    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf_8651fe8c-f499-4067-8ff2-6073a1f61943/istio-proxy/0.log"
Jul 27 20:36:59.433372 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:59.433304    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bbdd9d5dd-559sf_cb4fa31f-27b7-43cb-9b28-39015195df03/kube-auth-proxy/0.log"
Jul 27 20:36:59.654577 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:59.654551    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8kxns_b11a86c7-2f27-42a6-bf83-dd394ca260f1/istio-proxy/1.log"
Jul 27 20:36:59.766897 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:59.766868    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-n9vbl_51062138-adfa-4c13-aea8-33c214f08d65/payload-pre-processing/0.log"
Jul 27 20:36:59.916902 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:59.916821    2563 scope.go:117] "RemoveContainer" containerID="ffcf413d21ddb57c50072464abfa59e69ea9e6f7baec091f43935d91510e6ac7"
Jul 27 20:36:59.984232 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:36:59.984212    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c96857fff-n9ckm_868e3d69-1d18-4be9-abf2-4a844fb46b8a/router/0.log"
Jul 27 20:37:00.312159 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:00.312125    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-789bt_609a20d1-fc7f-4dee-aab9-068fe18268b4/main/0.log"
Jul 27 20:37:00.637893 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:00.637794    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5lw9x_52a64605-e011-40f5-ab17-7af1bbc16741/main/0.log"
Jul 27 20:37:00.856820 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:00.856792    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-g5b24_eff1fcf3-56c0-4afd-84e1-50bb7e73a4fc/main/0.log"
Jul 27 20:37:08.611324 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:08.611289    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qb6nb_abaf6ffd-f230-4961-b59a-f91809572149/global-pull-secret-syncer/0.log"
Jul 27 20:37:08.773291 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:08.773259    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-snkr9_3a470f90-abba-44f8-a6d4-56f84091326c/konnectivity-agent/0.log"
Jul 27 20:37:08.869096 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:08.868987    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-17.ec2.internal_71d2293077aeb4f0cb21942afdf2229b/haproxy/0.log"
Jul 27 20:37:13.878289 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:13.878254    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86c948ccc7-5v6hz_256052de-6d72-43c2-a1e1-ca7bf6c8d234/authorino/0.log"
Jul 27 20:37:13.943558 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:13.943531    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4lnsq_0cc4e170-fc65-4df9-a246-341d9dbf0c5b/manager/0.log"
Jul 27 20:37:14.101136 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:14.101100    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ckm7x_1c976d66-b867-4430-9563-3e81eac77fdc/registry-server/0.log"
Jul 27 20:37:14.254124 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:14.254024    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-l6jqh_554f1663-d7c1-4693-ab72-9307cccb8fef/manager/0.log"
Jul 27 20:37:14.345313 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:14.345273    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zzbdn_a91f763d-e7c7-42b5-9730-aadd40c5d242/manager/0.log"
Jul 27 20:37:16.317887 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:16.317860    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-clb9r_572a364e-b7c2-4c6e-9210-bc07929c218c/node-exporter/0.log"
Jul 27 20:37:16.343352 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:16.343327    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-clb9r_572a364e-b7c2-4c6e-9210-bc07929c218c/kube-rbac-proxy/0.log"
Jul 27 20:37:16.381070 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:16.381029    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-clb9r_572a364e-b7c2-4c6e-9210-bc07929c218c/init-textfile/0.log"
Jul 27 20:37:18.905279 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905250    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"]
Jul 27 20:37:18.905662 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905581    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05907ba0-183d-4657-959e-03085b07020b" containerName="istio-proxy"
Jul 27 20:37:18.905662 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905592    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="05907ba0-183d-4657-959e-03085b07020b" containerName="istio-proxy"
Jul 27 20:37:18.905662 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905608    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerName="istio-proxy"
Jul 27 20:37:18.905662 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905613    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerName="istio-proxy"
Jul 27 20:37:18.905662 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905623    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerName="istio-proxy"
Jul 27 20:37:18.905662 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905628    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerName="istio-proxy"
Jul 27 20:37:18.905662 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905635    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cea952d0-7dbc-4d38-9bc7-4d9abe173da7" containerName="revoke-keys"
Jul 27 20:37:18.905662 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905640    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cea952d0-7dbc-4d38-9bc7-4d9abe173da7" containerName="revoke-keys"
Jul 27 20:37:18.906071 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905703    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="05907ba0-183d-4657-959e-03085b07020b" containerName="istio-proxy"
Jul 27 20:37:18.906071 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905709    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ba850c-ff65-478c-a1a0-563a0984bb4a" containerName="istio-proxy"
Jul 27 20:37:18.906071 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905715    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="05907ba0-183d-4657-959e-03085b07020b" containerName="istio-proxy"
Jul 27 20:37:18.906071 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.905720    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cea952d0-7dbc-4d38-9bc7-4d9abe173da7" containerName="revoke-keys"
Jul 27 20:37:18.908697 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.908680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:18.911334 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.911308    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9vsps\"/\"openshift-service-ca.crt\""
Jul 27 20:37:18.911432 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.911364    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9vsps\"/\"default-dockercfg-gfl9g\""
Jul 27 20:37:18.912910 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.912888    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9vsps\"/\"kube-root-ca.crt\""
Jul 27 20:37:18.918133 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:18.918104    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"]
Jul 27 20:37:19.026190 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.026160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-podres\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.026346 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.026222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-lib-modules\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.026346 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.026247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-sys\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.026346 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.026300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-proc\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.026346 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.026340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzfl7\" (UniqueName: \"kubernetes.io/projected/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-kube-api-access-bzfl7\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.127552 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.127522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-lib-modules\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.127697 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.127557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-sys\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.127697 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.127586    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-proc\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.127697 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.127617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzfl7\" (UniqueName: \"kubernetes.io/projected/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-kube-api-access-bzfl7\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.127697 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.127671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-podres\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.127697 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.127672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-sys\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.127887 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.127716    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-proc\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.127887 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.127714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-lib-modules\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.127887 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.127784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-podres\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.136686 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.136662    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzfl7\" (UniqueName: \"kubernetes.io/projected/24e8efc5-f4f6-494b-91dc-0d603fa15ecc-kube-api-access-bzfl7\") pod \"perf-node-gather-daemonset-mp4pf\" (UID: \"24e8efc5-f4f6-494b-91dc-0d603fa15ecc\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.220811 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.220752    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:19.356187 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.356162    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"]
Jul 27 20:37:19.358443 ip-10-0-134-17 kubenswrapper[2563]: W0727 20:37:19.358408    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod24e8efc5_f4f6_494b_91dc_0d603fa15ecc.slice/crio-2a5c83e5c195e0cbe9f3db7b4c40d35e54ccf993510db09be4a0a9a947adf606 WatchSource:0}: Error finding container 2a5c83e5c195e0cbe9f3db7b4c40d35e54ccf993510db09be4a0a9a947adf606: Status 404 returned error can't find the container with id 2a5c83e5c195e0cbe9f3db7b4c40d35e54ccf993510db09be4a0a9a947adf606
Jul 27 20:37:19.491558 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:19.491523    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf" event={"ID":"24e8efc5-f4f6-494b-91dc-0d603fa15ecc","Type":"ContainerStarted","Data":"2a5c83e5c195e0cbe9f3db7b4c40d35e54ccf993510db09be4a0a9a947adf606"}
Jul 27 20:37:20.497990 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:20.497956    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf" event={"ID":"24e8efc5-f4f6-494b-91dc-0d603fa15ecc","Type":"ContainerStarted","Data":"b0763d20a31905a9a9d6325ac53658c53c9aa43fa8681d8312bbd15bb1e21943"}
Jul 27 20:37:20.498406 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:20.498093    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:20.515546 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:20.515504    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf" podStartSLOduration=2.515491054 podStartE2EDuration="2.515491054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:37:20.514626043 +0000 UTC m=+4401.657830419" watchObservedRunningTime="2026-07-27 20:37:20.515491054 +0000 UTC m=+4401.658695430"
Jul 27 20:37:21.375745 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:21.375720    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k9hgr_522704f3-186a-4309-a226-0945f5a689a7/dns/0.log"
Jul 27 20:37:21.398166 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:21.398142    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k9hgr_522704f3-186a-4309-a226-0945f5a689a7/kube-rbac-proxy/0.log"
Jul 27 20:37:21.536730 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:21.536706    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9nvmk_4499a910-b91a-4ee7-af77-2e23b18f0d09/dns-node-resolver/0.log"
Jul 27 20:37:22.127648 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:22.127619    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7vb5t_a8660bdd-6abd-4726-adf7-4802172dda7b/node-ca/0.log"
Jul 27 20:37:23.175131 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:23.175102    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf_8651fe8c-f499-4067-8ff2-6073a1f61943/istio-proxy/0.log"
Jul 27 20:37:23.541113 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:23.541020    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bbdd9d5dd-559sf_cb4fa31f-27b7-43cb-9b28-39015195df03/kube-auth-proxy/0.log"
Jul 27 20:37:23.597225 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:23.597199    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8kxns_b11a86c7-2f27-42a6-bf83-dd394ca260f1/istio-proxy/0.log"
Jul 27 20:37:23.621582 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:23.621558    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8kxns_b11a86c7-2f27-42a6-bf83-dd394ca260f1/istio-proxy/1.log"
Jul 27 20:37:23.649254 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:23.649227    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-n9vbl_51062138-adfa-4c13-aea8-33c214f08d65/payload-pre-processing/0.log"
Jul 27 20:37:23.703857 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:23.703834    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c96857fff-n9ckm_868e3d69-1d18-4be9-abf2-4a844fb46b8a/router/0.log"
Jul 27 20:37:24.536178 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:24.536151    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-btlr9_5bf266a9-0698-4a82-ad9f-1ffeaf0581fd/serve-healthcheck-canary/0.log"
Jul 27 20:37:25.171812 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:25.171777    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gctvv_8da3480e-14a7-4d08-968f-c12973de8f26/kube-rbac-proxy/0.log"
Jul 27 20:37:25.190755 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:25.190727    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gctvv_8da3480e-14a7-4d08-968f-c12973de8f26/exporter/0.log"
Jul 27 20:37:25.209972 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:25.209951    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gctvv_8da3480e-14a7-4d08-968f-c12973de8f26/extractor/0.log"
Jul 27 20:37:26.512877 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:26.512847    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-mp4pf"
Jul 27 20:37:27.504603 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:27.504581    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-x5ztz_85f9dc34-465d-4b46-8357-796fbd58e609/manager/0.log"
Jul 27 20:37:27.740053 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:27.740010    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-pkz56_2d451838-3c69-45da-a7d3-8e133a81860d/manager/0.log"
Jul 27 20:37:27.978956 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:27.978924    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79d876b7f6-ggmcj_3a450e62-1d76-4fdc-b2ab-b0d8661b9122/manager/0.log"
Jul 27 20:37:28.095007 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:28.094984    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xjj5p_16994ff5-ea9c-44af-8039-606d3e3c9273/manager/0.log"
Jul 27 20:37:28.172700 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:28.172669    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c5c9bc998-bkjjf_54ee2a04-8e0a-4398-8ee9-63550f4b9bdb/manager/0.log"
Jul 27 20:37:28.191771 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:28.191744    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c5c9bc998-bkjjf_54ee2a04-8e0a-4398-8ee9-63550f4b9bdb/copy-manifests/0.log"
Jul 27 20:37:29.578171 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:29.578137    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf_8651fe8c-f499-4067-8ff2-6073a1f61943/istio-proxy/0.log"
Jul 27 20:37:29.690153 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:29.690124    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-h4g4r_62a843ef-6f32-4aa3-bb8d-5840a37c2d17/openshift-lws-operator/0.log"
Jul 27 20:37:29.853145 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:29.853060    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bbdd9d5dd-559sf_cb4fa31f-27b7-43cb-9b28-39015195df03/kube-auth-proxy/0.log"
Jul 27 20:37:29.888353 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:29.888324    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8kxns_b11a86c7-2f27-42a6-bf83-dd394ca260f1/istio-proxy/0.log"
Jul 27 20:37:29.914098 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:29.914064    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8kxns_b11a86c7-2f27-42a6-bf83-dd394ca260f1/istio-proxy/1.log"
Jul 27 20:37:29.938751 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:29.938722    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-n9vbl_51062138-adfa-4c13-aea8-33c214f08d65/payload-pre-processing/0.log"
Jul 27 20:37:29.985751 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:29.985725    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c96857fff-n9ckm_868e3d69-1d18-4be9-abf2-4a844fb46b8a/router/0.log"
Jul 27 20:37:31.305798 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:31.305765    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c4fpxf_8651fe8c-f499-4067-8ff2-6073a1f61943/istio-proxy/0.log"
Jul 27 20:37:31.589336 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:31.589267    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bbdd9d5dd-559sf_cb4fa31f-27b7-43cb-9b28-39015195df03/kube-auth-proxy/0.log"
Jul 27 20:37:31.622929 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:31.622901    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8kxns_b11a86c7-2f27-42a6-bf83-dd394ca260f1/istio-proxy/0.log"
Jul 27 20:37:31.649289 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:31.649269    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8kxns_b11a86c7-2f27-42a6-bf83-dd394ca260f1/istio-proxy/1.log"
Jul 27 20:37:31.671090 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:31.671067    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-n9vbl_51062138-adfa-4c13-aea8-33c214f08d65/payload-pre-processing/0.log"
Jul 27 20:37:31.711653 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:31.711630    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c96857fff-n9ckm_868e3d69-1d18-4be9-abf2-4a844fb46b8a/router/0.log"
Jul 27 20:37:34.826961 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:34.826931    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-prcmt_9b56d365-2abc-4ce5-807b-fdd6c152e48f/migrator/0.log"
Jul 27 20:37:34.847254 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:34.847230    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-prcmt_9b56d365-2abc-4ce5-807b-fdd6c152e48f/graceful-termination/0.log"
Jul 27 20:37:35.211772 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:35.211738    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl_6968519b-b9ce-4bbd-8c33-64fa0d0b09c8/kube-storage-version-migrator-operator/1.log"
Jul 27 20:37:35.212618 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:35.212601    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-fnqdl_6968519b-b9ce-4bbd-8c33-64fa0d0b09c8/kube-storage-version-migrator-operator/0.log"
Jul 27 20:37:36.363643 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:36.363614    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5qhd8_e72fd04c-f910-4da6-8016-961a2ffbd03a/kube-multus-additional-cni-plugins/0.log"
Jul 27 20:37:36.387809 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:36.387786    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5qhd8_e72fd04c-f910-4da6-8016-961a2ffbd03a/egress-router-binary-copy/0.log"
Jul 27 20:37:36.408930 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:36.408905    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5qhd8_e72fd04c-f910-4da6-8016-961a2ffbd03a/cni-plugins/0.log"
Jul 27 20:37:36.430671 ip-10-0-134-17 kubenswrapper[2563]: I0727 20:37:36.430646    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5qhd8_e72fd04c-f910-4da6-8016-961a2ffbd03a/bond-cni-plugin/0.log"