Jul 29 15:11:11.889896 ip-10-0-130-249 systemd[1]: Starting Kubernetes Kubelet... Jul 29 15:11:12.330900 ip-10-0-130-249 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:11:12.330900 ip-10-0-130-249 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 15:11:12.330900 ip-10-0-130-249 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:11:12.330900 ip-10-0-130-249 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 15:11:12.330900 ip-10-0-130-249 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:11:12.332254 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.332087 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 15:11:12.336155 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336136 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:11:12.336155 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336155 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:11:12.336155 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336159 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336162 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336174 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336178 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336182 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336184 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336188 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336191 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336194 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336197 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336200 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336203 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336205 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336208 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336220 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336223 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336226 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336228 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336231 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336234 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:11:12.336262 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336237 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336239 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336242 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336245 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336248 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336250 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336253 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336256 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336259 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336262 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336265 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336267 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336270 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336274 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336278 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336283 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336286 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336290 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336293 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:11:12.336837 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336296 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336299 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336302 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336304 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336307 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336310 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336312 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336315 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336318 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336320 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336323 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336326 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336329 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336333 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336336 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336339 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336342 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336345 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336348 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336351 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:11:12.337341 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336354 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336357 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336360 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336363 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336367 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336371 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336375 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336377 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336380 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336383 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336386 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336391 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336393 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336397 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336401 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336404 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336407 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336410 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336413 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:11:12.337887 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336415 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336418 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336421 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336424 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336427 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336429 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336432 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336435 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336439 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336442 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336444 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336447 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336450 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336452 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336455 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336458 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336460 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336463 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.336466 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337255 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:11:12.338380 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337263 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337266 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337268 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337272 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337275 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337279 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337282 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337284 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337287 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337290 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337293 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337296 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337299 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337301 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337304 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337307 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337310 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337313 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337316 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337319 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:11:12.338911 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337322 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337326 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337329 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337331 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337334 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337337 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337339 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337344 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337348 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337351 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337354 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337357 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337360 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337364 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337367 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337370 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337372 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337376 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337380 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:11:12.339454 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337383 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337386 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337389 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337391 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337394 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337397 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337400 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337403 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337406 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337412 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337414 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337417 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337420 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337424 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337427 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337430 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337433 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337436 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337439 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:11:12.339980 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337442 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337445 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337448 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337450 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337453 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337457 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337461 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337464 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337467 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337470 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337474 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337477 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337482 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337485 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337488 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337491 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337494 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337497 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337500 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:11:12.340514 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337502 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337505 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337508 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337513 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337516 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337519 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337522 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337524 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337527 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337530 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337533 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337536 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337539 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337542 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337544 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337547 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337550 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337553 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337555 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337558 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:11:12.341065 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.337561 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338128 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338135 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338141 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338145 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338149 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338152 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338155 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338158 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338161 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338164 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338168 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338170 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338173 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338176 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338181 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338184 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338186 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:11:12.341610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338189 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338192 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338195 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338198 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338200 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338203 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338206 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338208 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338212 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338215 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338218 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338221 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338223 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338226 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338229 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338232 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338235 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338237 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338240 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338243 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:11:12.342083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338246 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338249 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338252 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338255 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338257 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338260 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338262 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338265 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338268 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338272 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338275 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338277 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338282 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338286 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338289 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338292 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338295 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338298 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338301 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338304 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:11:12.342670 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338309 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338312 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338315 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338318 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338321 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338324 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338326 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338329 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338331 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338334 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338337 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338340 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338343 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338346 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338349 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338352 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338354 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338357 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338360 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338362 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:11:12.343172 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338366 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338370 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338372 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338375 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338379 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338382 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338384 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338387 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338390 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338393 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338395 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338398 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338402 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338405 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338408 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338411 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338414 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338418 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338421 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338424 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:11:12.343713 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338427 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.338430 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338514 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338526 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338546 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338554 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338562 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338568 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338573 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338578 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338581 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338585 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338590 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338607 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338610 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338614 2554 flags.go:64] FLAG: --cgroup-root="" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338617 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338621 2554 flags.go:64] FLAG: --client-ca-file="" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338624 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338627 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338633 2554 flags.go:64] FLAG: --cluster-domain="" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338636 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338639 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338642 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 15:11:12.344302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338648 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338652 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338656 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338659 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338663 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338666 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338670 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338673 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338676 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338679 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338684 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338687 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338690 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338693 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338696 2554 flags.go:64] FLAG: --enable-server="true" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338700 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338705 2554 flags.go:64] FLAG: --event-burst="100" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338708 2554 flags.go:64] FLAG: --event-qps="50" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338712 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338715 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338718 2554 flags.go:64] FLAG: --eviction-hard="" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338722 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338726 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338729 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338733 2554 flags.go:64] FLAG: --eviction-soft="" Jul 29 15:11:12.345012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338736 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338739 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338742 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338745 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338748 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338752 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338755 2554 flags.go:64] FLAG: --feature-gates="" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338761 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338764 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338768 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338772 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338775 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338778 2554 flags.go:64] FLAG: --help="false" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338782 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338785 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338788 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338792 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338796 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338800 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338803 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338806 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338809 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338812 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 15:11:12.345717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338816 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338819 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338822 2554 flags.go:64] FLAG: --kube-reserved="" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338825 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338828 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338832 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338835 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338838 2554 flags.go:64] FLAG: --lock-file="" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338841 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338845 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338848 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338854 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338858 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338870 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338873 2554 flags.go:64] FLAG: --logging-format="text" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338876 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338881 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338885 2554 flags.go:64] FLAG: --manifest-url="" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338888 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338899 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338902 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338907 2554 flags.go:64] FLAG: --max-pods="110" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338910 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338914 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338917 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 15:11:12.346361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338921 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338924 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338928 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338931 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338940 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338943 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338946 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338950 2554 flags.go:64] FLAG: --pod-cidr="" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338954 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338962 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338970 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338973 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338977 2554 flags.go:64] FLAG: --port="10250" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338981 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338984 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f69ddcddcae9cba2" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338988 2554 flags.go:64] FLAG: --qos-reserved="" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338991 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338994 2554 flags.go:64] FLAG: --register-node="true" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.338997 2554 flags.go:64] FLAG: --register-with-taints="" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339001 2554 flags.go:64] FLAG: --registry-burst="10" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339005 2554 flags.go:64] FLAG: --registry-qps="5" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339007 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339011 2554 flags.go:64] FLAG: --reserved-memory="" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339015 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339019 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 15:11:12.347043 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339022 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339025 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339028 2554 flags.go:64] FLAG: --runonce="false" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339031 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339034 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339037 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339041 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339044 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339047 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339050 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339053 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339056 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339059 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339062 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339065 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339069 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339072 2554 flags.go:64] FLAG: --system-cgroups="" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339075 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339083 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339086 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339089 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339094 2554 flags.go:64] FLAG: --tls-min-version="" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339097 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339100 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339103 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 15:11:12.347728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339106 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339110 2554 flags.go:64] FLAG: --v="2" Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339114 2554 flags.go:64] FLAG: --version="false" Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339118 2554 flags.go:64] FLAG: --vmodule="" Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339122 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.339126 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339264 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339269 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339272 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339275 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339278 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339281 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339283 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339286 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339289 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339292 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339294 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339297 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339300 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339303 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339305 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:11:12.348401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339308 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339311 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339314 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339317 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339321 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339324 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339327 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339331 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339333 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339336 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339339 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339342 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339345 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339348 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339351 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339356 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339360 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339363 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339367 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:11:12.349020 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339369 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339372 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339375 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339378 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339381 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339384 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339387 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339390 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339392 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339395 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339398 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339401 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339404 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339407 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339410 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339412 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339415 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339420 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339423 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339426 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:11:12.349692 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339429 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339433 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339436 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339440 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339443 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339446 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339449 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339452 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339455 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339458 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339462 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339464 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339467 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339470 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339473 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339476 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339479 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339482 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339485 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:11:12.350227 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339488 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339490 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339493 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339496 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339499 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339502 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339504 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339508 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339511 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339515 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339520 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339524 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339527 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339530 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339533 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339536 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339539 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339541 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339544 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339547 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:11:12.350848 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339550 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339553 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339557 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339559 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339562 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.339565 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.340310 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.348701 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.348722 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.348742 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.348748 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348834 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348840 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348844 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348847 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:11:12.351647 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348850 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348854 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348856 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348859 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348862 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348865 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348868 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348871 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348874 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348877 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348880 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348883 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348886 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348888 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348891 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348894 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348896 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348899 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348902 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348905 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:11:12.352142 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348908 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348910 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348913 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348916 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348918 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348928 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348932 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348934 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348937 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348940 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348943 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348945 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348948 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348951 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348954 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348957 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348960 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348962 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348965 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348968 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:11:12.352862 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348971 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348973 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348976 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348979 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348981 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348984 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348987 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348989 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348992 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.348996 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349000 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349004 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349007 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349010 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349012 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349015 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349018 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349022 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349031 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:11:12.353401 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349035 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349039 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349043 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349047 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349050 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349053 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349056 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349059 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349068 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349072 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349075 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349078 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349081 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349083 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349086 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349089 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349092 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349094 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349097 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349100 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:11:12.354045 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349102 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349105 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349108 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349110 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349113 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349116 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349118 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349121 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349124 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349127 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349130 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349134 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349143 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349146 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349150 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:11:12.354613 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349155 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.349160 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349339 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349345 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349348 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349352 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349355 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349357 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349360 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349363 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349366 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349369 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349371 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349375 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349379 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:11:12.355026 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349381 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349384 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349386 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349389 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349392 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349395 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349397 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349400 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349403 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349405 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349408 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349411 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349414 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349417 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349420 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349429 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349433 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349437 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349440 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349443 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:11:12.355425 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349446 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349449 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349452 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349455 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349458 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349461 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349464 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349467 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349469 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349472 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349475 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349478 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349481 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349483 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349486 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349489 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349492 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349495 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349497 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:11:12.355966 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349500 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349503 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349505 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349508 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349510 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349514 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349517 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349520 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349523 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349532 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349535 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349538 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349540 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349543 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349546 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349549 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349551 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349554 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349557 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349560 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:11:12.356457 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349562 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349567 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349570 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349573 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349576 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349579 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349582 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349585 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349589 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349593 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349611 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349615 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349617 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349621 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349624 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349627 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349629 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349632 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349635 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:11:12.357017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349638 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349641 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349644 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349653 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349656 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349659 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349662 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:12.349665 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.349670 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.349827 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.354173 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.355816 2554 server.go:1019] "Starting client certificate rotation" Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.355922 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:11:12.357524 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.357016 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:11:12.358515 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.358500 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:11:12.359838 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.359801 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:11:12.368669 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.368647 2554 log.go:25] "Validated CRI v1 runtime API" Jul 29 15:11:12.371196 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.371177 2554 log.go:25] "Validated CRI v1 image API" Jul 29 15:11:12.372940 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.372919 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 15:11:12.377714 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.377693 2554 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a101e69a-eff9-4f78-a75a-2a22e037f144:/dev/nvme0n1p4 ab9e3f0c-b80c-4b0b-88e6-bd00aec2b2e1:/dev/nvme0n1p3] Jul 29 15:11:12.377781 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.377714 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 15:11:12.384860 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.384732 2554 manager.go:216] Machine: {Timestamp:2026-07-29 15:11:12.383298705 +0000 UTC m=+0.369640284 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099263 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2888ec4f05940600028411df2dbe73 SystemUUID:ec2888ec-4f05-9406-0002-8411df2dbe73 BootID:3e04f7f7-d282-4497-ac0d-8420bb725a3d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:31:a1:f6:db:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:31:a1:f6:db:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:6c:a7:7d:9d:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 15:11:12.384860 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.384854 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 15:11:12.384984 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.384951 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 15:11:12.388105 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.388072 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 15:11:12.388294 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.388110 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-249.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 15:11:12.388852 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.388839 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 15:11:12.388900 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.388854 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 15:11:12.388900 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.388863 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:11:12.389628 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.389614 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:11:12.390508 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.390497 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 15:11:12.392190 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.392170 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:11:12.392491 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.392477 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:11:12.392679 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.392668 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 15:11:12.392724 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.392713 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 29 15:11:12.392758 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.392731 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 15:11:12.392758 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.392751 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 15:11:12.392837 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.392761 2554 kubelet.go:398] "Adding apiserver pod source" Jul 29 15:11:12.392837 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.392771 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 15:11:12.393321 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.393304 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:11:12.393393 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.393328 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:11:12.397204 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.397179 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 15:11:12.399729 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.399711 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 15:11:12.399815 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.399745 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 15:11:12.401703 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.401689 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 15:11:12.401765 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.401709 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 15:11:12.401765 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.401716 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 15:11:12.401765 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.401722 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 15:11:12.401765 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.401732 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 15:11:12.401765 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.401738 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 15:11:12.401765 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.401746 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 15:11:12.401765 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.401752 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 15:11:12.401765 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.401759 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 15:11:12.401765 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.401765 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 15:11:12.402027 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.401775 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 15:11:12.402027 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.401781 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 15:11:12.402790 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.402779 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 15:11:12.402790 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.402789 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 15:11:12.403937 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.403914 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 15:11:12.404067 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.404049 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 15:11:12.406250 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.406237 2554 server.go:1268] "Started kubelet" Jul 29 15:11:12.406391 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.406351 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 15:11:12.406515 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.406330 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 15:11:12.406574 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.406556 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 15:11:12.407362 ip-10-0-130-249 systemd[1]: Started Kubernetes Kubelet. Jul 29 15:11:12.408411 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.408389 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 15:11:12.409233 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.409215 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 29 15:11:12.412295 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.412247 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 15:11:12.415967 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.415947 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-249.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 15:11:12.417023 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.417006 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 15:11:12.417023 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.415992 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-249.ec2.internal.18c6cb55f8d2e0a8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-249.ec2.internal,UID:ip-10-0-130-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-249.ec2.internal,},FirstTimestamp:2026-07-29 15:11:12.40620868 +0000 UTC m=+0.392550259,LastTimestamp:2026-07-29 15:11:12.40620868 +0000 UTC m=+0.392550259,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-249.ec2.internal,}" Jul 29 15:11:12.417223 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.417087 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 15:11:12.417223 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.417104 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:12.417695 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.417674 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 15:11:12.417695 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.417673 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 15:11:12.417818 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.417710 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 15:11:12.417881 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.417825 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 29 15:11:12.417881 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.417832 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 29 15:11:12.418224 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.418204 2554 factory.go:153] Registering CRI-O factory Jul 29 15:11:12.418224 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.418225 2554 factory.go:223] Registration of the crio container factory successfully Jul 29 15:11:12.418375 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.418302 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 15:11:12.418375 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.418312 2554 factory.go:55] Registering systemd factory Jul 29 15:11:12.418375 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.418321 2554 factory.go:223] Registration of the systemd container factory successfully Jul 29 15:11:12.418375 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.418342 2554 factory.go:103] Registering Raw factory Jul 29 15:11:12.418375 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.418355 2554 manager.go:1196] Started watching for new ooms in manager Jul 29 15:11:12.419030 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.419001 2554 manager.go:349] Starting recovery of all containers Jul 29 15:11:12.423101 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.423059 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 15:11:12.423220 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.423065 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 15:11:12.432345 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.432323 2554 manager.go:354] Recovery completed Jul 29 15:11:12.437109 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.437091 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:11:12.439390 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.439355 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:11:12.439463 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.439408 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:11:12.439463 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.439420 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:11:12.439943 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.439929 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 15:11:12.439943 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.439940 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 15:11:12.439943 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.439945 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:11:12.440095 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.439957 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:11:12.440787 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.440766 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:11:12.440878 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.440804 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:11:12.440878 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.440820 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:11:12.441918 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.441887 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vkp4r" Jul 29 15:11:12.442017 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.441932 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-249.ec2.internal.18c6cb55facd35d9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-249.ec2.internal,UID:ip-10-0-130-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-249.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-249.ec2.internal,},FirstTimestamp:2026-07-29 15:11:12.439391705 +0000 UTC m=+0.425733282,LastTimestamp:2026-07-29 15:11:12.439391705 +0000 UTC m=+0.425733282,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-249.ec2.internal,}" Jul 29 15:11:12.442146 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.442127 2554 policy_none.go:49] "None policy: Start" Jul 29 15:11:12.442146 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.442149 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 15:11:12.442256 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.442167 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 15:11:12.443493 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.443481 2554 policy_none.go:47] "Start" Jul 29 15:11:12.451885 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.451659 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-249.ec2.internal.18c6cb55facd8d23 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-249.ec2.internal,UID:ip-10-0-130-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-249.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-249.ec2.internal,},FirstTimestamp:2026-07-29 15:11:12.439414051 +0000 UTC m=+0.425755629,LastTimestamp:2026-07-29 15:11:12.439414051 +0000 UTC m=+0.425755629,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-249.ec2.internal,}" Jul 29 15:11:12.456862 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.456839 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vkp4r" Jul 29 15:11:12.480356 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.480325 2554 manager.go:337] "Starting Device Plugin manager" Jul 29 15:11:12.480519 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.480369 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 15:11:12.480519 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.480381 2554 server.go:87] "Starting device plugin registration server" Jul 29 15:11:12.480754 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.480740 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 15:11:12.480801 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.480757 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 15:11:12.480873 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.480855 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 15:11:12.480983 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.480945 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 15:11:12.480983 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.480957 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 15:11:12.481601 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.481571 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 15:11:12.481723 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.481652 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:12.581081 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.581051 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:11:12.582499 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.581768 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 15:11:12.583622 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.583577 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 15:11:12.583731 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.583637 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 15:11:12.583731 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.583664 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 15:11:12.583731 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.583708 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 15:11:12.584813 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.584785 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:11:12.584919 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.584836 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:11:12.584919 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.584865 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:11:12.584919 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.584900 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.586951 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.586933 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:11:12.599107 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.599035 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.599107 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.599067 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-249.ec2.internal\": node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:12.622757 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.622725 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:12.686274 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.686227 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-249.ec2.internal"] Jul 29 15:11:12.686447 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.686348 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:11:12.687414 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.687398 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:11:12.687490 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.687431 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:11:12.687490 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.687448 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:11:12.688892 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.688878 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:11:12.689017 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.688996 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.689155 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.689036 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:11:12.689705 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.689688 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:11:12.689705 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.689700 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:11:12.689840 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.689721 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:11:12.689840 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.689722 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:11:12.689840 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.689748 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:11:12.689840 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.689734 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:11:12.691151 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.691133 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.691235 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.691166 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:11:12.691894 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.691876 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:11:12.691982 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.691903 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:11:12.691982 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.691921 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:11:12.715695 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.715662 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-249.ec2.internal\" not found" node="ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.719336 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.719312 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/821386d642f6644e924f0e1083c6b0a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal\" (UID: \"821386d642f6644e924f0e1083c6b0a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.719424 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.719353 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/821386d642f6644e924f0e1083c6b0a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal\" (UID: \"821386d642f6644e924f0e1083c6b0a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.719424 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.719381 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/965b3684eb58bf903678fba036fb554a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-249.ec2.internal\" (UID: \"965b3684eb58bf903678fba036fb554a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.720632 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.720614 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-249.ec2.internal\" not found" node="ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.723708 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.723692 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:12.819920 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.819886 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/821386d642f6644e924f0e1083c6b0a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal\" (UID: \"821386d642f6644e924f0e1083c6b0a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.819920 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.819847 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/821386d642f6644e924f0e1083c6b0a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal\" (UID: \"821386d642f6644e924f0e1083c6b0a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.820088 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.819963 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/821386d642f6644e924f0e1083c6b0a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal\" (UID: \"821386d642f6644e924f0e1083c6b0a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.820088 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.819975 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/821386d642f6644e924f0e1083c6b0a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal\" (UID: \"821386d642f6644e924f0e1083c6b0a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.820088 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.819983 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/965b3684eb58bf903678fba036fb554a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-249.ec2.internal\" (UID: \"965b3684eb58bf903678fba036fb554a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.820088 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:12.820015 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/965b3684eb58bf903678fba036fb554a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-249.ec2.internal\" (UID: \"965b3684eb58bf903678fba036fb554a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-249.ec2.internal" Jul 29 15:11:12.824307 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.824284 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:12.924574 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:12.924456 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:13.018674 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.018629 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" Jul 29 15:11:13.024903 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:13.024880 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:13.024961 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.024905 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-249.ec2.internal" Jul 29 15:11:13.125150 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:13.125094 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:13.225393 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:13.225301 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:13.225393 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.225373 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:11:13.326077 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:13.326037 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:13.356502 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.356468 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 15:11:13.356998 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.356698 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 15:11:13.356998 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.356740 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 15:11:13.426556 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:13.426512 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:13.462257 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.462182 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 15:06:12 +0000 UTC" deadline="2028-02-09 22:01:20.121032123 +0000 UTC" Jul 29 15:11:13.462257 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.462243 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13446h50m6.658792835s" Jul 29 15:11:13.526783 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:13.526684 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:13.553054 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.553021 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:11:13.554190 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.554167 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:11:13.554313 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.554204 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:11:13.554313 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.554222 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:11:13.597087 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.597059 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:11:13.627796 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:13.627757 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:13.708017 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:13.707983 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod965b3684eb58bf903678fba036fb554a.slice/crio-32860ab0bfa1d3b83317b537b5cafce853225e1260917d5773bbe9e125591a33 WatchSource:0}: Error finding container 32860ab0bfa1d3b83317b537b5cafce853225e1260917d5773bbe9e125591a33: Status 404 returned error can't find the container with id 32860ab0bfa1d3b83317b537b5cafce853225e1260917d5773bbe9e125591a33 Jul 29 15:11:13.712277 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.712257 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:11:13.728876 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:13.728840 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:13.829229 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:13.829123 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:13.930251 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:13.930215 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-249.ec2.internal\" not found" Jul 29 15:11:13.980355 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:13.978967 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:11:14.017346 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.017300 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" Jul 29 15:11:14.030648 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.030609 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:11:14.031777 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.031761 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-249.ec2.internal" Jul 29 15:11:14.042202 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.042179 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:11:14.394053 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.394006 2554 apiserver.go:52] "Watching apiserver" Jul 29 15:11:14.402748 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.402714 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 15:11:14.403264 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.403232 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-278pz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal","openshift-multus/network-metrics-daemon-5dntz","openshift-ovn-kubernetes/ovnkube-node-wqsvw","kube-system/global-pull-secret-syncer-78zcw","kube-system/konnectivity-agent-6jtbt","kube-system/kube-apiserver-proxy-ip-10-0-130-249.ec2.internal","openshift-image-registry/node-ca-dfzkw","openshift-multus/multus-additional-cni-plugins-tf8mz","openshift-multus/multus-hg5g5","openshift-network-diagnostics/network-check-target-nrddt","openshift-network-operator/iptables-alerter-4dcs2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m","openshift-cluster-node-tuning-operator/tuned-6cwdl"] Jul 29 15:11:14.405186 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.405017 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.406513 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.406387 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.408102 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.407766 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:14.408102 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.407822 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 15:11:14.408102 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:14.407840 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:14.408102 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.408043 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 15:11:14.408365 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.408117 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 15:11:14.408365 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.408183 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 15:11:14.408365 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.408272 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vt2bp\"" Jul 29 15:11:14.408794 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.408704 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 15:11:14.408918 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.408886 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q5vnt\"" Jul 29 15:11:14.409173 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.409156 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 15:11:14.409328 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.409309 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 15:11:14.409692 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.409648 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.411235 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.411215 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:14.411322 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:14.411288 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:14.411872 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.411850 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 15:11:14.412281 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.412259 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nb92h\"" Jul 29 15:11:14.412401 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.412290 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 15:11:14.412497 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.412481 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 15:11:14.412562 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.412502 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 15:11:14.412702 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.412684 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 15:11:14.412830 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.412812 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 15:11:14.412893 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.412848 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6jtbt" Jul 29 15:11:14.415637 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.414899 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.415637 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.415434 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 15:11:14.415637 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.415488 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 15:11:14.415786 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.415687 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8vgg9\"" Jul 29 15:11:14.416775 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.416755 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.417494 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.417214 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 15:11:14.417494 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.417300 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 15:11:14.417494 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.417382 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n9hld\"" Jul 29 15:11:14.418333 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.418264 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 15:11:14.419063 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.419039 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:11:14.419370 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.419351 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dfzkw" Jul 29 15:11:14.419370 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.419364 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 15:11:14.419829 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.419808 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-55v2m\"" Jul 29 15:11:14.422096 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.422071 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-278pz" Jul 29 15:11:14.423446 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.423425 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:14.423544 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:14.423507 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:14.424333 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.424177 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 15:11:14.424333 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.424296 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 15:11:14.424441 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.424423 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b5282\"" Jul 29 15:11:14.424569 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.424551 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 15:11:14.426306 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.426255 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 15:11:14.426422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.426398 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 15:11:14.426699 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.426679 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kg7nz\"" Jul 29 15:11:14.427502 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.427467 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4dcs2" Jul 29 15:11:14.428320 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428296 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-run-netns\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.428430 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428337 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-var-lib-openvswitch\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.428430 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428369 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7151ff77-5c06-4299-a2ed-26acec1819a8-env-overrides\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.428430 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428397 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/586ac960-ad80-4322-87ed-9daf5c1fb30e-agent-certs\") pod \"konnectivity-agent-6jtbt\" (UID: \"586ac960-ad80-4322-87ed-9daf5c1fb30e\") " pod="kube-system/konnectivity-agent-6jtbt" Jul 29 15:11:14.428430 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428425 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a34235c-e10d-46fe-a587-a82f67340159-cni-binary-copy\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.428697 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428451 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.428697 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428475 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbp84\" (UniqueName: \"kubernetes.io/projected/66ba070d-c0ab-46ba-ba87-9176588d9ef1-kube-api-access-bbp84\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.428697 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428501 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-var-lib-cni-multus\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.428697 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428527 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-etc-openvswitch\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.428697 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428554 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnmsb\" (UniqueName: \"kubernetes.io/projected/a62548fe-f4bb-4879-9064-aacaf57d3e92-kube-api-access-pnmsb\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.428697 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428577 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-run-systemd\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.428952 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428791 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-socket-dir\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.428952 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428819 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:14.428952 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428857 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-sysctl-conf\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.428952 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428881 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-multus-cni-dir\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.428952 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428904 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-cnibin\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.428952 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428927 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-cni-bin\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.429252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a34235c-e10d-46fe-a587-a82f67340159-cnibin\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.429252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.428982 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq8tf\" (UniqueName: \"kubernetes.io/projected/6a34235c-e10d-46fe-a587-a82f67340159-kube-api-access-xq8tf\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.429252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429012 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kgls\" (UniqueName: \"kubernetes.io/projected/d55803f3-c21e-4eb0-aeca-8877eae6a64b-kube-api-access-7kgls\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:14.429252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429040 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-run-k8s-cni-cncf-io\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.429252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429064 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-hostroot\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.429252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a34235c-e10d-46fe-a587-a82f67340159-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.429252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429128 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-sysconfig\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.429252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429144 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-systemd\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.429252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429176 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-host\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.429252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429202 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-multus-socket-dir-parent\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.429252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429232 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a62548fe-f4bb-4879-9064-aacaf57d3e92-multus-daemon-config\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429257 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-log-socket\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429274 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7151ff77-5c06-4299-a2ed-26acec1819a8-ovnkube-config\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429290 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a34235c-e10d-46fe-a587-a82f67340159-os-release\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429305 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-cni-netd\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429345 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6a34235c-e10d-46fe-a587-a82f67340159-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429377 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bba0468-80b0-4f39-b48d-750abab54434-host\") pod \"node-ca-dfzkw\" (UID: \"8bba0468-80b0-4f39-b48d-750abab54434\") " pod="openshift-image-registry/node-ca-dfzkw" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429410 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-device-dir\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429439 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a62548fe-f4bb-4879-9064-aacaf57d3e92-cni-binary-copy\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429465 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/586ac960-ad80-4322-87ed-9daf5c1fb30e-konnectivity-ca\") pod \"konnectivity-agent-6jtbt\" (UID: \"586ac960-ad80-4322-87ed-9daf5c1fb30e\") " pod="kube-system/konnectivity-agent-6jtbt" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429490 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-sys-fs\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429514 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8bba0468-80b0-4f39-b48d-750abab54434-serviceca\") pod \"node-ca-dfzkw\" (UID: \"8bba0468-80b0-4f39-b48d-750abab54434\") " pod="openshift-image-registry/node-ca-dfzkw" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429540 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ba070d-c0ab-46ba-ba87-9176588d9ef1-tmp\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429565 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-multus-conf-dir\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429661 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/429076a7-cb20-464f-9ab9-c29ab3c80773-dbus\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:14.429785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429771 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a34235c-e10d-46fe-a587-a82f67340159-system-cni-dir\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429826 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-kubernetes\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429882 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-var-lib-kubelet\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429910 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-run-ovn\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429936 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7151ff77-5c06-4299-a2ed-26acec1819a8-ovnkube-script-lib\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.429973 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/429076a7-cb20-464f-9ab9-c29ab3c80773-kubelet-config\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430028 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6a34235c-e10d-46fe-a587-a82f67340159-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430091 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-tuned\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430132 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-os-release\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430175 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-var-lib-cni-bin\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430209 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-run-netns\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430246 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx5kk\" (UniqueName: \"kubernetes.io/projected/884f985d-22bd-4949-803b-1017821334ee-kube-api-access-rx5kk\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430277 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-modprobe-d\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430305 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-run\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430330 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430358 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-registration-dir\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.430529 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430396 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-var-lib-kubelet\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430428 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-slash\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430461 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s95s7\" (UniqueName: \"kubernetes.io/projected/7151ff77-5c06-4299-a2ed-26acec1819a8-kube-api-access-s95s7\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430487 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430512 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-sysctl-d\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430534 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-lib-modules\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430614 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-system-cni-dir\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430675 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-etc-kubernetes\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430702 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-systemd-units\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430727 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430755 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-sys\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430806 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-run-multus-certs\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430841 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-kubelet\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430913 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-run-openvswitch\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430940 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-node-log\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.431480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430966 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7151ff77-5c06-4299-a2ed-26acec1819a8-ovn-node-metrics-cert\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.432393 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.430991 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9t6k\" (UniqueName: \"kubernetes.io/projected/8bba0468-80b0-4f39-b48d-750abab54434-kube-api-access-x9t6k\") pod \"node-ca-dfzkw\" (UID: \"8bba0468-80b0-4f39-b48d-750abab54434\") " pod="openshift-image-registry/node-ca-dfzkw" Jul 29 15:11:14.432393 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.431658 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 15:11:14.432393 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.432070 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:11:14.432393 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.432233 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 15:11:14.433824 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.433766 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-psjgp\"" Jul 29 15:11:14.440120 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.440079 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:11:14.470748 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.470600 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-774td" Jul 29 15:11:14.484313 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.484289 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-774td" Jul 29 15:11:14.519342 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.519312 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 15:11:14.531415 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531373 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnmsb\" (UniqueName: \"kubernetes.io/projected/a62548fe-f4bb-4879-9064-aacaf57d3e92-kube-api-access-pnmsb\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.531415 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531412 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-run-systemd\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.531687 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531440 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/909564e0-0977-4595-9382-9893dc1cc7da-host-slash\") pod \"iptables-alerter-4dcs2\" (UID: \"909564e0-0977-4595-9382-9893dc1cc7da\") " pod="openshift-network-operator/iptables-alerter-4dcs2" Jul 29 15:11:14.531687 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531544 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-run-systemd\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.531687 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-socket-dir\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.531687 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531646 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:14.531687 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531669 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-sysctl-conf\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.531687 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531690 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-multus-cni-dir\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531716 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-cnibin\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-cni-bin\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531763 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a34235c-e10d-46fe-a587-a82f67340159-cnibin\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531784 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-socket-dir\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq8tf\" (UniqueName: \"kubernetes.io/projected/6a34235c-e10d-46fe-a587-a82f67340159-kube-api-access-xq8tf\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531852 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kgls\" (UniqueName: \"kubernetes.io/projected/d55803f3-c21e-4eb0-aeca-8877eae6a64b-kube-api-access-7kgls\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531876 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-sysctl-conf\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531885 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-run-k8s-cni-cncf-io\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531903 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-cni-bin\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531919 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-hostroot\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531946 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a34235c-e10d-46fe-a587-a82f67340159-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531972 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a34235c-e10d-46fe-a587-a82f67340159-cnibin\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531976 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v7ps\" (UniqueName: \"kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps\") pod \"network-check-target-nrddt\" (UID: \"8fc5b1de-0e23-44f7-ac91-189edba9bc37\") " pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:14.531860 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.531908 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-cnibin\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532010 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/909564e0-0977-4595-9382-9893dc1cc7da-iptables-alerter-script\") pod \"iptables-alerter-4dcs2\" (UID: \"909564e0-0977-4595-9382-9893dc1cc7da\") " pod="openshift-network-operator/iptables-alerter-4dcs2" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532027 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-multus-cni-dir\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.532050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532053 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-run-k8s-cni-cncf-io\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:14.532088 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs podName:d55803f3-c21e-4eb0-aeca-8877eae6a64b nodeName:}" failed. No retries permitted until 2026-07-29 15:11:15.032065111 +0000 UTC m=+3.018406690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs") pod "network-metrics-daemon-5dntz" (UID: "d55803f3-c21e-4eb0-aeca-8877eae6a64b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532105 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-hostroot\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532107 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-sysconfig\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532157 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-sysconfig\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532141 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-systemd\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532177 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a34235c-e10d-46fe-a587-a82f67340159-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532222 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-host\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532228 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-systemd\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532288 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-multus-socket-dir-parent\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532341 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-host\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532370 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a62548fe-f4bb-4879-9064-aacaf57d3e92-multus-daemon-config\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532395 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-log-socket\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532414 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7151ff77-5c06-4299-a2ed-26acec1819a8-ovnkube-config\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532502 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-multus-socket-dir-parent\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532599 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-log-socket\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532650 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a34235c-e10d-46fe-a587-a82f67340159-os-release\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.532937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532674 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-cni-netd\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532692 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6a34235c-e10d-46fe-a587-a82f67340159-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532717 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bba0468-80b0-4f39-b48d-750abab54434-host\") pod \"node-ca-dfzkw\" (UID: \"8bba0468-80b0-4f39-b48d-750abab54434\") " pod="openshift-image-registry/node-ca-dfzkw" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532746 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12648377-79cc-4ee8-afe6-8ad892fc5512-tmp-dir\") pod \"node-resolver-278pz\" (UID: \"12648377-79cc-4ee8-afe6-8ad892fc5512\") " pod="openshift-dns/node-resolver-278pz" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532755 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-cni-netd\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-device-dir\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532812 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a62548fe-f4bb-4879-9064-aacaf57d3e92-cni-binary-copy\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532843 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/586ac960-ad80-4322-87ed-9daf5c1fb30e-konnectivity-ca\") pod \"konnectivity-agent-6jtbt\" (UID: \"586ac960-ad80-4322-87ed-9daf5c1fb30e\") " pod="kube-system/konnectivity-agent-6jtbt" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532816 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-device-dir\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532876 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12648377-79cc-4ee8-afe6-8ad892fc5512-hosts-file\") pod \"node-resolver-278pz\" (UID: \"12648377-79cc-4ee8-afe6-8ad892fc5512\") " pod="openshift-dns/node-resolver-278pz" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532904 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-sys-fs\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532914 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a34235c-e10d-46fe-a587-a82f67340159-os-release\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532929 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8bba0468-80b0-4f39-b48d-750abab54434-serviceca\") pod \"node-ca-dfzkw\" (UID: \"8bba0468-80b0-4f39-b48d-750abab54434\") " pod="openshift-image-registry/node-ca-dfzkw" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532953 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ba070d-c0ab-46ba-ba87-9176588d9ef1-tmp\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532980 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-multus-conf-dir\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533004 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a62548fe-f4bb-4879-9064-aacaf57d3e92-multus-daemon-config\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/429076a7-cb20-464f-9ab9-c29ab3c80773-dbus\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:14.533922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533049 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a34235c-e10d-46fe-a587-a82f67340159-system-cni-dir\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533065 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/429076a7-cb20-464f-9ab9-c29ab3c80773-dbus\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533078 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-kubernetes\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-var-lib-kubelet\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-run-ovn\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533159 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7151ff77-5c06-4299-a2ed-26acec1819a8-ovnkube-script-lib\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533193 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/429076a7-cb20-464f-9ab9-c29ab3c80773-kubelet-config\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533222 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6a34235c-e10d-46fe-a587-a82f67340159-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533246 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-tuned\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533272 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-os-release\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533299 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-var-lib-cni-bin\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533324 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-run-netns\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533327 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a62548fe-f4bb-4879-9064-aacaf57d3e92-cni-binary-copy\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533332 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7151ff77-5c06-4299-a2ed-26acec1819a8-ovnkube-config\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.532852 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bba0468-80b0-4f39-b48d-750abab54434-host\") pod \"node-ca-dfzkw\" (UID: \"8bba0468-80b0-4f39-b48d-750abab54434\") " pod="openshift-image-registry/node-ca-dfzkw" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533382 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a34235c-e10d-46fe-a587-a82f67340159-system-cni-dir\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533403 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-run-netns\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.534785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533408 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-sys-fs\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533423 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbmn8\" (UniqueName: \"kubernetes.io/projected/12648377-79cc-4ee8-afe6-8ad892fc5512-kube-api-access-qbmn8\") pod \"node-resolver-278pz\" (UID: \"12648377-79cc-4ee8-afe6-8ad892fc5512\") " pod="openshift-dns/node-resolver-278pz" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533441 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-kubernetes\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx5kk\" (UniqueName: \"kubernetes.io/projected/884f985d-22bd-4949-803b-1017821334ee-kube-api-access-rx5kk\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533477 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-modprobe-d\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-run\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533533 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533558 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-registration-dir\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533586 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-var-lib-kubelet\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533629 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-slash\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533657 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s95s7\" (UniqueName: \"kubernetes.io/projected/7151ff77-5c06-4299-a2ed-26acec1819a8-kube-api-access-s95s7\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533668 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-os-release\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533683 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533706 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-var-lib-kubelet\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533709 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-sysctl-d\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533763 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-lib-modules\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533794 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-system-cni-dir\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.535620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533820 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-etc-kubernetes\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533845 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-systemd-units\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533872 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533902 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533931 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-sys\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533956 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-run-multus-certs\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533960 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/586ac960-ad80-4322-87ed-9daf5c1fb30e-konnectivity-ca\") pod \"konnectivity-agent-6jtbt\" (UID: \"586ac960-ad80-4322-87ed-9daf5c1fb30e\") " pod="kube-system/konnectivity-agent-6jtbt" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533982 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-kubelet\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534018 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534039 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-kubelet\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.533704 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6a34235c-e10d-46fe-a587-a82f67340159-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534092 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7151ff77-5c06-4299-a2ed-26acec1819a8-ovnkube-script-lib\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534117 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-sysctl-d\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534136 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-run-ovn\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534154 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-run-openvswitch\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-node-log\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534216 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7151ff77-5c06-4299-a2ed-26acec1819a8-ovn-node-metrics-cert\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9t6k\" (UniqueName: \"kubernetes.io/projected/8bba0468-80b0-4f39-b48d-750abab54434-kube-api-access-x9t6k\") pod \"node-ca-dfzkw\" (UID: \"8bba0468-80b0-4f39-b48d-750abab54434\") " pod="openshift-image-registry/node-ca-dfzkw" Jul 29 15:11:14.536465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534276 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-run-netns\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534303 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-var-lib-openvswitch\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534333 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7151ff77-5c06-4299-a2ed-26acec1819a8-env-overrides\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534360 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/586ac960-ad80-4322-87ed-9daf5c1fb30e-agent-certs\") pod \"konnectivity-agent-6jtbt\" (UID: \"586ac960-ad80-4322-87ed-9daf5c1fb30e\") " pod="kube-system/konnectivity-agent-6jtbt" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534372 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-systemd-units\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534378 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6a34235c-e10d-46fe-a587-a82f67340159-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534392 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a34235c-e10d-46fe-a587-a82f67340159-cni-binary-copy\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534413 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-system-cni-dir\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534447 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8bba0468-80b0-4f39-b48d-750abab54434-serviceca\") pod \"node-ca-dfzkw\" (UID: \"8bba0468-80b0-4f39-b48d-750abab54434\") " pod="openshift-image-registry/node-ca-dfzkw" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534455 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-multus-conf-dir\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534467 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-node-log\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534503 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534511 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-lib-modules\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534519 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-sys\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534518 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534554 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-var-lib-cni-bin\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534562 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-run-multus-certs\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534598 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z5mv\" (UniqueName: \"kubernetes.io/projected/909564e0-0977-4595-9382-9893dc1cc7da-kube-api-access-8z5mv\") pod \"iptables-alerter-4dcs2\" (UID: \"909564e0-0977-4595-9382-9893dc1cc7da\") " pod="openshift-network-operator/iptables-alerter-4dcs2" Jul 29 15:11:14.537359 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:14.534617 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534628 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-var-lib-openvswitch\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534636 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:14.534662 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret podName:429076a7-cb20-464f-9ab9-c29ab3c80773 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:15.034646811 +0000 UTC m=+3.020988394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret") pod "global-pull-secret-syncer-78zcw" (UID: "429076a7-cb20-464f-9ab9-c29ab3c80773") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534692 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbp84\" (UniqueName: \"kubernetes.io/projected/66ba070d-c0ab-46ba-ba87-9176588d9ef1-kube-api-access-bbp84\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534715 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-var-lib-cni-multus\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534730 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534735 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-etc-openvswitch\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534760 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-run-netns\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534771 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-etc-kubernetes\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534811 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-etc-openvswitch\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534839 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/429076a7-cb20-464f-9ab9-c29ab3c80773-kubelet-config\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534855 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-run\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534895 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-var-lib-kubelet\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534911 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-host-slash\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534942 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-modprobe-d\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.534962 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.538244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.535204 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a62548fe-f4bb-4879-9064-aacaf57d3e92-host-var-lib-cni-multus\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.538990 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.535349 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7151ff77-5c06-4299-a2ed-26acec1819a8-env-overrides\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.538990 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.535406 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/884f985d-22bd-4949-803b-1017821334ee-registration-dir\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.538990 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.535410 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7151ff77-5c06-4299-a2ed-26acec1819a8-run-openvswitch\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.538990 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.535701 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a34235c-e10d-46fe-a587-a82f67340159-cni-binary-copy\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.538990 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.538038 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ba070d-c0ab-46ba-ba87-9176588d9ef1-tmp\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.538990 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.538241 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7151ff77-5c06-4299-a2ed-26acec1819a8-ovn-node-metrics-cert\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.538990 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.538269 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66ba070d-c0ab-46ba-ba87-9176588d9ef1-etc-tuned\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.538990 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.538329 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/586ac960-ad80-4322-87ed-9daf5c1fb30e-agent-certs\") pod \"konnectivity-agent-6jtbt\" (UID: \"586ac960-ad80-4322-87ed-9daf5c1fb30e\") " pod="kube-system/konnectivity-agent-6jtbt" Jul 29 15:11:14.545622 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.545570 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq8tf\" (UniqueName: \"kubernetes.io/projected/6a34235c-e10d-46fe-a587-a82f67340159-kube-api-access-xq8tf\") pod \"multus-additional-cni-plugins-tf8mz\" (UID: \"6a34235c-e10d-46fe-a587-a82f67340159\") " pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.545622 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.545617 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx5kk\" (UniqueName: \"kubernetes.io/projected/884f985d-22bd-4949-803b-1017821334ee-kube-api-access-rx5kk\") pod \"aws-ebs-csi-driver-node-4dm4m\" (UID: \"884f985d-22bd-4949-803b-1017821334ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.546051 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.546025 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kgls\" (UniqueName: \"kubernetes.io/projected/d55803f3-c21e-4eb0-aeca-8877eae6a64b-kube-api-access-7kgls\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:14.546442 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.546418 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnmsb\" (UniqueName: \"kubernetes.io/projected/a62548fe-f4bb-4879-9064-aacaf57d3e92-kube-api-access-pnmsb\") pod \"multus-hg5g5\" (UID: \"a62548fe-f4bb-4879-9064-aacaf57d3e92\") " pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.547684 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.547664 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbp84\" (UniqueName: \"kubernetes.io/projected/66ba070d-c0ab-46ba-ba87-9176588d9ef1-kube-api-access-bbp84\") pod \"tuned-6cwdl\" (UID: \"66ba070d-c0ab-46ba-ba87-9176588d9ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.548618 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.548580 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s95s7\" (UniqueName: \"kubernetes.io/projected/7151ff77-5c06-4299-a2ed-26acec1819a8-kube-api-access-s95s7\") pod \"ovnkube-node-wqsvw\" (UID: \"7151ff77-5c06-4299-a2ed-26acec1819a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.552696 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.552663 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9t6k\" (UniqueName: \"kubernetes.io/projected/8bba0468-80b0-4f39-b48d-750abab54434-kube-api-access-x9t6k\") pod \"node-ca-dfzkw\" (UID: \"8bba0468-80b0-4f39-b48d-750abab54434\") " pod="openshift-image-registry/node-ca-dfzkw" Jul 29 15:11:14.589491 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.589427 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-249.ec2.internal" event={"ID":"965b3684eb58bf903678fba036fb554a","Type":"ContainerStarted","Data":"32860ab0bfa1d3b83317b537b5cafce853225e1260917d5773bbe9e125591a33"} Jul 29 15:11:14.635876 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.635831 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12648377-79cc-4ee8-afe6-8ad892fc5512-tmp-dir\") pod \"node-resolver-278pz\" (UID: \"12648377-79cc-4ee8-afe6-8ad892fc5512\") " pod="openshift-dns/node-resolver-278pz" Jul 29 15:11:14.635876 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.635878 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12648377-79cc-4ee8-afe6-8ad892fc5512-hosts-file\") pod \"node-resolver-278pz\" (UID: \"12648377-79cc-4ee8-afe6-8ad892fc5512\") " pod="openshift-dns/node-resolver-278pz" Jul 29 15:11:14.636131 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.635912 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbmn8\" (UniqueName: \"kubernetes.io/projected/12648377-79cc-4ee8-afe6-8ad892fc5512-kube-api-access-qbmn8\") pod \"node-resolver-278pz\" (UID: \"12648377-79cc-4ee8-afe6-8ad892fc5512\") " pod="openshift-dns/node-resolver-278pz" Jul 29 15:11:14.636131 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.635969 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z5mv\" (UniqueName: \"kubernetes.io/projected/909564e0-0977-4595-9382-9893dc1cc7da-kube-api-access-8z5mv\") pod \"iptables-alerter-4dcs2\" (UID: \"909564e0-0977-4595-9382-9893dc1cc7da\") " pod="openshift-network-operator/iptables-alerter-4dcs2" Jul 29 15:11:14.636131 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.635999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/909564e0-0977-4595-9382-9893dc1cc7da-host-slash\") pod \"iptables-alerter-4dcs2\" (UID: \"909564e0-0977-4595-9382-9893dc1cc7da\") " pod="openshift-network-operator/iptables-alerter-4dcs2" Jul 29 15:11:14.636131 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.636040 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7ps\" (UniqueName: \"kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps\") pod \"network-check-target-nrddt\" (UID: \"8fc5b1de-0e23-44f7-ac91-189edba9bc37\") " pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:14.636131 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.636047 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12648377-79cc-4ee8-afe6-8ad892fc5512-hosts-file\") pod \"node-resolver-278pz\" (UID: \"12648377-79cc-4ee8-afe6-8ad892fc5512\") " pod="openshift-dns/node-resolver-278pz" Jul 29 15:11:14.636131 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.636063 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/909564e0-0977-4595-9382-9893dc1cc7da-iptables-alerter-script\") pod \"iptables-alerter-4dcs2\" (UID: \"909564e0-0977-4595-9382-9893dc1cc7da\") " pod="openshift-network-operator/iptables-alerter-4dcs2" Jul 29 15:11:14.636434 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.636205 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/909564e0-0977-4595-9382-9893dc1cc7da-host-slash\") pod \"iptables-alerter-4dcs2\" (UID: \"909564e0-0977-4595-9382-9893dc1cc7da\") " pod="openshift-network-operator/iptables-alerter-4dcs2" Jul 29 15:11:14.636434 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.636226 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12648377-79cc-4ee8-afe6-8ad892fc5512-tmp-dir\") pod \"node-resolver-278pz\" (UID: \"12648377-79cc-4ee8-afe6-8ad892fc5512\") " pod="openshift-dns/node-resolver-278pz" Jul 29 15:11:14.636724 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.636703 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/909564e0-0977-4595-9382-9893dc1cc7da-iptables-alerter-script\") pod \"iptables-alerter-4dcs2\" (UID: \"909564e0-0977-4595-9382-9893dc1cc7da\") " pod="openshift-network-operator/iptables-alerter-4dcs2" Jul 29 15:11:14.644636 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:14.644570 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:11:14.644636 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:14.644613 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:11:14.644636 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:14.644628 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8v7ps for pod openshift-network-diagnostics/network-check-target-nrddt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:14.644804 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:14.644705 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps podName:8fc5b1de-0e23-44f7-ac91-189edba9bc37 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:15.144687376 +0000 UTC m=+3.131028940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8v7ps" (UniqueName: "kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps") pod "network-check-target-nrddt" (UID: "8fc5b1de-0e23-44f7-ac91-189edba9bc37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:14.646903 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.646874 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbmn8\" (UniqueName: \"kubernetes.io/projected/12648377-79cc-4ee8-afe6-8ad892fc5512-kube-api-access-qbmn8\") pod \"node-resolver-278pz\" (UID: \"12648377-79cc-4ee8-afe6-8ad892fc5512\") " pod="openshift-dns/node-resolver-278pz" Jul 29 15:11:14.648094 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.648067 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z5mv\" (UniqueName: \"kubernetes.io/projected/909564e0-0977-4595-9382-9893dc1cc7da-kube-api-access-8z5mv\") pod \"iptables-alerter-4dcs2\" (UID: \"909564e0-0977-4595-9382-9893dc1cc7da\") " pod="openshift-network-operator/iptables-alerter-4dcs2" Jul 29 15:11:14.719265 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.719221 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hg5g5" Jul 29 15:11:14.729766 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.729733 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" Jul 29 15:11:14.738850 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.738818 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:14.745806 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.745780 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6jtbt" Jul 29 15:11:14.753802 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.753769 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tf8mz" Jul 29 15:11:14.761837 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.761809 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" Jul 29 15:11:14.769815 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.769785 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dfzkw" Jul 29 15:11:14.777813 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.777769 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-278pz" Jul 29 15:11:14.786904 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.786875 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4dcs2" Jul 29 15:11:14.937654 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:14.937562 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:11:15.038137 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.038089 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:15.038137 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.038143 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:15.038397 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:15.038285 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:15.038397 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:15.038343 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:15.038397 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:15.038372 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret podName:429076a7-cb20-464f-9ab9-c29ab3c80773 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:16.038350033 +0000 UTC m=+4.024691608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret") pod "global-pull-secret-syncer-78zcw" (UID: "429076a7-cb20-464f-9ab9-c29ab3c80773") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:15.038397 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:15.038396 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs podName:d55803f3-c21e-4eb0-aeca-8877eae6a64b nodeName:}" failed. No retries permitted until 2026-07-29 15:11:16.038379718 +0000 UTC m=+4.024721282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs") pod "network-metrics-daemon-5dntz" (UID: "d55803f3-c21e-4eb0-aeca-8877eae6a64b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:15.239888 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.239787 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7ps\" (UniqueName: \"kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps\") pod \"network-check-target-nrddt\" (UID: \"8fc5b1de-0e23-44f7-ac91-189edba9bc37\") " pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:15.240071 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:15.239948 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:11:15.240071 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:15.239970 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:11:15.240071 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:15.239983 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8v7ps for pod openshift-network-diagnostics/network-check-target-nrddt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:15.240071 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:15.240055 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps podName:8fc5b1de-0e23-44f7-ac91-189edba9bc37 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:16.240034444 +0000 UTC m=+4.226376011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8v7ps" (UniqueName: "kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps") pod "network-check-target-nrddt" (UID: "8fc5b1de-0e23-44f7-ac91-189edba9bc37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:15.345751 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:15.345715 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ba070d_c0ab_46ba_ba87_9176588d9ef1.slice/crio-87661b746258f7f3dc8a19076b01534c9f49dbaaa1043807c9bc3c8f7ad0ad9f WatchSource:0}: Error finding container 87661b746258f7f3dc8a19076b01534c9f49dbaaa1043807c9bc3c8f7ad0ad9f: Status 404 returned error can't find the container with id 87661b746258f7f3dc8a19076b01534c9f49dbaaa1043807c9bc3c8f7ad0ad9f Jul 29 15:11:15.347009 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:15.346973 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12648377_79cc_4ee8_afe6_8ad892fc5512.slice/crio-098858cc891650ab3344623edd38fa51845979e45cda2929d8396f31db9e86e4 WatchSource:0}: Error finding container 098858cc891650ab3344623edd38fa51845979e45cda2929d8396f31db9e86e4: Status 404 returned error can't find the container with id 098858cc891650ab3344623edd38fa51845979e45cda2929d8396f31db9e86e4 Jul 29 15:11:15.350083 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:15.350060 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909564e0_0977_4595_9382_9893dc1cc7da.slice/crio-b9de3747d3431d8592d7d2d8b2934d1fb4a8e8272cdd7c3f501974fa088af7ab WatchSource:0}: Error finding container b9de3747d3431d8592d7d2d8b2934d1fb4a8e8272cdd7c3f501974fa088af7ab: Status 404 returned error can't find the container with id b9de3747d3431d8592d7d2d8b2934d1fb4a8e8272cdd7c3f501974fa088af7ab Jul 29 15:11:15.354209 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:15.354168 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7151ff77_5c06_4299_a2ed_26acec1819a8.slice/crio-a838f86ab6a06de6302acad874c83f5630fcc9a0eb07303ce7bacec43b293b9e WatchSource:0}: Error finding container a838f86ab6a06de6302acad874c83f5630fcc9a0eb07303ce7bacec43b293b9e: Status 404 returned error can't find the container with id a838f86ab6a06de6302acad874c83f5630fcc9a0eb07303ce7bacec43b293b9e Jul 29 15:11:15.355456 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:15.355434 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a34235c_e10d_46fe_a587_a82f67340159.slice/crio-e4b7e54f1229cb05bb6b16f20e08cad1ae0d4594c60c6ed81c7a0c417b07ea45 WatchSource:0}: Error finding container e4b7e54f1229cb05bb6b16f20e08cad1ae0d4594c60c6ed81c7a0c417b07ea45: Status 404 returned error can't find the container with id e4b7e54f1229cb05bb6b16f20e08cad1ae0d4594c60c6ed81c7a0c417b07ea45 Jul 29 15:11:15.357160 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:15.357141 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62548fe_f4bb_4879_9064_aacaf57d3e92.slice/crio-4317dda0320c8d166a5ca74383b48bad8f97a96b9cc185a7df0244357b02f58c WatchSource:0}: Error finding container 4317dda0320c8d166a5ca74383b48bad8f97a96b9cc185a7df0244357b02f58c: Status 404 returned error can't find the container with id 4317dda0320c8d166a5ca74383b48bad8f97a96b9cc185a7df0244357b02f58c Jul 29 15:11:15.358019 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:15.357993 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bba0468_80b0_4f39_b48d_750abab54434.slice/crio-25a85a879070b1bb12b944228c07c8fdb118b8fef8aa50fbbffc6bd647826acc WatchSource:0}: Error finding container 25a85a879070b1bb12b944228c07c8fdb118b8fef8aa50fbbffc6bd647826acc: Status 404 returned error can't find the container with id 25a85a879070b1bb12b944228c07c8fdb118b8fef8aa50fbbffc6bd647826acc Jul 29 15:11:15.358699 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:15.358671 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884f985d_22bd_4949_803b_1017821334ee.slice/crio-6df09b26c19626518d897195b76ed1a300b54d2e196d8e64ee8eb98dab61f8a4 WatchSource:0}: Error finding container 6df09b26c19626518d897195b76ed1a300b54d2e196d8e64ee8eb98dab61f8a4: Status 404 returned error can't find the container with id 6df09b26c19626518d897195b76ed1a300b54d2e196d8e64ee8eb98dab61f8a4 Jul 29 15:11:15.360610 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:15.360579 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586ac960_ad80_4322_87ed_9daf5c1fb30e.slice/crio-8bf22a5788eb52cba6b5be72a5f296255db627daaf156419949ba8e0b3d0917d WatchSource:0}: Error finding container 8bf22a5788eb52cba6b5be72a5f296255db627daaf156419949ba8e0b3d0917d: Status 404 returned error can't find the container with id 8bf22a5788eb52cba6b5be72a5f296255db627daaf156419949ba8e0b3d0917d Jul 29 15:11:15.372801 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:15.372766 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821386d642f6644e924f0e1083c6b0a3.slice/crio-ca5e0f5fc707dcb6464a1f98332abe9699c16e6f95ce3ae078177ebf4656f979 WatchSource:0}: Error finding container ca5e0f5fc707dcb6464a1f98332abe9699c16e6f95ce3ae078177ebf4656f979: Status 404 returned error can't find the container with id ca5e0f5fc707dcb6464a1f98332abe9699c16e6f95ce3ae078177ebf4656f979 Jul 29 15:11:15.488207 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.488153 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 15:06:14 +0000 UTC" deadline="2027-12-26 10:07:28.705927541 +0000 UTC" Jul 29 15:11:15.488207 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.488200 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12354h56m13.217735936s" Jul 29 15:11:15.594116 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.594072 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-249.ec2.internal" event={"ID":"965b3684eb58bf903678fba036fb554a","Type":"ContainerStarted","Data":"446b084ea22b828ee39369b0dc85c5d4dca986d2c29f82a64779e9df9ada0a8b"} Jul 29 15:11:15.595272 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.595244 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" event={"ID":"821386d642f6644e924f0e1083c6b0a3","Type":"ContainerStarted","Data":"ca5e0f5fc707dcb6464a1f98332abe9699c16e6f95ce3ae078177ebf4656f979"} Jul 29 15:11:15.596368 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.596336 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6jtbt" event={"ID":"586ac960-ad80-4322-87ed-9daf5c1fb30e","Type":"ContainerStarted","Data":"8bf22a5788eb52cba6b5be72a5f296255db627daaf156419949ba8e0b3d0917d"} Jul 29 15:11:15.597376 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.597355 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" event={"ID":"7151ff77-5c06-4299-a2ed-26acec1819a8","Type":"ContainerStarted","Data":"a838f86ab6a06de6302acad874c83f5630fcc9a0eb07303ce7bacec43b293b9e"} Jul 29 15:11:15.598571 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.598547 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4dcs2" event={"ID":"909564e0-0977-4595-9382-9893dc1cc7da","Type":"ContainerStarted","Data":"b9de3747d3431d8592d7d2d8b2934d1fb4a8e8272cdd7c3f501974fa088af7ab"} Jul 29 15:11:15.599841 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.599817 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" event={"ID":"66ba070d-c0ab-46ba-ba87-9176588d9ef1","Type":"ContainerStarted","Data":"87661b746258f7f3dc8a19076b01534c9f49dbaaa1043807c9bc3c8f7ad0ad9f"} Jul 29 15:11:15.601025 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.601000 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" event={"ID":"884f985d-22bd-4949-803b-1017821334ee","Type":"ContainerStarted","Data":"6df09b26c19626518d897195b76ed1a300b54d2e196d8e64ee8eb98dab61f8a4"} Jul 29 15:11:15.602079 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.602061 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dfzkw" event={"ID":"8bba0468-80b0-4f39-b48d-750abab54434","Type":"ContainerStarted","Data":"25a85a879070b1bb12b944228c07c8fdb118b8fef8aa50fbbffc6bd647826acc"} Jul 29 15:11:15.606573 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.606544 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hg5g5" event={"ID":"a62548fe-f4bb-4879-9064-aacaf57d3e92","Type":"ContainerStarted","Data":"4317dda0320c8d166a5ca74383b48bad8f97a96b9cc185a7df0244357b02f58c"} Jul 29 15:11:15.607675 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.607652 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tf8mz" event={"ID":"6a34235c-e10d-46fe-a587-a82f67340159","Type":"ContainerStarted","Data":"e4b7e54f1229cb05bb6b16f20e08cad1ae0d4594c60c6ed81c7a0c417b07ea45"} Jul 29 15:11:15.608733 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.608711 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-278pz" event={"ID":"12648377-79cc-4ee8-afe6-8ad892fc5512","Type":"ContainerStarted","Data":"098858cc891650ab3344623edd38fa51845979e45cda2929d8396f31db9e86e4"} Jul 29 15:11:15.611469 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.611425 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-249.ec2.internal" podStartSLOduration=1.611413542 podStartE2EDuration="1.611413542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:15.61106345 +0000 UTC m=+3.597405030" watchObservedRunningTime="2026-07-29 15:11:15.611413542 +0000 UTC m=+3.597755129" Jul 29 15:11:15.731962 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:15.731932 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:11:16.047388 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:16.047333 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:16.047617 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:16.047410 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:16.047617 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:16.047589 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:16.047753 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:16.047664 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs podName:d55803f3-c21e-4eb0-aeca-8877eae6a64b nodeName:}" failed. No retries permitted until 2026-07-29 15:11:18.047641762 +0000 UTC m=+6.033983328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs") pod "network-metrics-daemon-5dntz" (UID: "d55803f3-c21e-4eb0-aeca-8877eae6a64b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:16.047753 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:16.047735 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:16.047873 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:16.047771 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret podName:429076a7-cb20-464f-9ab9-c29ab3c80773 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:18.047759457 +0000 UTC m=+6.034101024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret") pod "global-pull-secret-syncer-78zcw" (UID: "429076a7-cb20-464f-9ab9-c29ab3c80773") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:16.249120 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:16.248424 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7ps\" (UniqueName: \"kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps\") pod \"network-check-target-nrddt\" (UID: \"8fc5b1de-0e23-44f7-ac91-189edba9bc37\") " pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:16.249120 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:16.248628 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:11:16.249120 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:16.248654 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:11:16.249120 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:16.248670 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8v7ps for pod openshift-network-diagnostics/network-check-target-nrddt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:16.249120 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:16.248737 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps podName:8fc5b1de-0e23-44f7-ac91-189edba9bc37 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:18.248716165 +0000 UTC m=+6.235057734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8v7ps" (UniqueName: "kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps") pod "network-check-target-nrddt" (UID: "8fc5b1de-0e23-44f7-ac91-189edba9bc37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:16.489082 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:16.488916 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 15:06:14 +0000 UTC" deadline="2028-01-18 07:57:28.529376765 +0000 UTC" Jul 29 15:11:16.489082 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:16.488991 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12904h46m12.040391522s" Jul 29 15:11:16.584731 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:16.584699 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:16.584941 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:16.584861 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:16.585274 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:16.585253 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:16.585368 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:16.585348 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:16.585439 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:16.585428 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:16.585524 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:16.585507 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:18.066155 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:18.066116 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:18.066725 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:18.066213 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:18.066725 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:18.066372 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:18.066725 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:18.066444 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret podName:429076a7-cb20-464f-9ab9-c29ab3c80773 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:22.066422324 +0000 UTC m=+10.052763893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret") pod "global-pull-secret-syncer-78zcw" (UID: "429076a7-cb20-464f-9ab9-c29ab3c80773") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:18.067000 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:18.066977 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:18.067055 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:18.067043 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs podName:d55803f3-c21e-4eb0-aeca-8877eae6a64b nodeName:}" failed. No retries permitted until 2026-07-29 15:11:22.067025476 +0000 UTC m=+10.053367043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs") pod "network-metrics-daemon-5dntz" (UID: "d55803f3-c21e-4eb0-aeca-8877eae6a64b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:18.267620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:18.267578 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7ps\" (UniqueName: \"kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps\") pod \"network-check-target-nrddt\" (UID: \"8fc5b1de-0e23-44f7-ac91-189edba9bc37\") " pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:18.267793 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:18.267763 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:11:18.267793 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:18.267787 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:11:18.267920 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:18.267801 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8v7ps for pod openshift-network-diagnostics/network-check-target-nrddt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:18.267920 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:18.267861 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps podName:8fc5b1de-0e23-44f7-ac91-189edba9bc37 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:22.267842456 +0000 UTC m=+10.254184024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8v7ps" (UniqueName: "kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps") pod "network-check-target-nrddt" (UID: "8fc5b1de-0e23-44f7-ac91-189edba9bc37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:18.584925 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:18.584867 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:18.585104 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:18.584999 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:18.585680 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:18.585404 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:18.585680 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:18.585505 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:18.585680 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:18.584831 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:18.585925 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:18.585703 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:20.584741 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:20.584646 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:20.585192 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:20.584814 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:20.585264 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:20.585243 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:20.585351 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:20.585328 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:20.589933 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:20.585803 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:20.589933 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:20.586146 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:22.104246 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:22.104203 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:22.104748 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:22.104258 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:22.104748 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:22.104370 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:22.104748 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:22.104371 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:22.104748 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:22.104427 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs podName:d55803f3-c21e-4eb0-aeca-8877eae6a64b nodeName:}" failed. No retries permitted until 2026-07-29 15:11:30.104410138 +0000 UTC m=+18.090751713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs") pod "network-metrics-daemon-5dntz" (UID: "d55803f3-c21e-4eb0-aeca-8877eae6a64b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:22.104748 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:22.104447 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret podName:429076a7-cb20-464f-9ab9-c29ab3c80773 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:30.104437642 +0000 UTC m=+18.090779211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret") pod "global-pull-secret-syncer-78zcw" (UID: "429076a7-cb20-464f-9ab9-c29ab3c80773") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:22.305843 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:22.305592 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7ps\" (UniqueName: \"kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps\") pod \"network-check-target-nrddt\" (UID: \"8fc5b1de-0e23-44f7-ac91-189edba9bc37\") " pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:22.305843 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:22.305765 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:11:22.305843 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:22.305789 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:11:22.305843 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:22.305802 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8v7ps for pod openshift-network-diagnostics/network-check-target-nrddt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:22.306194 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:22.305871 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps podName:8fc5b1de-0e23-44f7-ac91-189edba9bc37 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:30.305851425 +0000 UTC m=+18.292192987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8v7ps" (UniqueName: "kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps") pod "network-check-target-nrddt" (UID: "8fc5b1de-0e23-44f7-ac91-189edba9bc37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:22.585361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:22.585281 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:22.585533 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:22.585394 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:22.585676 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:22.585612 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:22.585808 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:22.585709 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:22.585808 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:22.585775 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:22.585922 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:22.585859 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:24.584695 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:24.584654 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:24.585192 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:24.584796 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:24.585192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:24.584671 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:24.585313 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:24.585192 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:24.585313 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:24.585186 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:24.585313 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:24.585291 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:26.584731 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:26.584682 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:26.585109 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:26.584687 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:26.585109 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:26.584815 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:26.585109 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:26.584824 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:26.585109 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:26.584931 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:26.585109 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:26.585033 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:28.583940 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:28.583909 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:28.584315 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:28.583946 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:28.584315 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:28.583910 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:28.584315 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:28.584045 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:28.584315 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:28.584129 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:28.584315 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:28.584201 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:30.162734 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:30.162692 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:30.163212 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:30.162745 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:30.163212 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:30.162850 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:30.163212 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:30.162910 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs podName:d55803f3-c21e-4eb0-aeca-8877eae6a64b nodeName:}" failed. No retries permitted until 2026-07-29 15:11:46.16289227 +0000 UTC m=+34.149233851 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs") pod "network-metrics-daemon-5dntz" (UID: "d55803f3-c21e-4eb0-aeca-8877eae6a64b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:30.163212 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:30.162850 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:30.163212 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:30.163004 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret podName:429076a7-cb20-464f-9ab9-c29ab3c80773 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:46.162980896 +0000 UTC m=+34.149322477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret") pod "global-pull-secret-syncer-78zcw" (UID: "429076a7-cb20-464f-9ab9-c29ab3c80773") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:30.363813 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:30.363779 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7ps\" (UniqueName: \"kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps\") pod \"network-check-target-nrddt\" (UID: \"8fc5b1de-0e23-44f7-ac91-189edba9bc37\") " pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:30.364002 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:30.363979 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:11:30.364065 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:30.364009 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:11:30.364065 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:30.364022 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8v7ps for pod openshift-network-diagnostics/network-check-target-nrddt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:30.364158 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:30.364093 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps podName:8fc5b1de-0e23-44f7-ac91-189edba9bc37 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:46.364072237 +0000 UTC m=+34.350413813 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8v7ps" (UniqueName: "kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps") pod "network-check-target-nrddt" (UID: "8fc5b1de-0e23-44f7-ac91-189edba9bc37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:30.584091 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:30.584002 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:30.584261 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:30.584002 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:30.584261 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:30.584126 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:30.584261 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:30.584233 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:30.584420 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:30.584010 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:30.584420 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:30.584328 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:32.585570 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:32.585514 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:32.585979 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:32.585633 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:32.585979 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:32.585652 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:32.585979 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:32.585755 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:32.585979 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:32.585770 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:32.585979 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:32.585816 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:34.586288 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:34.584554 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:34.586288 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:34.584915 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:34.586288 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:34.585014 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:34.586288 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:34.585125 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:34.586288 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:34.585170 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:34.586288 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:34.585282 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:34.653474 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:34.653437 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hg5g5" event={"ID":"a62548fe-f4bb-4879-9064-aacaf57d3e92","Type":"ContainerStarted","Data":"a8e161959429d591a4604103dd13596558935dd9ef0fef3fa458e89ec9e92395"} Jul 29 15:11:34.655461 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:34.655437 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tf8mz" event={"ID":"6a34235c-e10d-46fe-a587-a82f67340159","Type":"ContainerStarted","Data":"657269b53007bbd36c67641ac7b30343c2090c3b7dd57e317efbdf6ff970621a"} Jul 29 15:11:34.657668 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:34.657635 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" event={"ID":"7151ff77-5c06-4299-a2ed-26acec1819a8","Type":"ContainerStarted","Data":"a63697ebe3d5a4c422718da90dcab3afd19af0bda882bae5918437de4b1aed3e"} Jul 29 15:11:34.657812 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:34.657729 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" event={"ID":"7151ff77-5c06-4299-a2ed-26acec1819a8","Type":"ContainerStarted","Data":"467cc6eda6bb246b06bc528f6f84fc8898208178b4b749e5dd42f3d6c6dd42c0"} Jul 29 15:11:34.659707 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:34.659430 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" event={"ID":"66ba070d-c0ab-46ba-ba87-9176588d9ef1","Type":"ContainerStarted","Data":"bbc3c9b9b20d1c53ff120c3c5a826329cc3df34af52bdd78a1a079dd92ced8c2"} Jul 29 15:11:34.700176 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:34.700110 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hg5g5" podStartSLOduration=2.695576023 podStartE2EDuration="21.700089744s" totalImagesPullingTime="19.004513721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:34.677628762 +0000 UTC m=+22.663970348" watchObservedRunningTime="2026-07-29 15:11:34.700089744 +0000 UTC m=+22.686431328" Jul 29 15:11:34.700464 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:34.700431 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6cwdl" podStartSLOduration=2.740318079 podStartE2EDuration="21.700418552s" totalImagesPullingTime="18.960100473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:34.699868248 +0000 UTC m=+22.686209826" watchObservedRunningTime="2026-07-29 15:11:34.700418552 +0000 UTC m=+22.686760138" Jul 29 15:11:35.663379 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.663104 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" event={"ID":"884f985d-22bd-4949-803b-1017821334ee","Type":"ContainerStarted","Data":"e1d2f191f48f01aceaeba683269bde7845292743d036285b4f69e79ee8a96acc"} Jul 29 15:11:35.664610 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.664585 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dfzkw" event={"ID":"8bba0468-80b0-4f39-b48d-750abab54434","Type":"ContainerStarted","Data":"3c500074d21af009ddd741c58279c83704f9591a302eef4662a55974bc1b6a33"} Jul 29 15:11:35.665971 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.665937 2554 generic.go:356] "Generic (PLEG): container finished" podID="6a34235c-e10d-46fe-a587-a82f67340159" containerID="657269b53007bbd36c67641ac7b30343c2090c3b7dd57e317efbdf6ff970621a" exitCode=0 Jul 29 15:11:35.666056 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.666027 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tf8mz" event={"ID":"6a34235c-e10d-46fe-a587-a82f67340159","Type":"ContainerDied","Data":"657269b53007bbd36c67641ac7b30343c2090c3b7dd57e317efbdf6ff970621a"} Jul 29 15:11:35.667431 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.667410 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-278pz" event={"ID":"12648377-79cc-4ee8-afe6-8ad892fc5512","Type":"ContainerStarted","Data":"f1a66e3f1c14f8a91b7b8c327c989e76fe8d35d67c8db5758104e18c646c9abf"} Jul 29 15:11:35.669080 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.669057 2554 generic.go:356] "Generic (PLEG): container finished" podID="821386d642f6644e924f0e1083c6b0a3" containerID="eef803537ff21c183103032e84367968981fa8a3e8ca0d2ba2bde9b01e11ed1c" exitCode=0 Jul 29 15:11:35.669195 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.669108 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" event={"ID":"821386d642f6644e924f0e1083c6b0a3","Type":"ContainerDied","Data":"eef803537ff21c183103032e84367968981fa8a3e8ca0d2ba2bde9b01e11ed1c"} Jul 29 15:11:35.670569 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.670548 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6jtbt" event={"ID":"586ac960-ad80-4322-87ed-9daf5c1fb30e","Type":"ContainerStarted","Data":"3d206fb1970252a4068a0ea90e15e19dff45432ea26023c12691712a0395a9fb"} Jul 29 15:11:35.673407 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.673385 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" event={"ID":"7151ff77-5c06-4299-a2ed-26acec1819a8","Type":"ContainerStarted","Data":"c5dec6ba46137a642ce3b4e37cd00f1c5c7c39bdcfb3ded0911f204055c8c1ec"} Jul 29 15:11:35.673514 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.673447 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" event={"ID":"7151ff77-5c06-4299-a2ed-26acec1819a8","Type":"ContainerStarted","Data":"314893f4d07a83b86d83dcf9a979c0c02e278c467c8af0ef898e00dd47ca5a6b"} Jul 29 15:11:35.673514 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.673487 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" event={"ID":"7151ff77-5c06-4299-a2ed-26acec1819a8","Type":"ContainerStarted","Data":"d9d6bf333eb4cc8142d26999559c94e0c1d9d89eac2792f1f14dd3658ad789fe"} Jul 29 15:11:35.673635 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.673537 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" event={"ID":"7151ff77-5c06-4299-a2ed-26acec1819a8","Type":"ContainerStarted","Data":"f4098d39c418e26f9312a900ddffd4d67625a2251de700b2e3e22472d6572f76"} Jul 29 15:11:35.674625 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.674598 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4dcs2" event={"ID":"909564e0-0977-4595-9382-9893dc1cc7da","Type":"ContainerStarted","Data":"99f71848ad7c3de881318f4cf68d42cf8c6a5b7903f7b9dab5dc7dbebf154e43"} Jul 29 15:11:35.704258 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.704205 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dfzkw" podStartSLOduration=3.7607227 podStartE2EDuration="22.704184457s" totalImagesPullingTime="18.943461757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:35.68276835 +0000 UTC m=+23.669109925" watchObservedRunningTime="2026-07-29 15:11:35.704184457 +0000 UTC m=+23.690526044" Jul 29 15:11:35.704752 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.704722 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-278pz" podStartSLOduration=3.7476868850000002 podStartE2EDuration="22.704713359s" totalImagesPullingTime="18.957026474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:35.704182891 +0000 UTC m=+23.690524475" watchObservedRunningTime="2026-07-29 15:11:35.704713359 +0000 UTC m=+23.691054944" Jul 29 15:11:35.724793 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.724747 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4dcs2" podStartSLOduration=3.771302279 podStartE2EDuration="22.72473085s" totalImagesPullingTime="18.953428571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:35.724358931 +0000 UTC m=+23.710700520" watchObservedRunningTime="2026-07-29 15:11:35.72473085 +0000 UTC m=+23.711072459" Jul 29 15:11:35.760428 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.760376 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6jtbt" podStartSLOduration=3.818356361 podStartE2EDuration="22.760357821s" totalImagesPullingTime="18.94200146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:35.760298652 +0000 UTC m=+23.746640233" watchObservedRunningTime="2026-07-29 15:11:35.760357821 +0000 UTC m=+23.746699405" Jul 29 15:11:35.922731 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:35.922644 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:36.029219 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:36.029188 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:36.100374 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:36.100345 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:36.174853 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:36.174767 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:36.304184 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:36.304151 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:36.584250 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:36.584171 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:36.584513 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:36.584175 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:36.584513 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:36.584320 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:36.584513 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:36.584365 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:36.584513 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:36.584437 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:36.584513 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:36.584481 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:36.679417 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:36.679354 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" event={"ID":"821386d642f6644e924f0e1083c6b0a3","Type":"ContainerStarted","Data":"77f455eef0faf9b04f5a2016e3f2691eae11d72d19281b6d4340c1fdca153087"} Jul 29 15:11:36.699118 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:36.699063 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-249.ec2.internal" podStartSLOduration=22.699045536 podStartE2EDuration="22.699045536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:36.698540025 +0000 UTC m=+24.684881601" watchObservedRunningTime="2026-07-29 15:11:36.699045536 +0000 UTC m=+24.685387121" Jul 29 15:11:36.950421 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:36.950287 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6jtbt" Jul 29 15:11:36.950990 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:36.950970 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6jtbt" Jul 29 15:11:37.686029 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:37.685989 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" event={"ID":"7151ff77-5c06-4299-a2ed-26acec1819a8","Type":"ContainerStarted","Data":"1d5c99e1f4a6f9403f58a7a0c83201b2a1752e98cd47725db79ccbbad97aea0f"} Jul 29 15:11:37.689313 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:37.689286 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" event={"ID":"884f985d-22bd-4949-803b-1017821334ee","Type":"ContainerStarted","Data":"dab6df88ba7043caf7febc9e686e0c954ff897dca7d7512689641d010635f34b"} Jul 29 15:11:37.689888 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:37.689850 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 15:11:38.496884 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:38.496749 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T15:11:37.689869719Z","UUID":"bfe63ec6-a41c-42cc-9dbf-4c6e10e6a5e1","Handler":null,"Name":"","Endpoint":""} Jul 29 15:11:38.498264 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:38.498243 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 15:11:38.498405 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:38.498287 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 15:11:38.583977 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:38.583938 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:38.584165 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:38.583944 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:38.584165 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:38.584078 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:38.584165 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:38.583944 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:38.584327 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:38.584157 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:38.584327 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:38.584227 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:38.656182 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:38.656149 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6jtbt" Jul 29 15:11:38.656808 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:38.656784 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6jtbt" Jul 29 15:11:38.728701 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:38.728667 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:39.518844 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:39.518805 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:39.602883 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:39.602848 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:40.253834 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.253659 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:40.354823 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.354792 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:40.584216 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.584133 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:40.584216 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.584181 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:40.584401 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:40.584265 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:40.584401 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.584333 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:40.584401 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:40.584350 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:40.584401 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:40.584398 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:40.696614 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.696577 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" event={"ID":"884f985d-22bd-4949-803b-1017821334ee","Type":"ContainerStarted","Data":"6115c64f844b7c9414a27ed87f1e10375464ea7f542f8cc2452fb732dc240743"} Jul 29 15:11:40.698296 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.698274 2554 generic.go:356] "Generic (PLEG): container finished" podID="6a34235c-e10d-46fe-a587-a82f67340159" containerID="33265c28c31b3090dc29f1cf13a590f863849c187d1fdc181b35880bb9ed9fe9" exitCode=0 Jul 29 15:11:40.698383 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.698358 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tf8mz" event={"ID":"6a34235c-e10d-46fe-a587-a82f67340159","Type":"ContainerDied","Data":"33265c28c31b3090dc29f1cf13a590f863849c187d1fdc181b35880bb9ed9fe9"} Jul 29 15:11:40.702083 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.702063 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" event={"ID":"7151ff77-5c06-4299-a2ed-26acec1819a8","Type":"ContainerStarted","Data":"46d9053c93b1279c22491010a049f0fe2f11ae12dbffc12eb475896f896080b2"} Jul 29 15:11:40.702349 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.702332 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:40.715003 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.714957 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dm4m" podStartSLOduration=3.6889328900000002 podStartE2EDuration="27.714941945s" totalImagesPullingTime="24.026009055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:11:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:40.714787045 +0000 UTC m=+28.701128629" watchObservedRunningTime="2026-07-29 15:11:40.714941945 +0000 UTC m=+28.701283529" Jul 29 15:11:40.718374 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.718350 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:40.742648 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:40.742596 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" podStartSLOduration=8.73687644 podStartE2EDuration="27.742581293s" totalImagesPullingTime="19.005704853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:40.742023372 +0000 UTC m=+28.728364957" watchObservedRunningTime="2026-07-29 15:11:40.742581293 +0000 UTC m=+28.728922877" Jul 29 15:11:41.704429 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:41.704395 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:41.705094 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:41.704787 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:41.722661 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:41.722631 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:11:41.882433 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:41.882401 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:41.959870 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:41.959794 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:42.378757 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:42.378548 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5dntz"] Jul 29 15:11:42.378952 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:42.378870 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:42.379002 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:42.378968 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:42.379313 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:42.379268 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-78zcw"] Jul 29 15:11:42.379444 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:42.379379 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:42.379506 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:42.379477 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:42.380138 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:42.379968 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nrddt"] Jul 29 15:11:42.380138 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:42.380054 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:42.380302 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:42.380177 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:42.708486 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:42.708450 2554 generic.go:356] "Generic (PLEG): container finished" podID="6a34235c-e10d-46fe-a587-a82f67340159" containerID="601837fc95392467a6d9ff7ad081523428086681e82c364c87c0909ee030e84a" exitCode=0 Jul 29 15:11:42.708992 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:42.708554 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tf8mz" event={"ID":"6a34235c-e10d-46fe-a587-a82f67340159","Type":"ContainerDied","Data":"601837fc95392467a6d9ff7ad081523428086681e82c364c87c0909ee030e84a"} Jul 29 15:11:43.584794 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:43.584576 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:43.584794 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:43.584728 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:44.417225 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:44.417138 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:44.584163 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:44.584125 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:44.584330 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:44.584250 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:44.584330 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:44.584284 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:44.584396 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:44.584332 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:44.715263 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:44.715226 2554 generic.go:356] "Generic (PLEG): container finished" podID="6a34235c-e10d-46fe-a587-a82f67340159" containerID="1ac3bbb83e9206ff5107727b7a103c9dce0cac57ff83d84f6ceafedf801433a1" exitCode=0 Jul 29 15:11:44.715437 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:44.715275 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tf8mz" event={"ID":"6a34235c-e10d-46fe-a587-a82f67340159","Type":"ContainerDied","Data":"1ac3bbb83e9206ff5107727b7a103c9dce0cac57ff83d84f6ceafedf801433a1"} Jul 29 15:11:45.584892 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:45.584856 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:45.585341 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:45.584984 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dntz" podUID="d55803f3-c21e-4eb0-aeca-8877eae6a64b" Jul 29 15:11:45.802248 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:45.802214 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:45.874807 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:45.874715 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:46.180569 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:46.180546 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:46.180747 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:46.180587 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:46.180747 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:46.180706 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:46.180857 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:46.180780 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret podName:429076a7-cb20-464f-9ab9-c29ab3c80773 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:18.180759714 +0000 UTC m=+66.167101295 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret") pod "global-pull-secret-syncer-78zcw" (UID: "429076a7-cb20-464f-9ab9-c29ab3c80773") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:11:46.180857 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:46.180710 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:46.180857 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:46.180844 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs podName:d55803f3-c21e-4eb0-aeca-8877eae6a64b nodeName:}" failed. No retries permitted until 2026-07-29 15:12:18.180828797 +0000 UTC m=+66.167170359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs") pod "network-metrics-daemon-5dntz" (UID: "d55803f3-c21e-4eb0-aeca-8877eae6a64b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:11:46.381320 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:46.381290 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7ps\" (UniqueName: \"kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps\") pod \"network-check-target-nrddt\" (UID: \"8fc5b1de-0e23-44f7-ac91-189edba9bc37\") " pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:46.381490 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:46.381441 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:11:46.381490 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:46.381462 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:11:46.381490 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:46.381473 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8v7ps for pod openshift-network-diagnostics/network-check-target-nrddt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:46.381645 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:46.381554 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps podName:8fc5b1de-0e23-44f7-ac91-189edba9bc37 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:18.38153603 +0000 UTC m=+66.367877607 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8v7ps" (UniqueName: "kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps") pod "network-check-target-nrddt" (UID: "8fc5b1de-0e23-44f7-ac91-189edba9bc37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:11:46.583912 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:46.583834 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:46.584082 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:46.583938 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrddt" podUID="8fc5b1de-0e23-44f7-ac91-189edba9bc37" Jul 29 15:11:46.584082 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:46.584011 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:46.584198 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:46.584100 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78zcw" podUID="429076a7-cb20-464f-9ab9-c29ab3c80773" Jul 29 15:11:46.678078 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:46.678039 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:46.749854 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:46.749820 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:47.294215 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.293980 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-249.ec2.internal" event="NodeReady" Jul 29 15:11:47.294394 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.294343 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 15:11:47.353377 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.353337 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fxk4d"] Jul 29 15:11:47.356837 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.356798 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rnq2g"] Jul 29 15:11:47.357001 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.356895 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:47.358680 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.358657 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rnq2g" Jul 29 15:11:47.359416 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.359394 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 15:11:47.359416 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.359409 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dw7hg\"" Jul 29 15:11:47.359609 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.359444 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 15:11:47.362986 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.362813 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 15:11:47.362986 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.362808 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2gcqd\"" Jul 29 15:11:47.362986 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.362866 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 15:11:47.362986 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.362880 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 15:11:47.365054 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.364995 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fxk4d"] Jul 29 15:11:47.368031 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.367975 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rnq2g"] Jul 29 15:11:47.488758 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.488724 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-tmp-dir\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:47.488950 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.488766 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkpjn\" (UniqueName: \"kubernetes.io/projected/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-kube-api-access-mkpjn\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:47.488950 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.488866 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-config-volume\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:47.488950 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.488906 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:47.488950 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.488931 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8006ac72-bec6-4b8c-91c4-0c815fce3ef5-cert\") pod \"ingress-canary-rnq2g\" (UID: \"8006ac72-bec6-4b8c-91c4-0c815fce3ef5\") " pod="openshift-ingress-canary/ingress-canary-rnq2g" Jul 29 15:11:47.489191 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.489010 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8z7g\" (UniqueName: \"kubernetes.io/projected/8006ac72-bec6-4b8c-91c4-0c815fce3ef5-kube-api-access-m8z7g\") pod \"ingress-canary-rnq2g\" (UID: \"8006ac72-bec6-4b8c-91c4-0c815fce3ef5\") " pod="openshift-ingress-canary/ingress-canary-rnq2g" Jul 29 15:11:47.515086 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.515054 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:47.584288 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.584201 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:11:47.586757 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.586733 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sgb7s\"" Jul 29 15:11:47.586757 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.586747 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:11:47.588314 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.588286 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:47.589314 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.589291 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8z7g\" (UniqueName: \"kubernetes.io/projected/8006ac72-bec6-4b8c-91c4-0c815fce3ef5-kube-api-access-m8z7g\") pod \"ingress-canary-rnq2g\" (UID: \"8006ac72-bec6-4b8c-91c4-0c815fce3ef5\") " pod="openshift-ingress-canary/ingress-canary-rnq2g" Jul 29 15:11:47.589421 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.589326 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-tmp-dir\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:47.589421 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.589355 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkpjn\" (UniqueName: \"kubernetes.io/projected/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-kube-api-access-mkpjn\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:47.589611 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.589593 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-config-volume\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:47.589690 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.589632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:47.589690 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.589657 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8006ac72-bec6-4b8c-91c4-0c815fce3ef5-cert\") pod \"ingress-canary-rnq2g\" (UID: \"8006ac72-bec6-4b8c-91c4-0c815fce3ef5\") " pod="openshift-ingress-canary/ingress-canary-rnq2g" Jul 29 15:11:47.589787 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.589706 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-tmp-dir\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:47.589787 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:47.589726 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:11:47.589787 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:47.589786 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls podName:bbde44aa-abf9-4bc5-a825-ad18c6e11fe2 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:48.089765236 +0000 UTC m=+36.076106811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls") pod "dns-default-fxk4d" (UID: "bbde44aa-abf9-4bc5-a825-ad18c6e11fe2") : secret "dns-default-metrics-tls" not found Jul 29 15:11:47.590170 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.590148 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-config-volume\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:47.595059 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.595035 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8006ac72-bec6-4b8c-91c4-0c815fce3ef5-cert\") pod \"ingress-canary-rnq2g\" (UID: \"8006ac72-bec6-4b8c-91c4-0c815fce3ef5\") " pod="openshift-ingress-canary/ingress-canary-rnq2g" Jul 29 15:11:47.602145 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.602123 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkpjn\" (UniqueName: \"kubernetes.io/projected/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-kube-api-access-mkpjn\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:47.602325 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.602305 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8z7g\" (UniqueName: \"kubernetes.io/projected/8006ac72-bec6-4b8c-91c4-0c815fce3ef5-kube-api-access-m8z7g\") pod \"ingress-canary-rnq2g\" (UID: \"8006ac72-bec6-4b8c-91c4-0c815fce3ef5\") " pod="openshift-ingress-canary/ingress-canary-rnq2g" Jul 29 15:11:47.677627 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:47.677586 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rnq2g" Jul 29 15:11:48.093999 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:48.093947 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:48.094559 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:48.094130 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:11:48.094559 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:48.094209 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls podName:bbde44aa-abf9-4bc5-a825-ad18c6e11fe2 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:49.094192302 +0000 UTC m=+37.080533865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls") pod "dns-default-fxk4d" (UID: "bbde44aa-abf9-4bc5-a825-ad18c6e11fe2") : secret "dns-default-metrics-tls" not found Jul 29 15:11:48.584897 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:48.584861 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:11:48.585082 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:48.584861 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:11:48.587929 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:48.587901 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cnmln\"" Jul 29 15:11:48.588097 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:48.587938 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 15:11:48.589058 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:48.589027 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:11:48.589182 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:48.589070 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 15:11:48.784205 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:48.784178 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rnq2g"] Jul 29 15:11:48.789540 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:11:48.789503 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8006ac72_bec6_4b8c_91c4_0c815fce3ef5.slice/crio-a005e720d8b6d910862298ab4d93bc0f5c77e7b893a38ecef135619513b1016c WatchSource:0}: Error finding container a005e720d8b6d910862298ab4d93bc0f5c77e7b893a38ecef135619513b1016c: Status 404 returned error can't find the container with id a005e720d8b6d910862298ab4d93bc0f5c77e7b893a38ecef135619513b1016c Jul 29 15:11:49.101212 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:49.101015 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:49.101212 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:49.101173 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:11:49.101868 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:49.101273 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls podName:bbde44aa-abf9-4bc5-a825-ad18c6e11fe2 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:51.101256149 +0000 UTC m=+39.087597711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls") pod "dns-default-fxk4d" (UID: "bbde44aa-abf9-4bc5-a825-ad18c6e11fe2") : secret "dns-default-metrics-tls" not found Jul 29 15:11:49.732598 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:49.732557 2554 generic.go:356] "Generic (PLEG): container finished" podID="6a34235c-e10d-46fe-a587-a82f67340159" containerID="c229179f8d4167b5a715d3085a1cac1503fd32723cea9f33b29efc763fdc11a3" exitCode=0 Jul 29 15:11:49.732789 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:49.732656 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tf8mz" event={"ID":"6a34235c-e10d-46fe-a587-a82f67340159","Type":"ContainerDied","Data":"c229179f8d4167b5a715d3085a1cac1503fd32723cea9f33b29efc763fdc11a3"} Jul 29 15:11:49.733931 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:49.733900 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rnq2g" event={"ID":"8006ac72-bec6-4b8c-91c4-0c815fce3ef5","Type":"ContainerStarted","Data":"a005e720d8b6d910862298ab4d93bc0f5c77e7b893a38ecef135619513b1016c"} Jul 29 15:11:50.591697 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:50.591643 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:50.660362 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:50.660328 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:50.739837 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:50.739761 2554 generic.go:356] "Generic (PLEG): container finished" podID="6a34235c-e10d-46fe-a587-a82f67340159" containerID="f64a0d59d010c40bb14e1dc6438403bc3159848ea99868a950d0796811401dcd" exitCode=0 Jul 29 15:11:50.739837 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:50.739811 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tf8mz" event={"ID":"6a34235c-e10d-46fe-a587-a82f67340159","Type":"ContainerDied","Data":"f64a0d59d010c40bb14e1dc6438403bc3159848ea99868a950d0796811401dcd"} Jul 29 15:11:51.118614 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:51.118567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:51.118827 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:51.118708 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:11:51.118827 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:51.118780 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls podName:bbde44aa-abf9-4bc5-a825-ad18c6e11fe2 nodeName:}" failed. No retries permitted until 2026-07-29 15:11:55.118761492 +0000 UTC m=+43.105103072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls") pod "dns-default-fxk4d" (UID: "bbde44aa-abf9-4bc5-a825-ad18c6e11fe2") : secret "dns-default-metrics-tls" not found Jul 29 15:11:51.497869 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:51.497841 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:51.613810 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:51.613774 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:51.744908 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:51.744871 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tf8mz" event={"ID":"6a34235c-e10d-46fe-a587-a82f67340159","Type":"ContainerStarted","Data":"a0b8a6d3ffe2a30916e11061d42bf19295ef9a268971034d7846bcf3f0bec2e7"} Jul 29 15:11:51.746334 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:51.746310 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rnq2g" event={"ID":"8006ac72-bec6-4b8c-91c4-0c815fce3ef5","Type":"ContainerStarted","Data":"c22c6c5ab830db1ac32d0b8e38d5ba99bc726d65dc5bef7d692c10a8f6b14094"} Jul 29 15:11:51.772668 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:51.772619 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tf8mz" podStartSLOduration=9.183038758 podStartE2EDuration="38.772600648s" totalImagesPullingTime="29.58956189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:11:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:51.771355123 +0000 UTC m=+39.757696707" watchObservedRunningTime="2026-07-29 15:11:51.772600648 +0000 UTC m=+39.758942232" Jul 29 15:11:51.790123 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:51.790074 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rnq2g" podStartSLOduration=2.159229044 podStartE2EDuration="4.790057876s" totalImagesPullingTime="2.630828832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:51.789874089 +0000 UTC m=+39.776215676" watchObservedRunningTime="2026-07-29 15:11:51.790057876 +0000 UTC m=+39.776399460" Jul 29 15:11:51.884039 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:51.884006 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:52.225772 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:52.225740 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:52.299939 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:52.299906 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:11:55.150858 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:11:55.150827 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:11:55.151241 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:55.150946 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:11:55.151241 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:11:55.150998 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls podName:bbde44aa-abf9-4bc5-a825-ad18c6e11fe2 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:03.150982569 +0000 UTC m=+51.137324130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls") pod "dns-default-fxk4d" (UID: "bbde44aa-abf9-4bc5-a825-ad18c6e11fe2") : secret "dns-default-metrics-tls" not found Jul 29 15:12:01.560536 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:01.560497 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:01.729146 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:01.729115 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:03.206723 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:03.206685 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:12:03.207211 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:03.206816 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:12:03.207211 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:03.206905 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls podName:bbde44aa-abf9-4bc5-a825-ad18c6e11fe2 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:19.206882379 +0000 UTC m=+67.193223944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls") pod "dns-default-fxk4d" (UID: "bbde44aa-abf9-4bc5-a825-ad18c6e11fe2") : secret "dns-default-metrics-tls" not found Jul 29 15:12:07.726951 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:07.726915 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:07.805083 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:07.805052 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:13.731025 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:13.730992 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqsvw" Jul 29 15:12:13.905105 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:13.905067 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:14.008229 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.008134 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-mjcr9"] Jul 29 15:12:14.032399 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.032368 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mjcr9" Jul 29 15:12:14.035775 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.035748 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qd9tn\"" Jul 29 15:12:14.036650 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.036627 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-mjcr9"] Jul 29 15:12:14.087754 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.087716 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:14.116782 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.116747 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms"] Jul 29 15:12:14.137187 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.137154 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q"] Jul 29 15:12:14.137363 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.137269 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:14.143676 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.143644 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:12:14.143847 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.143749 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 29 15:12:14.143847 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.143837 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vb9sd\"" Jul 29 15:12:14.144769 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.144745 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 29 15:12:14.161059 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.161027 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-584dfc7869-xd84w"] Jul 29 15:12:14.161210 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.161154 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" Jul 29 15:12:14.164341 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.164318 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 29 15:12:14.164470 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.164348 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lwgn7\"" Jul 29 15:12:14.164470 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.164423 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 29 15:12:14.164470 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.164442 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 29 15:12:14.172009 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.171987 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:12:14.181115 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.181089 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms"] Jul 29 15:12:14.181260 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.181126 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q"] Jul 29 15:12:14.181260 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.181140 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-584dfc7869-xd84w"] Jul 29 15:12:14.181260 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.181246 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.185220 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.185200 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 29 15:12:14.185401 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.185384 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 29 15:12:14.185446 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.185432 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 29 15:12:14.185581 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.185565 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 15:12:14.185679 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.185665 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 29 15:12:14.185801 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.185776 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ps6dj\"" Jul 29 15:12:14.185801 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.185789 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 15:12:14.188159 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.188133 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmbbq\" (UniqueName: \"kubernetes.io/projected/2a10e24c-671a-451d-b337-606787eae437-kube-api-access-lmbbq\") pod \"network-check-source-7d88cb55d8-mjcr9\" (UID: \"2a10e24c-671a-451d-b337-606787eae437\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mjcr9" Jul 29 15:12:14.288963 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.288867 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zmbc\" (UniqueName: \"kubernetes.io/projected/040aaca8-16f6-4126-a822-5043ca11b9a4-kube-api-access-8zmbc\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.288963 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.288907 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.288963 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.288931 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/045efd45-dcb2-4a29-86f5-ca6dabf56bbe-serving-cert\") pod \"service-ca-operator-5d6c75f84f-88d6q\" (UID: \"045efd45-dcb2-4a29-86f5-ca6dabf56bbe\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" Jul 29 15:12:14.289186 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.288974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94p7\" (UniqueName: \"kubernetes.io/projected/045efd45-dcb2-4a29-86f5-ca6dabf56bbe-kube-api-access-p94p7\") pod \"service-ca-operator-5d6c75f84f-88d6q\" (UID: \"045efd45-dcb2-4a29-86f5-ca6dabf56bbe\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" Jul 29 15:12:14.289186 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.289018 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/045efd45-dcb2-4a29-86f5-ca6dabf56bbe-config\") pod \"service-ca-operator-5d6c75f84f-88d6q\" (UID: \"045efd45-dcb2-4a29-86f5-ca6dabf56bbe\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" Jul 29 15:12:14.289186 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.289055 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmbbq\" (UniqueName: \"kubernetes.io/projected/2a10e24c-671a-451d-b337-606787eae437-kube-api-access-lmbbq\") pod \"network-check-source-7d88cb55d8-mjcr9\" (UID: \"2a10e24c-671a-451d-b337-606787eae437\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mjcr9" Jul 29 15:12:14.289186 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.289073 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-vzbms\" (UID: \"5787924b-c501-4a1f-a652-468d500715e2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:14.289186 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.289090 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-default-certificate\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.289186 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.289179 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.289359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.289220 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rnnl\" (UniqueName: \"kubernetes.io/projected/5787924b-c501-4a1f-a652-468d500715e2-kube-api-access-4rnnl\") pod \"cluster-samples-operator-6748489656-vzbms\" (UID: \"5787924b-c501-4a1f-a652-468d500715e2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:14.289359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.289274 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-stats-auth\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.302662 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.302633 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 15:12:14.313270 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.313244 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 15:12:14.325139 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.325107 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmbbq\" (UniqueName: \"kubernetes.io/projected/2a10e24c-671a-451d-b337-606787eae437-kube-api-access-lmbbq\") pod \"network-check-source-7d88cb55d8-mjcr9\" (UID: \"2a10e24c-671a-451d-b337-606787eae437\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mjcr9" Jul 29 15:12:14.341773 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.341736 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mjcr9" Jul 29 15:12:14.389868 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.389832 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmbc\" (UniqueName: \"kubernetes.io/projected/040aaca8-16f6-4126-a822-5043ca11b9a4-kube-api-access-8zmbc\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.389868 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.389872 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.390121 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.389987 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/045efd45-dcb2-4a29-86f5-ca6dabf56bbe-serving-cert\") pod \"service-ca-operator-5d6c75f84f-88d6q\" (UID: \"045efd45-dcb2-4a29-86f5-ca6dabf56bbe\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" Jul 29 15:12:14.390121 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.390016 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p94p7\" (UniqueName: \"kubernetes.io/projected/045efd45-dcb2-4a29-86f5-ca6dabf56bbe-kube-api-access-p94p7\") pod \"service-ca-operator-5d6c75f84f-88d6q\" (UID: \"045efd45-dcb2-4a29-86f5-ca6dabf56bbe\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" Jul 29 15:12:14.390121 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.390066 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/045efd45-dcb2-4a29-86f5-ca6dabf56bbe-config\") pod \"service-ca-operator-5d6c75f84f-88d6q\" (UID: \"045efd45-dcb2-4a29-86f5-ca6dabf56bbe\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" Jul 29 15:12:14.390121 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.390099 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-vzbms\" (UID: \"5787924b-c501-4a1f-a652-468d500715e2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:14.390316 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.390141 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-default-certificate\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.390316 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.390192 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.390316 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.390228 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rnnl\" (UniqueName: \"kubernetes.io/projected/5787924b-c501-4a1f-a652-468d500715e2-kube-api-access-4rnnl\") pod \"cluster-samples-operator-6748489656-vzbms\" (UID: \"5787924b-c501-4a1f-a652-468d500715e2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:14.390316 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:14.390264 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 15:12:14.390498 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:14.390325 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls podName:5787924b-c501-4a1f-a652-468d500715e2 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:14.890304506 +0000 UTC m=+62.876646082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls") pod "cluster-samples-operator-6748489656-vzbms" (UID: "5787924b-c501-4a1f-a652-468d500715e2") : secret "samples-operator-tls" not found Jul 29 15:12:14.390498 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.390293 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-stats-auth\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.390498 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:14.390352 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 15:12:14.390498 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:14.390390 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs podName:040aaca8-16f6-4126-a822-5043ca11b9a4 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:14.890377584 +0000 UTC m=+62.876719146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs") pod "router-default-584dfc7869-xd84w" (UID: "040aaca8-16f6-4126-a822-5043ca11b9a4") : secret "router-metrics-certs-default" not found Jul 29 15:12:14.390498 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:14.390410 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle podName:040aaca8-16f6-4126-a822-5043ca11b9a4 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:14.89040061 +0000 UTC m=+62.876742178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle") pod "router-default-584dfc7869-xd84w" (UID: "040aaca8-16f6-4126-a822-5043ca11b9a4") : configmap references non-existent config key: service-ca.crt Jul 29 15:12:14.390901 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.390881 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/045efd45-dcb2-4a29-86f5-ca6dabf56bbe-config\") pod \"service-ca-operator-5d6c75f84f-88d6q\" (UID: \"045efd45-dcb2-4a29-86f5-ca6dabf56bbe\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" Jul 29 15:12:14.392807 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.392783 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-stats-auth\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.392916 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.392815 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/045efd45-dcb2-4a29-86f5-ca6dabf56bbe-serving-cert\") pod \"service-ca-operator-5d6c75f84f-88d6q\" (UID: \"045efd45-dcb2-4a29-86f5-ca6dabf56bbe\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" Jul 29 15:12:14.392962 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.392946 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-default-certificate\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.396119 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.396077 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:14.400029 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.400006 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zmbc\" (UniqueName: \"kubernetes.io/projected/040aaca8-16f6-4126-a822-5043ca11b9a4-kube-api-access-8zmbc\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.403303 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.403277 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94p7\" (UniqueName: \"kubernetes.io/projected/045efd45-dcb2-4a29-86f5-ca6dabf56bbe-kube-api-access-p94p7\") pod \"service-ca-operator-5d6c75f84f-88d6q\" (UID: \"045efd45-dcb2-4a29-86f5-ca6dabf56bbe\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" Jul 29 15:12:14.403561 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.403544 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rnnl\" (UniqueName: \"kubernetes.io/projected/5787924b-c501-4a1f-a652-468d500715e2-kube-api-access-4rnnl\") pod \"cluster-samples-operator-6748489656-vzbms\" (UID: \"5787924b-c501-4a1f-a652-468d500715e2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:14.469994 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.469962 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" Jul 29 15:12:14.486964 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.486913 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:14.488095 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.488072 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-mjcr9"] Jul 29 15:12:14.491469 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:12:14.491442 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a10e24c_671a_451d_b337_606787eae437.slice/crio-dd4107d1356b551deb4774e1c0bf65479effd0a156bbdae2feda4e5d4c7a53e4 WatchSource:0}: Error finding container dd4107d1356b551deb4774e1c0bf65479effd0a156bbdae2feda4e5d4c7a53e4: Status 404 returned error can't find the container with id dd4107d1356b551deb4774e1c0bf65479effd0a156bbdae2feda4e5d4c7a53e4 Jul 29 15:12:14.611662 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.611631 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q"] Jul 29 15:12:14.614709 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:12:14.614682 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod045efd45_dcb2_4a29_86f5_ca6dabf56bbe.slice/crio-1ea3277c68a941c6639ac7ccab72126cd831ff6e93fae04634818c5509b9b0b5 WatchSource:0}: Error finding container 1ea3277c68a941c6639ac7ccab72126cd831ff6e93fae04634818c5509b9b0b5: Status 404 returned error can't find the container with id 1ea3277c68a941c6639ac7ccab72126cd831ff6e93fae04634818c5509b9b0b5 Jul 29 15:12:14.799059 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.799026 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" event={"ID":"045efd45-dcb2-4a29-86f5-ca6dabf56bbe","Type":"ContainerStarted","Data":"1ea3277c68a941c6639ac7ccab72126cd831ff6e93fae04634818c5509b9b0b5"} Jul 29 15:12:14.800115 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.800089 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mjcr9" event={"ID":"2a10e24c-671a-451d-b337-606787eae437","Type":"ContainerStarted","Data":"dd4107d1356b551deb4774e1c0bf65479effd0a156bbdae2feda4e5d4c7a53e4"} Jul 29 15:12:14.895078 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.894978 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.895266 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.895078 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:14.895266 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:14.895096 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 15:12:14.895266 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:14.895137 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-vzbms\" (UID: \"5787924b-c501-4a1f-a652-468d500715e2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:14.895266 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:14.895162 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs podName:040aaca8-16f6-4126-a822-5043ca11b9a4 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:15.89514237 +0000 UTC m=+63.881483948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs") pod "router-default-584dfc7869-xd84w" (UID: "040aaca8-16f6-4126-a822-5043ca11b9a4") : secret "router-metrics-certs-default" not found Jul 29 15:12:14.895266 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:14.895256 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle podName:040aaca8-16f6-4126-a822-5043ca11b9a4 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:15.895236677 +0000 UTC m=+63.881578258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle") pod "router-default-584dfc7869-xd84w" (UID: "040aaca8-16f6-4126-a822-5043ca11b9a4") : configmap references non-existent config key: service-ca.crt Jul 29 15:12:14.895462 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:14.895297 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 15:12:14.895462 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:14.895349 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls podName:5787924b-c501-4a1f-a652-468d500715e2 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:15.895336268 +0000 UTC m=+63.881677830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls") pod "cluster-samples-operator-6748489656-vzbms" (UID: "5787924b-c501-4a1f-a652-468d500715e2") : secret "samples-operator-tls" not found Jul 29 15:12:15.904208 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:15.903991 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:15.904208 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:15.904114 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:15.904208 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:15.904172 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-vzbms\" (UID: \"5787924b-c501-4a1f-a652-468d500715e2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:15.904813 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:15.904172 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 15:12:15.904813 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:15.904278 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle podName:040aaca8-16f6-4126-a822-5043ca11b9a4 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:17.904256151 +0000 UTC m=+65.890597718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle") pod "router-default-584dfc7869-xd84w" (UID: "040aaca8-16f6-4126-a822-5043ca11b9a4") : configmap references non-existent config key: service-ca.crt Jul 29 15:12:15.904813 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:15.904306 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs podName:040aaca8-16f6-4126-a822-5043ca11b9a4 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:17.904295816 +0000 UTC m=+65.890637382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs") pod "router-default-584dfc7869-xd84w" (UID: "040aaca8-16f6-4126-a822-5043ca11b9a4") : secret "router-metrics-certs-default" not found Jul 29 15:12:15.904813 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:15.904356 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 15:12:15.904813 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:15.904396 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls podName:5787924b-c501-4a1f-a652-468d500715e2 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:17.90437834 +0000 UTC m=+65.890719954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls") pod "cluster-samples-operator-6748489656-vzbms" (UID: "5787924b-c501-4a1f-a652-468d500715e2") : secret "samples-operator-tls" not found Jul 29 15:12:16.605140 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:16.605107 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:16.679935 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:16.679899 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:17.923223 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:17.923180 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:17.923769 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:17.923261 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:17.923769 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:17.923297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-vzbms\" (UID: \"5787924b-c501-4a1f-a652-468d500715e2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:17.923769 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:17.923311 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 15:12:17.923769 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:17.923398 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs podName:040aaca8-16f6-4126-a822-5043ca11b9a4 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:21.923375174 +0000 UTC m=+69.909716744 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs") pod "router-default-584dfc7869-xd84w" (UID: "040aaca8-16f6-4126-a822-5043ca11b9a4") : secret "router-metrics-certs-default" not found Jul 29 15:12:17.923769 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:17.923402 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 15:12:17.923769 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:17.923422 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle podName:040aaca8-16f6-4126-a822-5043ca11b9a4 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:21.923406995 +0000 UTC m=+69.909748560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle") pod "router-default-584dfc7869-xd84w" (UID: "040aaca8-16f6-4126-a822-5043ca11b9a4") : configmap references non-existent config key: service-ca.crt Jul 29 15:12:17.923769 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:17.923448 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls podName:5787924b-c501-4a1f-a652-468d500715e2 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:21.923438927 +0000 UTC m=+69.909780495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls") pod "cluster-samples-operator-6748489656-vzbms" (UID: "5787924b-c501-4a1f-a652-468d500715e2") : secret "samples-operator-tls" not found Jul 29 15:12:18.225811 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.225771 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:12:18.225996 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.225834 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:12:18.228431 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.228415 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:12:18.228646 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.228634 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:12:18.236297 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:18.236268 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 15:12:18.236375 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:18.236342 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs podName:d55803f3-c21e-4eb0-aeca-8877eae6a64b nodeName:}" failed. No retries permitted until 2026-07-29 15:13:22.236322321 +0000 UTC m=+130.222663896 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs") pod "network-metrics-daemon-5dntz" (UID: "d55803f3-c21e-4eb0-aeca-8877eae6a64b") : secret "metrics-daemon-secret" not found Jul 29 15:12:18.238515 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.238490 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/429076a7-cb20-464f-9ab9-c29ab3c80773-original-pull-secret\") pod \"global-pull-secret-syncer-78zcw\" (UID: \"429076a7-cb20-464f-9ab9-c29ab3c80773\") " pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:12:18.296617 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.296583 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78zcw" Jul 29 15:12:18.427681 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.427642 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7ps\" (UniqueName: \"kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps\") pod \"network-check-target-nrddt\" (UID: \"8fc5b1de-0e23-44f7-ac91-189edba9bc37\") " pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:12:18.429037 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.428994 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-78zcw"] Jul 29 15:12:18.430495 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.430475 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v7ps\" (UniqueName: \"kubernetes.io/projected/8fc5b1de-0e23-44f7-ac91-189edba9bc37-kube-api-access-8v7ps\") pod \"network-check-target-nrddt\" (UID: \"8fc5b1de-0e23-44f7-ac91-189edba9bc37\") " pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:12:18.432882 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:12:18.432859 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429076a7_cb20_464f_9ab9_c29ab3c80773.slice/crio-685481ecffc54c259d3d47c485e7f0f4c5874b084a18a117cdadfc4a68412d8c WatchSource:0}: Error finding container 685481ecffc54c259d3d47c485e7f0f4c5874b084a18a117cdadfc4a68412d8c: Status 404 returned error can't find the container with id 685481ecffc54c259d3d47c485e7f0f4c5874b084a18a117cdadfc4a68412d8c Jul 29 15:12:18.605420 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.605338 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cnmln\"" Jul 29 15:12:18.613377 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.613355 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:12:18.733389 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.733360 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:18.762544 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.762498 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nrddt"] Jul 29 15:12:18.765772 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:12:18.765731 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc5b1de_0e23_44f7_ac91_189edba9bc37.slice/crio-e474f0d46ae79b1fe5b8439eacd6229cba4522c593093504f80e23114cdcdd18 WatchSource:0}: Error finding container e474f0d46ae79b1fe5b8439eacd6229cba4522c593093504f80e23114cdcdd18: Status 404 returned error can't find the container with id e474f0d46ae79b1fe5b8439eacd6229cba4522c593093504f80e23114cdcdd18 Jul 29 15:12:18.811494 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.811462 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-78zcw" event={"ID":"429076a7-cb20-464f-9ab9-c29ab3c80773","Type":"ContainerStarted","Data":"685481ecffc54c259d3d47c485e7f0f4c5874b084a18a117cdadfc4a68412d8c"} Jul 29 15:12:18.812859 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.812833 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nrddt" event={"ID":"8fc5b1de-0e23-44f7-ac91-189edba9bc37","Type":"ContainerStarted","Data":"e474f0d46ae79b1fe5b8439eacd6229cba4522c593093504f80e23114cdcdd18"} Jul 29 15:12:18.814462 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.814439 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" event={"ID":"045efd45-dcb2-4a29-86f5-ca6dabf56bbe","Type":"ContainerStarted","Data":"b70c0a5ce01ae027cb856505c3ff5f1fa7daff7601d042f058902fac69f87b78"} Jul 29 15:12:18.816139 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.816114 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mjcr9" event={"ID":"2a10e24c-671a-451d-b337-606787eae437","Type":"ContainerStarted","Data":"376edf44b7e363aa4e7a8601a302a072e0b2d5434e4c7cc31d3d647e70df43ad"} Jul 29 15:12:18.834189 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.834142 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" podStartSLOduration=1.6870015390000002 podStartE2EDuration="4.834125361s" totalImagesPullingTime="3.147123822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:18.833438257 +0000 UTC m=+66.819779872" watchObservedRunningTime="2026-07-29 15:12:18.834125361 +0000 UTC m=+66.820466959" Jul 29 15:12:18.837051 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.837024 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:18.852889 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.852839 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mjcr9" podStartSLOduration=2.577638187 podStartE2EDuration="5.852818955s" totalImagesPullingTime="3.275180768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:18.852199836 +0000 UTC m=+66.838541425" watchObservedRunningTime="2026-07-29 15:12:18.852818955 +0000 UTC m=+66.839160516" Jul 29 15:12:18.932098 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:18.932070 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:19.233405 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:19.233321 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:12:19.233594 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:19.233555 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:12:19.233694 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:19.233674 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls podName:bbde44aa-abf9-4bc5-a825-ad18c6e11fe2 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:51.233611679 +0000 UTC m=+99.219953241 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls") pod "dns-default-fxk4d" (UID: "bbde44aa-abf9-4bc5-a825-ad18c6e11fe2") : secret "dns-default-metrics-tls" not found Jul 29 15:12:19.820241 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:19.820199 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nrddt" event={"ID":"8fc5b1de-0e23-44f7-ac91-189edba9bc37","Type":"ContainerStarted","Data":"f3ed331e7b24feae935936213175a1e6424b8e0f71f9a4ca02e469e52de11475"} Jul 29 15:12:19.825215 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:19.825181 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:19.961347 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:19.961313 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:20.098814 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:20.098726 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:20.197155 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:20.197115 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:20.343639 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:20.343600 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:20.444611 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:20.444574 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:20.823200 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:20.823119 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:12:21.107922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.107815 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nrddt" podStartSLOduration=68.107794962 podStartE2EDuration="1m8.107794962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:11:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:19.842001734 +0000 UTC m=+67.828343325" watchObservedRunningTime="2026-07-29 15:12:21.107794962 +0000 UTC m=+69.094136548" Jul 29 15:12:21.109022 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.108997 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gqsrn"] Jul 29 15:12:21.127169 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.127134 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gqsrn"] Jul 29 15:12:21.127371 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.127250 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.130193 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.130030 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 15:12:21.130193 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.130053 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 15:12:21.130193 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.130072 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 15:12:21.130453 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.130437 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ztgq7\"" Jul 29 15:12:21.131050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.130896 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 15:12:21.139161 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.139137 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:21.147758 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.147734 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-997ff\" (UniqueName: \"kubernetes.io/projected/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-api-access-997ff\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.147894 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.147793 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9bc7f842-e85d-40f3-a01b-12383bad63c9-crio-socket\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.147894 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.147819 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bc7f842-e85d-40f3-a01b-12383bad63c9-data-volume\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.148014 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.147932 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.148014 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.147990 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.222702 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.222657 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:21.248850 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.248818 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9bc7f842-e85d-40f3-a01b-12383bad63c9-crio-socket\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.249042 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.248856 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bc7f842-e85d-40f3-a01b-12383bad63c9-data-volume\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.249042 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.248906 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.249042 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.248951 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.249042 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.248965 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9bc7f842-e85d-40f3-a01b-12383bad63c9-crio-socket\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.249042 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.249007 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-997ff\" (UniqueName: \"kubernetes.io/projected/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-api-access-997ff\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.249282 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.249058 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:12:21.249282 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.249116 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm podName:9bc7f842-e85d-40f3-a01b-12383bad63c9 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:21.749097442 +0000 UTC m=+69.735439023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gqsrn" (UID: "9bc7f842-e85d-40f3-a01b-12383bad63c9") : configmap "kube-rbac-proxy" not found Jul 29 15:12:21.249379 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.249292 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bc7f842-e85d-40f3-a01b-12383bad63c9-data-volume\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.249379 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.249311 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:12:21.249379 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.249354 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls podName:9bc7f842-e85d-40f3-a01b-12383bad63c9 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:21.749337223 +0000 UTC m=+69.735678785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gqsrn" (UID: "9bc7f842-e85d-40f3-a01b-12383bad63c9") : secret "insights-runtime-extractor-tls" not found Jul 29 15:12:21.259386 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.259359 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-997ff\" (UniqueName: \"kubernetes.io/projected/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-api-access-997ff\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.753781 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.753746 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.753995 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.753810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:21.753995 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.753879 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:12:21.753995 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.753956 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm podName:9bc7f842-e85d-40f3-a01b-12383bad63c9 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:22.753932487 +0000 UTC m=+70.740274070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gqsrn" (UID: "9bc7f842-e85d-40f3-a01b-12383bad63c9") : configmap "kube-rbac-proxy" not found Jul 29 15:12:21.754174 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.753991 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:12:21.754174 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.754075 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls podName:9bc7f842-e85d-40f3-a01b-12383bad63c9 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:22.754052668 +0000 UTC m=+70.740394234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gqsrn" (UID: "9bc7f842-e85d-40f3-a01b-12383bad63c9") : secret "insights-runtime-extractor-tls" not found Jul 29 15:12:21.938230 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.938190 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-srfx9"] Jul 29 15:12:21.955675 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.955618 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:21.955855 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.955725 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-vzbms\" (UID: \"5787924b-c501-4a1f-a652-468d500715e2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:21.955855 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.955776 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:21.955855 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.955801 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle podName:040aaca8-16f6-4126-a822-5043ca11b9a4 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:29.955778763 +0000 UTC m=+77.942120326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle") pod "router-default-584dfc7869-xd84w" (UID: "040aaca8-16f6-4126-a822-5043ca11b9a4") : configmap references non-existent config key: service-ca.crt Jul 29 15:12:21.956031 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.955869 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 15:12:21.956031 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.955872 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 15:12:21.956031 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.955921 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs podName:040aaca8-16f6-4126-a822-5043ca11b9a4 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:29.955905874 +0000 UTC m=+77.942247448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs") pod "router-default-584dfc7869-xd84w" (UID: "040aaca8-16f6-4126-a822-5043ca11b9a4") : secret "router-metrics-certs-default" not found Jul 29 15:12:21.956031 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:21.955941 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls podName:5787924b-c501-4a1f-a652-468d500715e2 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:29.955930996 +0000 UTC m=+77.942272566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls") pod "cluster-samples-operator-6748489656-vzbms" (UID: "5787924b-c501-4a1f-a652-468d500715e2") : secret "samples-operator-tls" not found Jul 29 15:12:21.969486 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.969449 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-srfx9"] Jul 29 15:12:21.969679 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.969593 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" Jul 29 15:12:21.973386 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.973352 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 29 15:12:21.973551 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.973538 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 29 15:12:21.974384 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.974364 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 29 15:12:21.974492 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.974401 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-w8nrx\"" Jul 29 15:12:21.974650 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.974632 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 29 15:12:21.993163 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:21.993129 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:22.056503 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.056411 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f47tl\" (UniqueName: \"kubernetes.io/projected/e77eef75-9180-419f-bed1-43c2905e3309-kube-api-access-f47tl\") pod \"service-ca-658d7b7c78-srfx9\" (UID: \"e77eef75-9180-419f-bed1-43c2905e3309\") " pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" Jul 29 15:12:22.056701 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.056609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e77eef75-9180-419f-bed1-43c2905e3309-signing-key\") pod \"service-ca-658d7b7c78-srfx9\" (UID: \"e77eef75-9180-419f-bed1-43c2905e3309\") " pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" Jul 29 15:12:22.056701 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.056670 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e77eef75-9180-419f-bed1-43c2905e3309-signing-cabundle\") pod \"service-ca-658d7b7c78-srfx9\" (UID: \"e77eef75-9180-419f-bed1-43c2905e3309\") " pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" Jul 29 15:12:22.157672 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.157629 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f47tl\" (UniqueName: \"kubernetes.io/projected/e77eef75-9180-419f-bed1-43c2905e3309-kube-api-access-f47tl\") pod \"service-ca-658d7b7c78-srfx9\" (UID: \"e77eef75-9180-419f-bed1-43c2905e3309\") " pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" Jul 29 15:12:22.158157 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.157731 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e77eef75-9180-419f-bed1-43c2905e3309-signing-key\") pod \"service-ca-658d7b7c78-srfx9\" (UID: \"e77eef75-9180-419f-bed1-43c2905e3309\") " pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" Jul 29 15:12:22.158157 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.157782 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e77eef75-9180-419f-bed1-43c2905e3309-signing-cabundle\") pod \"service-ca-658d7b7c78-srfx9\" (UID: \"e77eef75-9180-419f-bed1-43c2905e3309\") " pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" Jul 29 15:12:22.158540 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.158504 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e77eef75-9180-419f-bed1-43c2905e3309-signing-cabundle\") pod \"service-ca-658d7b7c78-srfx9\" (UID: \"e77eef75-9180-419f-bed1-43c2905e3309\") " pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" Jul 29 15:12:22.160584 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.160559 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e77eef75-9180-419f-bed1-43c2905e3309-signing-key\") pod \"service-ca-658d7b7c78-srfx9\" (UID: \"e77eef75-9180-419f-bed1-43c2905e3309\") " pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" Jul 29 15:12:22.169243 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.169216 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f47tl\" (UniqueName: \"kubernetes.io/projected/e77eef75-9180-419f-bed1-43c2905e3309-kube-api-access-f47tl\") pod \"service-ca-658d7b7c78-srfx9\" (UID: \"e77eef75-9180-419f-bed1-43c2905e3309\") " pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" Jul 29 15:12:22.280578 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.280540 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" Jul 29 15:12:22.581818 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.581791 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-srfx9"] Jul 29 15:12:22.584672 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:12:22.584639 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode77eef75_9180_419f_bed1_43c2905e3309.slice/crio-7c564f2841dcf346d30daed73aa918093ea2c8e0f06bf21b9fc5daf74a7d21b9 WatchSource:0}: Error finding container 7c564f2841dcf346d30daed73aa918093ea2c8e0f06bf21b9fc5daf74a7d21b9: Status 404 returned error can't find the container with id 7c564f2841dcf346d30daed73aa918093ea2c8e0f06bf21b9fc5daf74a7d21b9 Jul 29 15:12:22.763667 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.763580 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:22.763667 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.763658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:22.763869 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:22.763700 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:12:22.763869 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:22.763793 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm podName:9bc7f842-e85d-40f3-a01b-12383bad63c9 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:24.763760341 +0000 UTC m=+72.750101920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gqsrn" (UID: "9bc7f842-e85d-40f3-a01b-12383bad63c9") : configmap "kube-rbac-proxy" not found Jul 29 15:12:22.763869 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:22.763815 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:12:22.763869 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:22.763855 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls podName:9bc7f842-e85d-40f3-a01b-12383bad63c9 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:24.763846321 +0000 UTC m=+72.750187886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gqsrn" (UID: "9bc7f842-e85d-40f3-a01b-12383bad63c9") : secret "insights-runtime-extractor-tls" not found Jul 29 15:12:22.832602 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.832570 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" event={"ID":"e77eef75-9180-419f-bed1-43c2905e3309","Type":"ContainerStarted","Data":"5848736d94e5f559393e5e5e6e9555603cfc7e615e5282194c8ab2f07a4eff1b"} Jul 29 15:12:22.832718 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.832662 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" event={"ID":"e77eef75-9180-419f-bed1-43c2905e3309","Type":"ContainerStarted","Data":"7c564f2841dcf346d30daed73aa918093ea2c8e0f06bf21b9fc5daf74a7d21b9"} Jul 29 15:12:22.865022 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:22.864220 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-srfx9" podStartSLOduration=1.864202039 podStartE2EDuration="1.864202039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:12:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:22.863892156 +0000 UTC m=+70.850233763" watchObservedRunningTime="2026-07-29 15:12:22.864202039 +0000 UTC m=+70.850543624" Jul 29 15:12:23.684728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:23.684689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-278pz_12648377-79cc-4ee8-afe6-8ad892fc5512/dns-node-resolver/0.log" Jul 29 15:12:23.837788 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:23.837750 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-78zcw" event={"ID":"429076a7-cb20-464f-9ab9-c29ab3c80773","Type":"ContainerStarted","Data":"0fb0efb96f3f7f0c734f81245cf68d9398f1aa5fdbf80566d8990b104c4ea3c8"} Jul 29 15:12:23.859550 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:23.859485 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-78zcw" podStartSLOduration=66.496492428 podStartE2EDuration="1m10.859467972s" totalImagesPullingTime="4.362975544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:23.858629462 +0000 UTC m=+71.844971046" watchObservedRunningTime="2026-07-29 15:12:23.859467972 +0000 UTC m=+71.845809556" Jul 29 15:12:24.314609 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:24.314574 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:24.780105 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:24.780063 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:24.780557 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:24.780172 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:24.780557 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:24.780245 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:12:24.780557 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:24.780330 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls podName:9bc7f842-e85d-40f3-a01b-12383bad63c9 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:28.780308587 +0000 UTC m=+76.766650151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gqsrn" (UID: "9bc7f842-e85d-40f3-a01b-12383bad63c9") : secret "insights-runtime-extractor-tls" not found Jul 29 15:12:24.780557 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:24.780248 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:12:24.780557 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:24.780386 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm podName:9bc7f842-e85d-40f3-a01b-12383bad63c9 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:28.780371298 +0000 UTC m=+76.766712866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gqsrn" (UID: "9bc7f842-e85d-40f3-a01b-12383bad63c9") : configmap "kube-rbac-proxy" not found Jul 29 15:12:24.879313 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:24.879283 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dfzkw_8bba0468-80b0-4f39-b48d-750abab54434/node-ca/0.log" Jul 29 15:12:25.331342 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:25.331304 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:25.484144 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:25.484108 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:25.600153 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:25.600047 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:25.679472 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:25.679442 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rnq2g_8006ac72-bec6-4b8c-91c4-0c815fce3ef5/serve-healthcheck-canary/0.log" Jul 29 15:12:25.699990 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:25.699936 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:25.801182 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:25.801146 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:26.433217 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:26.433179 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:27.030192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:27.030154 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:27.155894 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:27.155862 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:27.239711 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:27.239657 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:27.628408 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:27.628340 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:27.821078 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:27.821023 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:28.222146 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:28.222111 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:28.568142 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:28.568039 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:28.814607 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:28.814576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:28.814811 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:28.814630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:28.814811 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:28.814698 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:12:28.814811 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:28.814773 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:12:28.814811 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:28.814791 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm podName:9bc7f842-e85d-40f3-a01b-12383bad63c9 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:36.81477252 +0000 UTC m=+84.801114084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gqsrn" (UID: "9bc7f842-e85d-40f3-a01b-12383bad63c9") : configmap "kube-rbac-proxy" not found Jul 29 15:12:28.815092 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:28.814836 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls podName:9bc7f842-e85d-40f3-a01b-12383bad63c9 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:36.814820183 +0000 UTC m=+84.801161745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gqsrn" (UID: "9bc7f842-e85d-40f3-a01b-12383bad63c9") : secret "insights-runtime-extractor-tls" not found Jul 29 15:12:28.815177 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:28.815146 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:29.057935 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:29.057904 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:29.231363 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:29.231328 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:29.331800 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:29.331714 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:29.619553 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:29.619423 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:30.024171 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:30.024118 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-vzbms\" (UID: \"5787924b-c501-4a1f-a652-468d500715e2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:30.024408 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:30.024184 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:30.024408 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:30.024255 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:30.024408 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:30.024273 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:30.024408 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:12:30.024390 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle podName:040aaca8-16f6-4126-a822-5043ca11b9a4 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:46.024372154 +0000 UTC m=+94.010713725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle") pod "router-default-584dfc7869-xd84w" (UID: "040aaca8-16f6-4126-a822-5043ca11b9a4") : configmap references non-existent config key: service-ca.crt Jul 29 15:12:30.026635 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:30.026604 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/040aaca8-16f6-4126-a822-5043ca11b9a4-metrics-certs\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:30.026766 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:30.026675 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5787924b-c501-4a1f-a652-468d500715e2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-vzbms\" (UID: \"5787924b-c501-4a1f-a652-468d500715e2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:30.047827 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:30.047791 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" Jul 29 15:12:30.179946 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:30.179913 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms"] Jul 29 15:12:30.843579 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:30.843540 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:30.861457 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:30.861423 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" event={"ID":"5787924b-c501-4a1f-a652-468d500715e2","Type":"ContainerStarted","Data":"c2d0f48b06fa3ad618498338de74439396b77a5f6af3e35856705305e4c8ed70"} Jul 29 15:12:30.944356 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:30.944298 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:32.568154 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:32.568103 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:32.667000 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:32.666953 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:32.874033 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:32.873925 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" event={"ID":"5787924b-c501-4a1f-a652-468d500715e2","Type":"ContainerStarted","Data":"4fddd634559ce08b62bfbf528b26107e145ff5cb32fb7d6b5bee2a044bf049ff"} Jul 29 15:12:32.874033 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:32.873979 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" event={"ID":"5787924b-c501-4a1f-a652-468d500715e2","Type":"ContainerStarted","Data":"91fd6469bf3998110ec8683a60040009405ce75fe4c1aae179ecec5377aa618b"} Jul 29 15:12:32.893638 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:32.893583 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-vzbms" podStartSLOduration=17.09982439 podStartE2EDuration="18.893567955s" totalImagesPullingTime="1.793743565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:32.89282648 +0000 UTC m=+80.879168064" watchObservedRunningTime="2026-07-29 15:12:32.893567955 +0000 UTC m=+80.879909536" Jul 29 15:12:33.220199 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:33.220161 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:33.815326 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:33.815271 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:34.033969 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:34.033938 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:34.427758 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:34.427724 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:34.622882 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:34.622849 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:34.899820 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:34.899773 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:35.020582 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:35.020535 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:35.417146 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:35.417114 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:35.588129 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:35.588097 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:35.662445 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:35.662417 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:35.817699 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:35.817662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:36.016538 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:36.016490 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:36.877299 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:36.877244 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:36.877299 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:36.877302 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:36.877907 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:36.877888 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc7f842-e85d-40f3-a01b-12383bad63c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:36.879690 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:36.879667 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc7f842-e85d-40f3-a01b-12383bad63c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gqsrn\" (UID: \"9bc7f842-e85d-40f3-a01b-12383bad63c9\") " pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:37.037538 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:37.037487 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gqsrn" Jul 29 15:12:37.167422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:37.167352 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gqsrn"] Jul 29 15:12:37.170654 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:12:37.170629 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc7f842_e85d_40f3_a01b_12383bad63c9.slice/crio-771380be6f5ff6c2b927d7ae94692f15092ce5829d43ed950e9f436c234375f3 WatchSource:0}: Error finding container 771380be6f5ff6c2b927d7ae94692f15092ce5829d43ed950e9f436c234375f3: Status 404 returned error can't find the container with id 771380be6f5ff6c2b927d7ae94692f15092ce5829d43ed950e9f436c234375f3 Jul 29 15:12:37.891555 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:37.891502 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gqsrn" event={"ID":"9bc7f842-e85d-40f3-a01b-12383bad63c9","Type":"ContainerStarted","Data":"771380be6f5ff6c2b927d7ae94692f15092ce5829d43ed950e9f436c234375f3"} Jul 29 15:12:42.908959 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:42.908926 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gqsrn" event={"ID":"9bc7f842-e85d-40f3-a01b-12383bad63c9","Type":"ContainerStarted","Data":"0bf8a5b305110959d3952ac57557670479c08e241e1a6077d0097bf617f7b9fd"} Jul 29 15:12:44.355570 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.355509 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9"] Jul 29 15:12:44.358334 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.358302 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:44.361507 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.361479 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 15:12:44.361507 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.361479 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 15:12:44.362713 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.362509 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 15:12:44.362872 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.362852 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 29 15:12:44.372752 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.372684 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9"] Jul 29 15:12:44.433109 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.433073 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kwsf\" (UniqueName: \"kubernetes.io/projected/05cfc1a9-3f85-455c-881f-bddfedd768c1-kube-api-access-8kwsf\") pod \"klusterlet-addon-workmgr-56b768c9b8-xjxq9\" (UID: \"05cfc1a9-3f85-455c-881f-bddfedd768c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:44.433270 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.433177 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05cfc1a9-3f85-455c-881f-bddfedd768c1-tmp\") pod \"klusterlet-addon-workmgr-56b768c9b8-xjxq9\" (UID: \"05cfc1a9-3f85-455c-881f-bddfedd768c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:44.433270 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.433260 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/05cfc1a9-3f85-455c-881f-bddfedd768c1-klusterlet-config\") pod \"klusterlet-addon-workmgr-56b768c9b8-xjxq9\" (UID: \"05cfc1a9-3f85-455c-881f-bddfedd768c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:44.480598 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.480558 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c9bdb57bc-5mcss"] Jul 29 15:12:44.482985 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.482957 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.485607 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.485562 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 15:12:44.485798 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.485633 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 15:12:44.486113 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.485913 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 15:12:44.486807 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.486760 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-snrjc\"" Jul 29 15:12:44.492929 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.492716 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 15:12:44.495208 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.495179 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:44.500073 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.500012 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9bdb57bc-5mcss"] Jul 29 15:12:44.535422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.533630 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7792ab71-6414-49b3-9b12-5556ce4b8a36-image-registry-private-configuration\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.535422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.533680 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05cfc1a9-3f85-455c-881f-bddfedd768c1-tmp\") pod \"klusterlet-addon-workmgr-56b768c9b8-xjxq9\" (UID: \"05cfc1a9-3f85-455c-881f-bddfedd768c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:44.535422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.533709 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7792ab71-6414-49b3-9b12-5556ce4b8a36-registry-tls\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.535422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.533731 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v8wg\" (UniqueName: \"kubernetes.io/projected/7792ab71-6414-49b3-9b12-5556ce4b8a36-kube-api-access-9v8wg\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.535422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.533758 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/05cfc1a9-3f85-455c-881f-bddfedd768c1-klusterlet-config\") pod \"klusterlet-addon-workmgr-56b768c9b8-xjxq9\" (UID: \"05cfc1a9-3f85-455c-881f-bddfedd768c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:44.535422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.533778 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7792ab71-6414-49b3-9b12-5556ce4b8a36-trusted-ca\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.535422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.533800 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7792ab71-6414-49b3-9b12-5556ce4b8a36-ca-trust-extracted\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.535422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.533861 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7792ab71-6414-49b3-9b12-5556ce4b8a36-installation-pull-secrets\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.535422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.533931 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kwsf\" (UniqueName: \"kubernetes.io/projected/05cfc1a9-3f85-455c-881f-bddfedd768c1-kube-api-access-8kwsf\") pod \"klusterlet-addon-workmgr-56b768c9b8-xjxq9\" (UID: \"05cfc1a9-3f85-455c-881f-bddfedd768c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:44.535422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.533956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7792ab71-6414-49b3-9b12-5556ce4b8a36-registry-certificates\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.535422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.533985 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7792ab71-6414-49b3-9b12-5556ce4b8a36-bound-sa-token\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.535422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.534375 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05cfc1a9-3f85-455c-881f-bddfedd768c1-tmp\") pod \"klusterlet-addon-workmgr-56b768c9b8-xjxq9\" (UID: \"05cfc1a9-3f85-455c-881f-bddfedd768c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:44.539151 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.539053 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/05cfc1a9-3f85-455c-881f-bddfedd768c1-klusterlet-config\") pod \"klusterlet-addon-workmgr-56b768c9b8-xjxq9\" (UID: \"05cfc1a9-3f85-455c-881f-bddfedd768c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:44.545990 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.545775 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kwsf\" (UniqueName: \"kubernetes.io/projected/05cfc1a9-3f85-455c-881f-bddfedd768c1-kube-api-access-8kwsf\") pod \"klusterlet-addon-workmgr-56b768c9b8-xjxq9\" (UID: \"05cfc1a9-3f85-455c-881f-bddfedd768c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:44.588172 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.588091 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:44.635484 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.635375 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7792ab71-6414-49b3-9b12-5556ce4b8a36-registry-tls\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.635484 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.635419 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v8wg\" (UniqueName: \"kubernetes.io/projected/7792ab71-6414-49b3-9b12-5556ce4b8a36-kube-api-access-9v8wg\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.635484 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.635450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7792ab71-6414-49b3-9b12-5556ce4b8a36-trusted-ca\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.635484 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.635477 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7792ab71-6414-49b3-9b12-5556ce4b8a36-ca-trust-extracted\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.635837 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.635557 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7792ab71-6414-49b3-9b12-5556ce4b8a36-installation-pull-secrets\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.635837 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.635629 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7792ab71-6414-49b3-9b12-5556ce4b8a36-registry-certificates\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.635837 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.635657 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7792ab71-6414-49b3-9b12-5556ce4b8a36-bound-sa-token\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.635837 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.635699 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7792ab71-6414-49b3-9b12-5556ce4b8a36-image-registry-private-configuration\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.636242 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.636212 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7792ab71-6414-49b3-9b12-5556ce4b8a36-ca-trust-extracted\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.637162 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.637106 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7792ab71-6414-49b3-9b12-5556ce4b8a36-trusted-ca\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.637784 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.637734 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7792ab71-6414-49b3-9b12-5556ce4b8a36-registry-certificates\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.639212 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.639177 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7792ab71-6414-49b3-9b12-5556ce4b8a36-image-registry-private-configuration\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.639610 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.639589 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7792ab71-6414-49b3-9b12-5556ce4b8a36-registry-tls\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.640061 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.640019 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7792ab71-6414-49b3-9b12-5556ce4b8a36-installation-pull-secrets\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.652474 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.652437 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7792ab71-6414-49b3-9b12-5556ce4b8a36-bound-sa-token\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.653028 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.653009 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v8wg\" (UniqueName: \"kubernetes.io/projected/7792ab71-6414-49b3-9b12-5556ce4b8a36-kube-api-access-9v8wg\") pod \"image-registry-c9bdb57bc-5mcss\" (UID: \"7792ab71-6414-49b3-9b12-5556ce4b8a36\") " pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.672189 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.672152 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:44.797206 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.797072 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:44.836068 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.836026 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9"] Jul 29 15:12:44.839470 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:12:44.839443 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05cfc1a9_3f85_455c_881f_bddfedd768c1.slice/crio-2bbf0ee8c02377413fbea09214fec1fd1cd06900816a19eea8ee171f478add65 WatchSource:0}: Error finding container 2bbf0ee8c02377413fbea09214fec1fd1cd06900816a19eea8ee171f478add65: Status 404 returned error can't find the container with id 2bbf0ee8c02377413fbea09214fec1fd1cd06900816a19eea8ee171f478add65 Jul 29 15:12:44.917151 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.917115 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" event={"ID":"05cfc1a9-3f85-455c-881f-bddfedd768c1","Type":"ContainerStarted","Data":"2bbf0ee8c02377413fbea09214fec1fd1cd06900816a19eea8ee171f478add65"} Jul 29 15:12:44.960584 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:44.960555 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9bdb57bc-5mcss"] Jul 29 15:12:44.962994 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:12:44.962965 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7792ab71_6414_49b3_9b12_5556ce4b8a36.slice/crio-34c4dd31489c4120df4da3e3f8df774b74efb702ceec5b34620b68eb1dcafa0c WatchSource:0}: Error finding container 34c4dd31489c4120df4da3e3f8df774b74efb702ceec5b34620b68eb1dcafa0c: Status 404 returned error can't find the container with id 34c4dd31489c4120df4da3e3f8df774b74efb702ceec5b34620b68eb1dcafa0c Jul 29 15:12:45.923585 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:45.923550 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" event={"ID":"7792ab71-6414-49b3-9b12-5556ce4b8a36","Type":"ContainerStarted","Data":"b7c5ebdbaa92772d5bb3318d2b561edb9463a3671a8263dc21525d790ad7f5ef"} Jul 29 15:12:45.924002 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:45.923608 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" event={"ID":"7792ab71-6414-49b3-9b12-5556ce4b8a36","Type":"ContainerStarted","Data":"34c4dd31489c4120df4da3e3f8df774b74efb702ceec5b34620b68eb1dcafa0c"} Jul 29 15:12:45.924002 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:45.923656 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:12:46.045863 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:46.045826 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:46.046832 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:46.046757 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/040aaca8-16f6-4126-a822-5043ca11b9a4-service-ca-bundle\") pod \"router-default-584dfc7869-xd84w\" (UID: \"040aaca8-16f6-4126-a822-5043ca11b9a4\") " pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:46.290339 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:46.290286 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:47.503802 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:47.503736 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" podStartSLOduration=3.503714469 podStartE2EDuration="3.503714469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:12:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:45.947107419 +0000 UTC m=+93.933449004" watchObservedRunningTime="2026-07-29 15:12:47.503714469 +0000 UTC m=+95.490056053" Jul 29 15:12:47.504683 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:47.504658 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-584dfc7869-xd84w"] Jul 29 15:12:47.508946 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:12:47.508916 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040aaca8_16f6_4126_a822_5043ca11b9a4.slice/crio-ed32faf752b3305f2930d4549a23918feee576d8cba5662db4a8a9efddd8bf22 WatchSource:0}: Error finding container ed32faf752b3305f2930d4549a23918feee576d8cba5662db4a8a9efddd8bf22: Status 404 returned error can't find the container with id ed32faf752b3305f2930d4549a23918feee576d8cba5662db4a8a9efddd8bf22 Jul 29 15:12:47.934241 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:47.934204 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-584dfc7869-xd84w" event={"ID":"040aaca8-16f6-4126-a822-5043ca11b9a4","Type":"ContainerStarted","Data":"a43f7969c41952c73d78651d7332f63ac34c35b39c669bbe52ce2f21843fc57c"} Jul 29 15:12:47.934438 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:47.934268 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-584dfc7869-xd84w" event={"ID":"040aaca8-16f6-4126-a822-5043ca11b9a4","Type":"ContainerStarted","Data":"ed32faf752b3305f2930d4549a23918feee576d8cba5662db4a8a9efddd8bf22"} Jul 29 15:12:47.937007 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:47.936971 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gqsrn" event={"ID":"9bc7f842-e85d-40f3-a01b-12383bad63c9","Type":"ContainerStarted","Data":"6f41314013586485af159cbb46adbfda9a261b744f240718e05be53247b1b018"} Jul 29 15:12:47.960254 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:47.959977 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-584dfc7869-xd84w" podStartSLOduration=33.959954373 podStartE2EDuration="33.959954373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:12:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:47.958458306 +0000 UTC m=+95.944799924" watchObservedRunningTime="2026-07-29 15:12:47.959954373 +0000 UTC m=+95.946295959" Jul 29 15:12:48.291229 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:48.291094 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:48.294704 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:48.294420 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:48.942337 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:48.942308 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:48.943707 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:48.943675 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-584dfc7869-xd84w" Jul 29 15:12:51.296797 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:51.296762 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:12:51.299368 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:51.299335 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbde44aa-abf9-4bc5-a825-ad18c6e11fe2-metrics-tls\") pod \"dns-default-fxk4d\" (UID: \"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2\") " pod="openshift-dns/dns-default-fxk4d" Jul 29 15:12:51.572348 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:51.572271 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dw7hg\"" Jul 29 15:12:51.580551 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:51.580490 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fxk4d" Jul 29 15:12:51.828725 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:51.828643 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nrddt" Jul 29 15:12:52.596685 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:52.596652 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fxk4d"] Jul 29 15:12:52.600176 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:12:52.600144 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbde44aa_abf9_4bc5_a825_ad18c6e11fe2.slice/crio-b3deeb5262220bd50f32c96fa93a04c6a51f50458e4ab39a57a5f0adabe76cb4 WatchSource:0}: Error finding container b3deeb5262220bd50f32c96fa93a04c6a51f50458e4ab39a57a5f0adabe76cb4: Status 404 returned error can't find the container with id b3deeb5262220bd50f32c96fa93a04c6a51f50458e4ab39a57a5f0adabe76cb4 Jul 29 15:12:52.754338 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:52.754254 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:52.862348 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:52.862311 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:52.949093 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:52.949060 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:52.957088 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:52.957050 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" event={"ID":"05cfc1a9-3f85-455c-881f-bddfedd768c1","Type":"ContainerStarted","Data":"4cc32b4f26d3c1efdc2667c461a8666aaea0cf3c5d021a9266734f767ab07b03"} Jul 29 15:12:52.957367 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:52.957346 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:52.959149 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:52.959127 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" Jul 29 15:12:52.959558 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:52.959513 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gqsrn" event={"ID":"9bc7f842-e85d-40f3-a01b-12383bad63c9","Type":"ContainerStarted","Data":"e25048848f3d7a1b343358d864fffa57d36862ad58aad9e716f0f6caffc4dd4a"} Jul 29 15:12:52.960594 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:52.960573 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fxk4d" event={"ID":"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2","Type":"ContainerStarted","Data":"b3deeb5262220bd50f32c96fa93a04c6a51f50458e4ab39a57a5f0adabe76cb4"} Jul 29 15:12:52.977361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:52.977287 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56b768c9b8-xjxq9" podStartSLOduration=1.366055571 podStartE2EDuration="8.977267623s" totalImagesPullingTime="7.611212052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:52.976585633 +0000 UTC m=+100.962927214" watchObservedRunningTime="2026-07-29 15:12:52.977267623 +0000 UTC m=+100.963609190" Jul 29 15:12:52.999008 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:52.998846 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gqsrn" podStartSLOduration=16.839352214 podStartE2EDuration="31.998824563s" totalImagesPullingTime="15.159472349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:12:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:52.998355758 +0000 UTC m=+100.984697342" watchObservedRunningTime="2026-07-29 15:12:52.998824563 +0000 UTC m=+100.985166150" Jul 29 15:12:53.142159 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:53.142082 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:55.975065 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:55.975024 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:56.022109 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.022066 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-7qtdm"] Jul 29 15:12:56.024399 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.024378 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.028053 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.028027 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 29 15:12:56.028053 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.028047 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 15:12:56.028237 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.028047 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 29 15:12:56.028515 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.028490 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7wmn4\"" Jul 29 15:12:56.028621 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.028490 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 15:12:56.028621 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.028560 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 15:12:56.036809 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.036775 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-7qtdm"] Jul 29 15:12:56.071913 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.071875 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:56.140037 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.139991 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f46e7a2-d732-4b81-9aad-66385c4c6709-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7qtdm\" (UID: \"3f46e7a2-d732-4b81-9aad-66385c4c6709\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.140223 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.140080 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdk6c\" (UniqueName: \"kubernetes.io/projected/3f46e7a2-d732-4b81-9aad-66385c4c6709-kube-api-access-xdk6c\") pod \"prometheus-operator-84d69f794d-7qtdm\" (UID: \"3f46e7a2-d732-4b81-9aad-66385c4c6709\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.140223 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.140174 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f46e7a2-d732-4b81-9aad-66385c4c6709-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-7qtdm\" (UID: \"3f46e7a2-d732-4b81-9aad-66385c4c6709\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.140223 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.140203 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f46e7a2-d732-4b81-9aad-66385c4c6709-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-7qtdm\" (UID: \"3f46e7a2-d732-4b81-9aad-66385c4c6709\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.241090 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.241009 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f46e7a2-d732-4b81-9aad-66385c4c6709-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7qtdm\" (UID: \"3f46e7a2-d732-4b81-9aad-66385c4c6709\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.241090 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.241050 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdk6c\" (UniqueName: \"kubernetes.io/projected/3f46e7a2-d732-4b81-9aad-66385c4c6709-kube-api-access-xdk6c\") pod \"prometheus-operator-84d69f794d-7qtdm\" (UID: \"3f46e7a2-d732-4b81-9aad-66385c4c6709\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.241331 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.241097 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f46e7a2-d732-4b81-9aad-66385c4c6709-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-7qtdm\" (UID: \"3f46e7a2-d732-4b81-9aad-66385c4c6709\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.241331 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.241125 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f46e7a2-d732-4b81-9aad-66385c4c6709-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-7qtdm\" (UID: \"3f46e7a2-d732-4b81-9aad-66385c4c6709\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.241872 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.241847 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f46e7a2-d732-4b81-9aad-66385c4c6709-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-7qtdm\" (UID: \"3f46e7a2-d732-4b81-9aad-66385c4c6709\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.243423 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.243394 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f46e7a2-d732-4b81-9aad-66385c4c6709-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-7qtdm\" (UID: \"3f46e7a2-d732-4b81-9aad-66385c4c6709\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.243618 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.243597 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f46e7a2-d732-4b81-9aad-66385c4c6709-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7qtdm\" (UID: \"3f46e7a2-d732-4b81-9aad-66385c4c6709\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.251032 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.251000 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdk6c\" (UniqueName: \"kubernetes.io/projected/3f46e7a2-d732-4b81-9aad-66385c4c6709-kube-api-access-xdk6c\") pod \"prometheus-operator-84d69f794d-7qtdm\" (UID: \"3f46e7a2-d732-4b81-9aad-66385c4c6709\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.295064 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.294990 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:56.336020 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.335985 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" Jul 29 15:12:56.495482 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.495423 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-7qtdm"] Jul 29 15:12:56.499051 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:12:56.499021 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f46e7a2_d732_4b81_9aad_66385c4c6709.slice/crio-45ac973b420cae1cb594b769e7eb0bfc4b7c06a481328fad36178392626c6685 WatchSource:0}: Error finding container 45ac973b420cae1cb594b769e7eb0bfc4b7c06a481328fad36178392626c6685: Status 404 returned error can't find the container with id 45ac973b420cae1cb594b769e7eb0bfc4b7c06a481328fad36178392626c6685 Jul 29 15:12:56.976136 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.976097 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fxk4d" event={"ID":"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2","Type":"ContainerStarted","Data":"a4fdfddf76c441f697e35e49c71f766c2e53de18a90f3c3a7b2fa1a208a65fad"} Jul 29 15:12:56.976608 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.976163 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fxk4d" event={"ID":"bbde44aa-abf9-4bc5-a825-ad18c6e11fe2","Type":"ContainerStarted","Data":"0b9cff0da02cfabab1079e7033cefcd18f1e6bee1f4a9fe1c02b1661ceae7afd"} Jul 29 15:12:56.976608 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.976224 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fxk4d" Jul 29 15:12:56.977195 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.977175 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" event={"ID":"3f46e7a2-d732-4b81-9aad-66385c4c6709","Type":"ContainerStarted","Data":"45ac973b420cae1cb594b769e7eb0bfc4b7c06a481328fad36178392626c6685"} Jul 29 15:12:56.997064 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:56.997013 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fxk4d" podStartSLOduration=66.323196515 podStartE2EDuration="1m9.996997274s" totalImagesPullingTime="3.673800759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:56.996815954 +0000 UTC m=+104.983157550" watchObservedRunningTime="2026-07-29 15:12:56.996997274 +0000 UTC m=+104.983338857" Jul 29 15:12:57.983013 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:57.982919 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" event={"ID":"3f46e7a2-d732-4b81-9aad-66385c4c6709","Type":"ContainerStarted","Data":"546422127b716cd9d517af84e20c766081c6c830b8e6e9e2db460b6384176d9c"} Jul 29 15:12:57.983013 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:57.982984 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" event={"ID":"3f46e7a2-d732-4b81-9aad-66385c4c6709","Type":"ContainerStarted","Data":"91c85eaa7e1108a13f544ff617b371a0c3518f5bc0e4380ccc6127ca95fa81b3"} Jul 29 15:12:58.005607 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:58.005558 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-7qtdm" podStartSLOduration=0.794566787 podStartE2EDuration="2.005541112s" totalImagesPullingTime="1.210974325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:58.004265683 +0000 UTC m=+105.990607266" watchObservedRunningTime="2026-07-29 15:12:58.005541112 +0000 UTC m=+105.991882709" Jul 29 15:12:58.011735 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:12:58.011705 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:00.121222 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:00.121189 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:00.261451 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:00.261418 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:01.418789 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:01.418753 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:01.514263 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:01.514221 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:01.598782 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:01.598739 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:01.726774 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:01.726744 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:01.822141 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:01.822096 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:01.918675 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:01.918640 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:02.109343 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:02.109258 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:02.205232 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:02.205199 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:02.305451 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:02.305419 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:02.501720 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:02.501679 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:02.601292 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:02.601263 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:02.739510 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:02.739476 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:02.835835 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:02.835753 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:03.087336 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:03.087243 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:03.483936 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:03.483895 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:03.583680 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:03.583649 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:03.813766 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:03.813666 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:04.298739 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.298700 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:04.422951 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.422897 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:04.459141 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.459109 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9796p"] Jul 29 15:13:04.462749 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.462718 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.468269 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.468239 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rlsh5\"" Jul 29 15:13:04.468728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.468707 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 15:13:04.469036 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.469020 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 15:13:04.469415 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.469395 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 15:13:04.540206 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.540172 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:04.608896 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.608789 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.608896 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.608840 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cce0b86-3eec-470b-9dac-8363dd60b883-sys\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.608896 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.608874 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c8xq\" (UniqueName: \"kubernetes.io/projected/3cce0b86-3eec-470b-9dac-8363dd60b883-kube-api-access-5c8xq\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.609469 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.608939 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-accelerators-collector-config\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.609469 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.608972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3cce0b86-3eec-470b-9dac-8363dd60b883-root\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.609469 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.608994 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-textfile\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.609469 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.609021 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cce0b86-3eec-470b-9dac-8363dd60b883-metrics-client-ca\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.609469 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.609048 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-wtmp\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.609469 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.609073 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-tls\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.643397 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.643355 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:04.709609 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.709567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cce0b86-3eec-470b-9dac-8363dd60b883-sys\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.709609 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.709605 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c8xq\" (UniqueName: \"kubernetes.io/projected/3cce0b86-3eec-470b-9dac-8363dd60b883-kube-api-access-5c8xq\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.709879 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.709651 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-accelerators-collector-config\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.709879 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.709699 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3cce0b86-3eec-470b-9dac-8363dd60b883-root\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.709879 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.709695 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cce0b86-3eec-470b-9dac-8363dd60b883-sys\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.709879 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.709715 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-textfile\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.709879 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.709734 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cce0b86-3eec-470b-9dac-8363dd60b883-metrics-client-ca\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.709879 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.709751 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-wtmp\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.709879 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.709771 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-tls\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.709879 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.709859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.710283 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.709924 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-wtmp\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.710283 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.710005 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3cce0b86-3eec-470b-9dac-8363dd60b883-root\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.710283 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.710102 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-textfile\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.710434 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.710419 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-accelerators-collector-config\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.710913 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.710889 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cce0b86-3eec-470b-9dac-8363dd60b883-metrics-client-ca\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.712379 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.712358 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.712652 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.712631 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3cce0b86-3eec-470b-9dac-8363dd60b883-node-exporter-tls\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.724609 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.724570 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c8xq\" (UniqueName: \"kubernetes.io/projected/3cce0b86-3eec-470b-9dac-8363dd60b883-kube-api-access-5c8xq\") pod \"node-exporter-9796p\" (UID: \"3cce0b86-3eec-470b-9dac-8363dd60b883\") " pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.740591 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.740515 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:04.773513 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:04.773475 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9796p" Jul 29 15:13:04.788309 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:13:04.788273 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cce0b86_3eec_470b_9dac_8363dd60b883.slice/crio-017f55a2b5fbc83164b24b713461a4e695da64724fde663c66e7a198eb5e3826 WatchSource:0}: Error finding container 017f55a2b5fbc83164b24b713461a4e695da64724fde663c66e7a198eb5e3826: Status 404 returned error can't find the container with id 017f55a2b5fbc83164b24b713461a4e695da64724fde663c66e7a198eb5e3826 Jul 29 15:13:05.007035 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:05.006999 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9796p" event={"ID":"3cce0b86-3eec-470b-9dac-8363dd60b883","Type":"ContainerStarted","Data":"017f55a2b5fbc83164b24b713461a4e695da64724fde663c66e7a198eb5e3826"} Jul 29 15:13:06.012154 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.012065 2554 generic.go:356] "Generic (PLEG): container finished" podID="3cce0b86-3eec-470b-9dac-8363dd60b883" containerID="2faf2027d8aa544f4b99ee61102dfa55fc52dfa848d0c374e331cd4cc25b6a49" exitCode=0 Jul 29 15:13:06.012154 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.012130 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9796p" event={"ID":"3cce0b86-3eec-470b-9dac-8363dd60b883","Type":"ContainerDied","Data":"2faf2027d8aa544f4b99ee61102dfa55fc52dfa848d0c374e331cd4cc25b6a49"} Jul 29 15:13:06.417812 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.417699 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77b8876f45-5jcmk"] Jul 29 15:13:06.421196 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.421178 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.438692 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.438657 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 15:13:06.438875 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.438664 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 15:13:06.438946 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.438885 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 15:13:06.438946 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.438906 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 15:13:06.439027 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.438665 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 15:13:06.439073 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.439059 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77b8876f45-5jcmk"] Jul 29 15:13:06.439167 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.439145 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-55alek055pu3s\"" Jul 29 15:13:06.439286 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.439222 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kbn5f\"" Jul 29 15:13:06.524359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.524325 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-grpc-tls\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.524359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.524367 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.524639 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.524414 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-tls\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.524639 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.524465 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c564602-14d7-4dd4-a11d-c3459a73bd1b-metrics-client-ca\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.524639 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.524486 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftt7k\" (UniqueName: \"kubernetes.io/projected/0c564602-14d7-4dd4-a11d-c3459a73bd1b-kube-api-access-ftt7k\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.524639 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.524595 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.524639 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.524635 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.524798 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.524668 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.585147 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.585114 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:06.625061 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.625028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.625061 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.625074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.625299 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.625098 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-grpc-tls\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.625299 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.625226 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.625410 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.625318 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-tls\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.625410 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.625375 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c564602-14d7-4dd4-a11d-c3459a73bd1b-metrics-client-ca\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.625410 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.625403 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftt7k\" (UniqueName: \"kubernetes.io/projected/0c564602-14d7-4dd4-a11d-c3459a73bd1b-kube-api-access-ftt7k\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.625582 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.625474 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.626222 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.626194 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c564602-14d7-4dd4-a11d-c3459a73bd1b-metrics-client-ca\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.627868 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.627841 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.627987 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.627910 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.628114 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.628094 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.628177 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.628114 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-grpc-tls\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.628287 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.628271 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-tls\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.628343 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.628271 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c564602-14d7-4dd4-a11d-c3459a73bd1b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.635073 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.635047 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftt7k\" (UniqueName: \"kubernetes.io/projected/0c564602-14d7-4dd4-a11d-c3459a73bd1b-kube-api-access-ftt7k\") pod \"thanos-querier-77b8876f45-5jcmk\" (UID: \"0c564602-14d7-4dd4-a11d-c3459a73bd1b\") " pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.686367 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.686316 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:06.730566 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.730511 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:06.873469 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.873437 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77b8876f45-5jcmk"] Jul 29 15:13:06.877683 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:13:06.877649 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c564602_14d7_4dd4_a11d_c3459a73bd1b.slice/crio-c124352222e7c541bf431513bef72d1bd85b68896a30e5eafb2b764d6858677e WatchSource:0}: Error finding container c124352222e7c541bf431513bef72d1bd85b68896a30e5eafb2b764d6858677e: Status 404 returned error can't find the container with id c124352222e7c541bf431513bef72d1bd85b68896a30e5eafb2b764d6858677e Jul 29 15:13:06.931912 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.931882 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c9bdb57bc-5mcss" Jul 29 15:13:06.985230 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:06.985144 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fxk4d" Jul 29 15:13:07.021569 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:07.021515 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9796p" event={"ID":"3cce0b86-3eec-470b-9dac-8363dd60b883","Type":"ContainerStarted","Data":"85b37335c2aaa93096cc6958a82fd73228fec3da4bbd3fd90ead80e880630196"} Jul 29 15:13:07.022067 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:07.021601 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9796p" event={"ID":"3cce0b86-3eec-470b-9dac-8363dd60b883","Type":"ContainerStarted","Data":"54d0395da04ef4d30960177593c74563a91ae162432d4d59a6f4352ba29ea83c"} Jul 29 15:13:07.022938 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:07.022911 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" event={"ID":"0c564602-14d7-4dd4-a11d-c3459a73bd1b","Type":"ContainerStarted","Data":"c124352222e7c541bf431513bef72d1bd85b68896a30e5eafb2b764d6858677e"} Jul 29 15:13:07.042157 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:07.042091 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9796p" podStartSLOduration=2.023078422 podStartE2EDuration="3.042071831s" totalImagesPullingTime="952.473186ms" totalInitContainerRuntime="66.520223ms" isStatefulPod=true podCreationTimestamp="2026-07-29 15:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:13:07.041718907 +0000 UTC m=+115.028060493" watchObservedRunningTime="2026-07-29 15:13:07.042071831 +0000 UTC m=+115.028413409" Jul 29 15:13:07.076004 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:07.075969 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:07.180456 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:07.180426 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:07.394274 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:07.394179 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:07.493888 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:07.493856 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:07.740501 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:07.740466 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:07.846022 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:07.845982 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:07.940798 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:07.940765 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:09.032742 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.032707 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" event={"ID":"0c564602-14d7-4dd4-a11d-c3459a73bd1b","Type":"ContainerStarted","Data":"884b791498fefe89641759f7b320fa3431e772db1debab64f974f7d35a7217da"} Jul 29 15:13:09.033107 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.032776 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" event={"ID":"0c564602-14d7-4dd4-a11d-c3459a73bd1b","Type":"ContainerStarted","Data":"e936ad1aeca6bb4f8d00ee5c82dfcdb067a2123dae312128fff6a186504f8b7f"} Jul 29 15:13:09.033107 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.032801 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" event={"ID":"0c564602-14d7-4dd4-a11d-c3459a73bd1b","Type":"ContainerStarted","Data":"1c30af3a9ff9690750af325b8a3e5b27bf2a74fe12b2bcc648ce3e7f93411871"} Jul 29 15:13:09.216173 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.216133 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:09.365215 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.365123 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:09.647096 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.647067 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5657b68c96-khwmn"] Jul 29 15:13:09.651410 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.651382 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.654049 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.654022 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 15:13:09.654188 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.654076 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 15:13:09.654188 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.654161 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rz2fm\"" Jul 29 15:13:09.654313 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.654245 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 15:13:09.654371 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.654325 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 15:13:09.659904 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.659627 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 15:13:09.662029 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.662008 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 15:13:09.672204 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.672140 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5657b68c96-khwmn"] Jul 29 15:13:09.754472 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.754430 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.754472 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.754476 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-metrics-client-ca\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.754741 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.754502 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-secret-telemeter-client\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.754741 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.754638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.754741 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.754667 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29s2m\" (UniqueName: \"kubernetes.io/projected/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-kube-api-access-29s2m\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.754851 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.754741 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-telemeter-client-tls\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.754851 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.754806 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-federate-client-tls\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.754851 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.754834 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-serving-certs-ca-bundle\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.855296 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.855258 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-telemeter-client-tls\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.855445 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.855315 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-federate-client-tls\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.855445 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.855431 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-serving-certs-ca-bundle\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.855615 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.855474 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.855615 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.855499 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-metrics-client-ca\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.855615 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.855560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-secret-telemeter-client\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.855615 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.855608 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.855803 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.855634 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29s2m\" (UniqueName: \"kubernetes.io/projected/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-kube-api-access-29s2m\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.856440 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.856409 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-serving-certs-ca-bundle\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.856596 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.856575 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-metrics-client-ca\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.856695 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.856598 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.858480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.858425 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-telemeter-client-tls\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.858662 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.858615 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.858769 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.858742 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-secret-telemeter-client\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.860193 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.860170 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-federate-client-tls\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.870356 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.870291 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29s2m\" (UniqueName: \"kubernetes.io/projected/9a5a0a60-6e05-46b0-b720-ea7d7305b63b-kube-api-access-29s2m\") pod \"telemeter-client-5657b68c96-khwmn\" (UID: \"9a5a0a60-6e05-46b0-b720-ea7d7305b63b\") " pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:09.911014 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.910976 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:09.978220 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:09.978183 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" Jul 29 15:13:10.040925 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:10.040879 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" event={"ID":"0c564602-14d7-4dd4-a11d-c3459a73bd1b","Type":"ContainerStarted","Data":"3c3222fc89bc36772100c825fcda1a592126592908cd994edb84dc43667e539c"} Jul 29 15:13:10.041800 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:10.041606 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:10.041800 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:10.041682 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" event={"ID":"0c564602-14d7-4dd4-a11d-c3459a73bd1b","Type":"ContainerStarted","Data":"37507a573ddd20a64f7b757c2973095969a3f8fd72e2921d1f74ff247c8b2296"} Jul 29 15:13:10.041800 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:10.041732 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" event={"ID":"0c564602-14d7-4dd4-a11d-c3459a73bd1b","Type":"ContainerStarted","Data":"1407ab382bade0ac57bb5329d23b78a3e7110f58b83a8e05e12cefd2ca35bde1"} Jul 29 15:13:10.072309 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:10.072246 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" podStartSLOduration=1.641077207 podStartE2EDuration="4.072224667s" totalImagesPullingTime="2.43114746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:13:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:13:10.070235007 +0000 UTC m=+118.056576596" watchObservedRunningTime="2026-07-29 15:13:10.072224667 +0000 UTC m=+118.058566252" Jul 29 15:13:10.123662 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:10.123624 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5657b68c96-khwmn"] Jul 29 15:13:10.126160 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:13:10.126130 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5a0a60_6e05_46b0_b720_ea7d7305b63b.slice/crio-2737a5670c42d802feebc15f95b9fd27b85f05a841559f20362772356c42b86c WatchSource:0}: Error finding container 2737a5670c42d802feebc15f95b9fd27b85f05a841559f20362772356c42b86c: Status 404 returned error can't find the container with id 2737a5670c42d802feebc15f95b9fd27b85f05a841559f20362772356c42b86c Jul 29 15:13:10.698708 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:10.698668 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:11.045716 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.045626 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" event={"ID":"9a5a0a60-6e05-46b0-b720-ea7d7305b63b","Type":"ContainerStarted","Data":"2737a5670c42d802feebc15f95b9fd27b85f05a841559f20362772356c42b86c"} Jul 29 15:13:11.114828 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.114792 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54b45f6c68-f2lp2"] Jul 29 15:13:11.139858 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.139821 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b45f6c68-f2lp2"] Jul 29 15:13:11.140031 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.139884 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.143315 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.142972 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 15:13:11.143315 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.143037 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 15:13:11.143315 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.143134 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 15:13:11.143315 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.143282 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 15:13:11.143315 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.143307 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 15:13:11.144221 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.144097 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ftf5b\"" Jul 29 15:13:11.144337 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.144277 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 15:13:11.144413 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.144353 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 15:13:11.268979 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.268943 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72528215-5b8d-420a-8691-f22a2928e17a-console-oauth-config\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.269165 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.269011 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-oauth-serving-cert\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.269165 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.269061 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-service-ca\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.269165 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.269080 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92m9h\" (UniqueName: \"kubernetes.io/projected/72528215-5b8d-420a-8691-f22a2928e17a-kube-api-access-92m9h\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.269165 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.269112 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-console-config\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.269307 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.269190 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72528215-5b8d-420a-8691-f22a2928e17a-console-serving-cert\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.370116 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.370029 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72528215-5b8d-420a-8691-f22a2928e17a-console-serving-cert\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.370116 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.370073 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72528215-5b8d-420a-8691-f22a2928e17a-console-oauth-config\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.370116 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.370108 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-oauth-serving-cert\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.370404 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.370151 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-service-ca\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.370404 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.370178 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92m9h\" (UniqueName: \"kubernetes.io/projected/72528215-5b8d-420a-8691-f22a2928e17a-kube-api-access-92m9h\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.370404 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.370201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-console-config\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.370988 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.370938 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-console-config\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.371095 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.370986 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-service-ca\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.371198 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.371175 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-oauth-serving-cert\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.373066 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.373044 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72528215-5b8d-420a-8691-f22a2928e17a-console-serving-cert\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.373158 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.373118 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72528215-5b8d-420a-8691-f22a2928e17a-console-oauth-config\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.385173 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.385142 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92m9h\" (UniqueName: \"kubernetes.io/projected/72528215-5b8d-420a-8691-f22a2928e17a-kube-api-access-92m9h\") pod \"console-54b45f6c68-f2lp2\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.452964 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.452928 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:11.642899 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.642871 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b45f6c68-f2lp2"] Jul 29 15:13:11.955687 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:11.955655 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:12.051763 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:13:12.051733 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72528215_5b8d_420a_8691_f22a2928e17a.slice/crio-17085560ab3f662349a95dd5d22bb184adddfef193d670c3e1aa1b7451090682 WatchSource:0}: Error finding container 17085560ab3f662349a95dd5d22bb184adddfef193d670c3e1aa1b7451090682: Status 404 returned error can't find the container with id 17085560ab3f662349a95dd5d22bb184adddfef193d670c3e1aa1b7451090682 Jul 29 15:13:12.070816 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:12.070779 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:12.863979 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:12.863939 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:12.967901 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:12.967849 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:13.055241 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:13.055201 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" event={"ID":"9a5a0a60-6e05-46b0-b720-ea7d7305b63b","Type":"ContainerStarted","Data":"1e85dd3a1cc645ea3f8937fc7fa63f5960a41b253236860d9527f6daef9f1755"} Jul 29 15:13:13.056662 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:13.056635 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b45f6c68-f2lp2" event={"ID":"72528215-5b8d-420a-8691-f22a2928e17a","Type":"ContainerStarted","Data":"17085560ab3f662349a95dd5d22bb184adddfef193d670c3e1aa1b7451090682"} Jul 29 15:13:13.549991 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:13.549948 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:13.648074 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:13.648039 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:13.749949 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:13.749913 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:15.425209 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:15.425162 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:15.534276 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:15.534237 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:16.053216 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:16.053186 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77b8876f45-5jcmk" Jul 29 15:13:16.788268 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:16.788231 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:16.877540 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:16.877495 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:17.075488 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:17.075395 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" event={"ID":"9a5a0a60-6e05-46b0-b720-ea7d7305b63b","Type":"ContainerStarted","Data":"5af74d6cf5d5a70b7e4a9cd16f03e368555ad0e1f8ff98ac48235f110a773b5e"} Jul 29 15:13:17.075488 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:17.075462 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" event={"ID":"9a5a0a60-6e05-46b0-b720-ea7d7305b63b","Type":"ContainerStarted","Data":"40d6216c511ddbc8c6d9dd21becabd6f7472a70876692e68a24936918d0c15ea"} Jul 29 15:13:17.076923 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:17.076900 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b45f6c68-f2lp2" event={"ID":"72528215-5b8d-420a-8691-f22a2928e17a","Type":"ContainerStarted","Data":"1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4"} Jul 29 15:13:17.117078 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:17.117013 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5657b68c96-khwmn" podStartSLOduration=2.312017544 podStartE2EDuration="8.116991654s" totalImagesPullingTime="5.80497411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:13:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:13:17.115824033 +0000 UTC m=+125.102165616" watchObservedRunningTime="2026-07-29 15:13:17.116991654 +0000 UTC m=+125.103333239" Jul 29 15:13:17.140347 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:17.140296 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54b45f6c68-f2lp2" podStartSLOduration=2.115526773 podStartE2EDuration="6.140280114s" totalImagesPullingTime="4.024753341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:13:17.13947037 +0000 UTC m=+125.125811977" watchObservedRunningTime="2026-07-29 15:13:17.140280114 +0000 UTC m=+125.126621697" Jul 29 15:13:18.243255 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:18.243226 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:18.343969 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:18.343936 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:20.087654 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:20.087616 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:21.454026 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:21.453988 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:21.454423 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:21.454044 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:21.460936 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:21.460907 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:21.886886 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:21.886805 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:21.988888 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:21.988860 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:22.099861 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:22.099831 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:22.272931 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:22.272897 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:13:22.275184 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:22.275153 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d55803f3-c21e-4eb0-aeca-8877eae6a64b-metrics-certs\") pod \"network-metrics-daemon-5dntz\" (UID: \"d55803f3-c21e-4eb0-aeca-8877eae6a64b\") " pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:13:22.405000 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:22.404971 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sgb7s\"" Jul 29 15:13:22.405167 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:22.405134 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dntz" Jul 29 15:13:22.724398 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:22.724366 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5dntz"] Jul 29 15:13:22.727263 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:13:22.727233 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55803f3_c21e_4eb0_aeca_8877eae6a64b.slice/crio-35061a58aa43bdcd6457d29bbf60f78d9ca3cee1b0567eb420ce7732c7ea6721 WatchSource:0}: Error finding container 35061a58aa43bdcd6457d29bbf60f78d9ca3cee1b0567eb420ce7732c7ea6721: Status 404 returned error can't find the container with id 35061a58aa43bdcd6457d29bbf60f78d9ca3cee1b0567eb420ce7732c7ea6721 Jul 29 15:13:22.942248 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:22.942208 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:23.041042 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:23.041002 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:23.100538 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:23.100490 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5dntz" event={"ID":"d55803f3-c21e-4eb0-aeca-8877eae6a64b","Type":"ContainerStarted","Data":"35061a58aa43bdcd6457d29bbf60f78d9ca3cee1b0567eb420ce7732c7ea6721"} Jul 29 15:13:24.107145 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:24.107102 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5dntz" event={"ID":"d55803f3-c21e-4eb0-aeca-8877eae6a64b","Type":"ContainerStarted","Data":"658b90e60205db3c0791110fc786864c8f8222f3b831790455acab2c68360f4c"} Jul 29 15:13:24.564406 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:24.564372 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:24.674004 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:24.673970 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:24.789279 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:24.789238 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:24.889279 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:24.889187 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:25.112103 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:25.112068 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5dntz" event={"ID":"d55803f3-c21e-4eb0-aeca-8877eae6a64b","Type":"ContainerStarted","Data":"26902e28d36f0a67846097bab07f28927ed6507e62c1be4965a4daad6cb9c355"} Jul 29 15:13:25.131366 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:25.131313 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5dntz" podStartSLOduration=130.882960021 podStartE2EDuration="2m12.131296793s" totalImagesPullingTime="1.248336772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:13:25.129579465 +0000 UTC m=+133.115921052" watchObservedRunningTime="2026-07-29 15:13:25.131296793 +0000 UTC m=+133.117638377" Jul 29 15:13:25.246451 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:25.246422 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:25.346463 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:25.346430 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:31.877367 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:31.877319 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b45f6c68-f2lp2"] Jul 29 15:13:34.123504 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:34.123465 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:34.279960 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:34.279929 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:35.117785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:35.117744 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:35.221935 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:35.221906 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:35.592281 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:35.592246 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:35.670186 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:35.670147 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:36.923328 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:36.923287 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:37.020058 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:37.020021 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:39.164573 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:39.164517 2554 generic.go:356] "Generic (PLEG): container finished" podID="045efd45-dcb2-4a29-86f5-ca6dabf56bbe" containerID="b70c0a5ce01ae027cb856505c3ff5f1fa7daff7601d042f058902fac69f87b78" exitCode=0 Jul 29 15:13:39.164967 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:39.164590 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" event={"ID":"045efd45-dcb2-4a29-86f5-ca6dabf56bbe","Type":"ContainerDied","Data":"b70c0a5ce01ae027cb856505c3ff5f1fa7daff7601d042f058902fac69f87b78"} Jul 29 15:13:39.164967 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:39.164914 2554 scope.go:117] "RemoveContainer" containerID="b70c0a5ce01ae027cb856505c3ff5f1fa7daff7601d042f058902fac69f87b78" Jul 29 15:13:40.171292 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:40.171261 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-88d6q" event={"ID":"045efd45-dcb2-4a29-86f5-ca6dabf56bbe","Type":"ContainerStarted","Data":"12666560e837a402e9b5229bf6f53a13ed0c22c583178b9d56854bca0bec90be"} Jul 29 15:13:50.589432 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:50.589398 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:50.670299 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:50.670262 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:56.897117 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:56.897073 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54b45f6c68-f2lp2" podUID="72528215-5b8d-420a-8691-f22a2928e17a" containerName="console" containerID="cri-o://1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4" gracePeriod=15 Jul 29 15:13:57.135955 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.135931 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:57.235191 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.235154 2554 generic.go:356] "Generic (PLEG): container finished" podID="72528215-5b8d-420a-8691-f22a2928e17a" containerID="1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4" exitCode=0 Jul 29 15:13:57.235362 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.235199 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b45f6c68-f2lp2" Jul 29 15:13:57.235362 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.235232 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b45f6c68-f2lp2" event={"ID":"72528215-5b8d-420a-8691-f22a2928e17a","Type":"ContainerDied","Data":"1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4"} Jul 29 15:13:57.235362 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.235288 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b45f6c68-f2lp2" event={"ID":"72528215-5b8d-420a-8691-f22a2928e17a","Type":"ContainerDied","Data":"17085560ab3f662349a95dd5d22bb184adddfef193d670c3e1aa1b7451090682"} Jul 29 15:13:57.235362 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.235309 2554 scope.go:117] "RemoveContainer" containerID="1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4" Jul 29 15:13:57.245090 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.245072 2554 scope.go:117] "RemoveContainer" containerID="1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4" Jul 29 15:13:57.245387 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:13:57.245360 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4\": container with ID starting with 1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4 not found: ID does not exist" containerID="1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4" Jul 29 15:13:57.245490 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.245397 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4"} err="failed to get container status \"1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4\": rpc error: code = NotFound desc = could not find container \"1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4\": container with ID starting with 1c4c209b0b9094f325776e03d08e73e5c68f841f39cd67f0ff823ef2f0954ed4 not found: ID does not exist" Jul 29 15:13:57.275887 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.275847 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-oauth-serving-cert\") pod \"72528215-5b8d-420a-8691-f22a2928e17a\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " Jul 29 15:13:57.276020 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.275895 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-console-config\") pod \"72528215-5b8d-420a-8691-f22a2928e17a\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " Jul 29 15:13:57.276020 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.275929 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-service-ca\") pod \"72528215-5b8d-420a-8691-f22a2928e17a\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " Jul 29 15:13:57.276111 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.276042 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72528215-5b8d-420a-8691-f22a2928e17a-console-serving-cert\") pod \"72528215-5b8d-420a-8691-f22a2928e17a\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " Jul 29 15:13:57.276111 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.276086 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92m9h\" (UniqueName: \"kubernetes.io/projected/72528215-5b8d-420a-8691-f22a2928e17a-kube-api-access-92m9h\") pod \"72528215-5b8d-420a-8691-f22a2928e17a\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " Jul 29 15:13:57.276213 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.276176 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72528215-5b8d-420a-8691-f22a2928e17a-console-oauth-config\") pod \"72528215-5b8d-420a-8691-f22a2928e17a\" (UID: \"72528215-5b8d-420a-8691-f22a2928e17a\") " Jul 29 15:13:57.276365 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.276340 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-console-config" (OuterVolumeSpecName: "console-config") pod "72528215-5b8d-420a-8691-f22a2928e17a" (UID: "72528215-5b8d-420a-8691-f22a2928e17a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:13:57.276365 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.276354 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "72528215-5b8d-420a-8691-f22a2928e17a" (UID: "72528215-5b8d-420a-8691-f22a2928e17a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:13:57.276473 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.276344 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-service-ca" (OuterVolumeSpecName: "service-ca") pod "72528215-5b8d-420a-8691-f22a2928e17a" (UID: "72528215-5b8d-420a-8691-f22a2928e17a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:13:57.276473 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.276440 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-oauth-serving-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:13:57.276473 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.276466 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-console-config\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:13:57.276610 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.276484 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72528215-5b8d-420a-8691-f22a2928e17a-service-ca\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:13:57.278476 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.278448 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72528215-5b8d-420a-8691-f22a2928e17a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "72528215-5b8d-420a-8691-f22a2928e17a" (UID: "72528215-5b8d-420a-8691-f22a2928e17a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:13:57.278476 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.278457 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72528215-5b8d-420a-8691-f22a2928e17a-kube-api-access-92m9h" (OuterVolumeSpecName: "kube-api-access-92m9h") pod "72528215-5b8d-420a-8691-f22a2928e17a" (UID: "72528215-5b8d-420a-8691-f22a2928e17a"). InnerVolumeSpecName "kube-api-access-92m9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:13:57.278645 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.278463 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72528215-5b8d-420a-8691-f22a2928e17a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "72528215-5b8d-420a-8691-f22a2928e17a" (UID: "72528215-5b8d-420a-8691-f22a2928e17a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:13:57.377660 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.377620 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72528215-5b8d-420a-8691-f22a2928e17a-console-serving-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:13:57.377660 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.377652 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92m9h\" (UniqueName: \"kubernetes.io/projected/72528215-5b8d-420a-8691-f22a2928e17a-kube-api-access-92m9h\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:13:57.377660 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.377663 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72528215-5b8d-420a-8691-f22a2928e17a-console-oauth-config\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:13:57.560637 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.560605 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b45f6c68-f2lp2"] Jul 29 15:13:57.568999 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:57.568966 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54b45f6c68-f2lp2"] Jul 29 15:13:58.589299 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:13:58.589264 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72528215-5b8d-420a-8691-f22a2928e17a" path="/var/lib/kubelet/pods/72528215-5b8d-420a-8691-f22a2928e17a/volumes" Jul 29 15:14:20.628386 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:20.628344 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:20.722822 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:20.722793 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:27.219141 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.219110 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:14:27.219550 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.219532 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72528215-5b8d-420a-8691-f22a2928e17a" containerName="console" Jul 29 15:14:27.219604 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.219552 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="72528215-5b8d-420a-8691-f22a2928e17a" containerName="console" Jul 29 15:14:27.219676 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.219663 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="72528215-5b8d-420a-8691-f22a2928e17a" containerName="console" Jul 29 15:14:27.224750 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.224733 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.227908 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.227879 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 15:14:27.227908 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.227895 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 15:14:27.228129 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.227893 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 15:14:27.228129 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.228011 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 15:14:27.228129 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.228021 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 15:14:27.228129 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.228021 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 15:14:27.228342 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.228136 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 15:14:27.228342 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.228327 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ts2w5\"" Jul 29 15:14:27.228439 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.228427 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 15:14:27.234815 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.234797 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 15:14:27.237547 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.237506 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:14:27.309286 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309242 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.309286 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309285 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.309501 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309310 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df15251-8272-483e-8f4d-ef7174d641c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.309501 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309418 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df15251-8272-483e-8f4d-ef7174d641c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.309501 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309449 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.309501 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309472 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.309501 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.309747 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309512 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-web-config\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.309747 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309621 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df15251-8272-483e-8f4d-ef7174d641c8-config-out\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.309747 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309693 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksrms\" (UniqueName: \"kubernetes.io/projected/2df15251-8272-483e-8f4d-ef7174d641c8-kube-api-access-ksrms\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.309747 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309729 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.309909 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309752 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df15251-8272-483e-8f4d-ef7174d641c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.309909 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.309776 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2df15251-8272-483e-8f4d-ef7174d641c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.410611 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410562 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df15251-8272-483e-8f4d-ef7174d641c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.410611 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410610 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.410869 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.410869 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410653 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.410869 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410677 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-web-config\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.410869 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410715 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df15251-8272-483e-8f4d-ef7174d641c8-config-out\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.410869 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410769 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksrms\" (UniqueName: \"kubernetes.io/projected/2df15251-8272-483e-8f4d-ef7174d641c8-kube-api-access-ksrms\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.410869 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410797 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.410869 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410825 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df15251-8272-483e-8f4d-ef7174d641c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.410869 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410850 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2df15251-8272-483e-8f4d-ef7174d641c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.411280 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410882 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.411280 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410906 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.411280 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.410936 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df15251-8272-483e-8f4d-ef7174d641c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.411692 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.411667 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df15251-8272-483e-8f4d-ef7174d641c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.412638 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.412608 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df15251-8272-483e-8f4d-ef7174d641c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.412908 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.412885 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2df15251-8272-483e-8f4d-ef7174d641c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.413574 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.413547 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.413693 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.413670 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df15251-8272-483e-8f4d-ef7174d641c8-config-out\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.413756 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.413741 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df15251-8272-483e-8f4d-ef7174d641c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.414096 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.414059 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.414177 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.414090 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-web-config\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.414475 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.414451 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.415440 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.415415 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.415546 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.415422 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.415795 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.415778 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df15251-8272-483e-8f4d-ef7174d641c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.424935 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.424911 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksrms\" (UniqueName: \"kubernetes.io/projected/2df15251-8272-483e-8f4d-ef7174d641c8-kube-api-access-ksrms\") pod \"alertmanager-main-0\" (UID: \"2df15251-8272-483e-8f4d-ef7174d641c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.535913 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.535822 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:14:27.682938 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:27.682908 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:14:27.684984 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:14:27.684956 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df15251_8272_483e_8f4d_ef7174d641c8.slice/crio-c840319867e8ce6ebf8d0c5aa160abe8d64cce1e9b1fb77e015752def879a992 WatchSource:0}: Error finding container c840319867e8ce6ebf8d0c5aa160abe8d64cce1e9b1fb77e015752def879a992: Status 404 returned error can't find the container with id c840319867e8ce6ebf8d0c5aa160abe8d64cce1e9b1fb77e015752def879a992 Jul 29 15:14:28.355425 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:28.355390 2554 generic.go:356] "Generic (PLEG): container finished" podID="2df15251-8272-483e-8f4d-ef7174d641c8" containerID="588f135d94e39a2041f69db6ba331d46399f57275b722f0b7cf9baa2752523f1" exitCode=0 Jul 29 15:14:28.355841 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:28.355458 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df15251-8272-483e-8f4d-ef7174d641c8","Type":"ContainerDied","Data":"588f135d94e39a2041f69db6ba331d46399f57275b722f0b7cf9baa2752523f1"} Jul 29 15:14:28.355841 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:28.355545 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df15251-8272-483e-8f4d-ef7174d641c8","Type":"ContainerStarted","Data":"c840319867e8ce6ebf8d0c5aa160abe8d64cce1e9b1fb77e015752def879a992"} Jul 29 15:14:30.369126 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:30.369094 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df15251-8272-483e-8f4d-ef7174d641c8","Type":"ContainerStarted","Data":"54509d60435fb7ef160d115e4b83cdddd23c7cc0d8eb0f07e3ab198ac1167357"} Jul 29 15:14:30.369536 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:30.369154 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df15251-8272-483e-8f4d-ef7174d641c8","Type":"ContainerStarted","Data":"c96cb49457c22505a6955a60aeea8cd2beb2a52f364304028531c1281c51d06b"} Jul 29 15:14:30.369536 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:30.369181 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df15251-8272-483e-8f4d-ef7174d641c8","Type":"ContainerStarted","Data":"1eaf0976392fd6b55f5e8a377bcacc3f77f60066f01a287814ecd18ed070b949"} Jul 29 15:14:30.369536 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:30.369211 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df15251-8272-483e-8f4d-ef7174d641c8","Type":"ContainerStarted","Data":"f4311b82970388253bc28d8ac3c84413a459e0f5c791ed36545f271f598a6c67"} Jul 29 15:14:30.369536 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:30.369234 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df15251-8272-483e-8f4d-ef7174d641c8","Type":"ContainerStarted","Data":"61543cf48f1cde25790ce29db53fc3b4497ac018e78e7f408c5a94f5b3f5fb5b"} Jul 29 15:14:30.369536 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:30.369259 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df15251-8272-483e-8f4d-ef7174d641c8","Type":"ContainerStarted","Data":"ba9db1c57053d7b07e7a5457fcf3dfab8bf4f35a4edf049a124a57abce5573f2"} Jul 29 15:14:30.401044 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:30.400992 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.826392637 podStartE2EDuration="3.400973068s" totalImagesPullingTime="1.558775045s" totalInitContainerRuntime="15.805386ms" isStatefulPod=false podCreationTimestamp="2026-07-29 15:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:14:30.399506798 +0000 UTC m=+198.385848383" watchObservedRunningTime="2026-07-29 15:14:30.400973068 +0000 UTC m=+198.387314651" Jul 29 15:14:32.436027 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:32.435993 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:34.301974 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:34.301940 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:35.590305 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:35.590265 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:35.688081 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:35.688047 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:41.858767 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:41.858729 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:47.450572 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:47.450537 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:47.550500 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:47.550468 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:58.338652 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:58.338610 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:58.439412 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:58.439378 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:58.504731 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:14:58.504693 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:15:29.602493 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:15:29.602454 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:15:29.701969 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:15:29.701911 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:15:52.545346 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:15:52.545306 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:15:52.642151 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:15:52.642101 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:15:53.524258 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:15:53.524227 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:15:56.152694 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:15:56.152658 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:15:56.252027 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:15:56.251988 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:15:59.852721 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:15:59.852681 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:00.041574 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:00.041540 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:01.539017 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:01.538979 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:01.605416 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:01.605371 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:01.698401 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:01.698344 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:02.319139 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:02.319104 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:08.340917 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:08.340869 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:09.893677 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:09.893632 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:09.970242 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:09.970208 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:10.464592 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.464555 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z"] Jul 29 15:16:10.467703 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.467686 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z" Jul 29 15:16:10.470035 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.470013 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:16:10.470120 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.470063 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 29 15:16:10.470120 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.470081 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bg2vk\"" Jul 29 15:16:10.481274 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.481251 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z"] Jul 29 15:16:10.563788 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.563757 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59300779-12c8-4b98-96bb-8f8575b8a8ab-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pdp4z\" (UID: \"59300779-12c8-4b98-96bb-8f8575b8a8ab\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z" Jul 29 15:16:10.563937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.563806 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkp8m\" (UniqueName: \"kubernetes.io/projected/59300779-12c8-4b98-96bb-8f8575b8a8ab-kube-api-access-mkp8m\") pod \"openshift-lws-operator-fd8ccff4c-pdp4z\" (UID: \"59300779-12c8-4b98-96bb-8f8575b8a8ab\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z" Jul 29 15:16:10.664222 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.664194 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59300779-12c8-4b98-96bb-8f8575b8a8ab-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pdp4z\" (UID: \"59300779-12c8-4b98-96bb-8f8575b8a8ab\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z" Jul 29 15:16:10.664368 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.664237 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkp8m\" (UniqueName: \"kubernetes.io/projected/59300779-12c8-4b98-96bb-8f8575b8a8ab-kube-api-access-mkp8m\") pod \"openshift-lws-operator-fd8ccff4c-pdp4z\" (UID: \"59300779-12c8-4b98-96bb-8f8575b8a8ab\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z" Jul 29 15:16:10.664563 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.664546 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59300779-12c8-4b98-96bb-8f8575b8a8ab-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pdp4z\" (UID: \"59300779-12c8-4b98-96bb-8f8575b8a8ab\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z" Jul 29 15:16:10.673416 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.673386 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkp8m\" (UniqueName: \"kubernetes.io/projected/59300779-12c8-4b98-96bb-8f8575b8a8ab-kube-api-access-mkp8m\") pod \"openshift-lws-operator-fd8ccff4c-pdp4z\" (UID: \"59300779-12c8-4b98-96bb-8f8575b8a8ab\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z" Jul 29 15:16:10.787801 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.787733 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z" Jul 29 15:16:10.914886 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:10.914804 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z"] Jul 29 15:16:10.918330 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:16:10.918298 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59300779_12c8_4b98_96bb_8f8575b8a8ab.slice/crio-d8a1d7b9bc23c0725794bd4bb6ecadce074a0ef106d37af7e9dfd9a7d04fe18f WatchSource:0}: Error finding container d8a1d7b9bc23c0725794bd4bb6ecadce074a0ef106d37af7e9dfd9a7d04fe18f: Status 404 returned error can't find the container with id d8a1d7b9bc23c0725794bd4bb6ecadce074a0ef106d37af7e9dfd9a7d04fe18f Jul 29 15:16:11.124720 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:11.124638 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:11.755451 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:11.755409 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z" event={"ID":"59300779-12c8-4b98-96bb-8f8575b8a8ab","Type":"ContainerStarted","Data":"d8a1d7b9bc23c0725794bd4bb6ecadce074a0ef106d37af7e9dfd9a7d04fe18f"} Jul 29 15:16:12.875784 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:12.875762 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 15:16:14.770036 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:14.770001 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z" event={"ID":"59300779-12c8-4b98-96bb-8f8575b8a8ab","Type":"ContainerStarted","Data":"63eab5e7e756b8378000012cbc82fc08feb245cb86eccb967f1cc8272505100f"} Jul 29 15:16:14.786815 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:14.786763 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pdp4z" podStartSLOduration=1.802314229 podStartE2EDuration="4.786745967s" totalImagesPullingTime="2.984431738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:16:14.786640035 +0000 UTC m=+302.772981620" watchObservedRunningTime="2026-07-29 15:16:14.786745967 +0000 UTC m=+302.773087552" Jul 29 15:16:15.577050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:15.577008 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:15.677255 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:15.677219 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:17.615421 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:17.615390 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:27.864237 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:27.864204 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:27.937848 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:27.937816 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt"] Jul 29 15:16:27.941096 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:27.941079 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:27.944301 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:27.944271 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 29 15:16:27.944430 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:27.944304 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 29 15:16:27.944430 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:27.944305 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 29 15:16:27.944430 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:27.944350 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nr6lz\"" Jul 29 15:16:27.951135 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:27.951114 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt"] Jul 29 15:16:27.968951 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:27.968927 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:28.004220 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.004187 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3-manager-config\") pod \"lws-controller-manager-9bd7bffd8-mvcwt\" (UID: \"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3\") " pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.004385 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.004227 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3-metrics-cert\") pod \"lws-controller-manager-9bd7bffd8-mvcwt\" (UID: \"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3\") " pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.004385 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.004254 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97xxl\" (UniqueName: \"kubernetes.io/projected/2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3-kube-api-access-97xxl\") pod \"lws-controller-manager-9bd7bffd8-mvcwt\" (UID: \"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3\") " pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.004385 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.004349 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3-cert\") pod \"lws-controller-manager-9bd7bffd8-mvcwt\" (UID: \"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3\") " pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.105119 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.105082 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3-cert\") pod \"lws-controller-manager-9bd7bffd8-mvcwt\" (UID: \"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3\") " pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.105314 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.105143 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3-manager-config\") pod \"lws-controller-manager-9bd7bffd8-mvcwt\" (UID: \"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3\") " pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.105314 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.105165 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3-metrics-cert\") pod \"lws-controller-manager-9bd7bffd8-mvcwt\" (UID: \"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3\") " pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.105314 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.105188 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97xxl\" (UniqueName: \"kubernetes.io/projected/2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3-kube-api-access-97xxl\") pod \"lws-controller-manager-9bd7bffd8-mvcwt\" (UID: \"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3\") " pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.105936 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.105911 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3-manager-config\") pod \"lws-controller-manager-9bd7bffd8-mvcwt\" (UID: \"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3\") " pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.107723 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.107705 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3-cert\") pod \"lws-controller-manager-9bd7bffd8-mvcwt\" (UID: \"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3\") " pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.107784 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.107750 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3-metrics-cert\") pod \"lws-controller-manager-9bd7bffd8-mvcwt\" (UID: \"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3\") " pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.114959 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.114901 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97xxl\" (UniqueName: \"kubernetes.io/projected/2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3-kube-api-access-97xxl\") pod \"lws-controller-manager-9bd7bffd8-mvcwt\" (UID: \"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3\") " pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.250701 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.250669 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:28.381533 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.381493 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt"] Jul 29 15:16:28.384439 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:16:28.384411 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dac5b43_2ac9_432b_bdf3_f48b8a2f86a3.slice/crio-94b7ba00e8846afb4d68e7f207c6bee46b5daa587cc2750d635373715ecdb538 WatchSource:0}: Error finding container 94b7ba00e8846afb4d68e7f207c6bee46b5daa587cc2750d635373715ecdb538: Status 404 returned error can't find the container with id 94b7ba00e8846afb4d68e7f207c6bee46b5daa587cc2750d635373715ecdb538 Jul 29 15:16:28.386795 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.386778 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:16:28.822318 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:28.822283 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" event={"ID":"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3","Type":"ContainerStarted","Data":"94b7ba00e8846afb4d68e7f207c6bee46b5daa587cc2750d635373715ecdb538"} Jul 29 15:16:30.832139 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:30.832101 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" event={"ID":"2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3","Type":"ContainerStarted","Data":"4b710f95ef9a2e375728e68c89f5450beaf30d96b6ff5325393a789fdfd20533"} Jul 29 15:16:30.832501 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:30.832232 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:33.541847 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:33.541791 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:33.645002 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:33.644966 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:33.965742 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:33.965712 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:34.224786 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.224689 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:34.393219 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.393165 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" podStartSLOduration=5.679713906 podStartE2EDuration="7.393147746s" totalImagesPullingTime="1.71343384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:16:30.852899919 +0000 UTC m=+318.839241515" watchObservedRunningTime="2026-07-29 15:16:34.393147746 +0000 UTC m=+322.379489330" Jul 29 15:16:34.394620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.394597 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l"] Jul 29 15:16:34.397874 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.397857 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.400156 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.400135 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 29 15:16:34.400257 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.400241 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 29 15:16:34.400487 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.400465 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 29 15:16:34.400660 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.400647 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-djg4x\"" Jul 29 15:16:34.400714 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.400680 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 29 15:16:34.423254 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.423222 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l"] Jul 29 15:16:34.458068 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.457992 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.458068 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.458067 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-manifests\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.458358 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.458106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvtrz\" (UniqueName: \"kubernetes.io/projected/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-kube-api-access-nvtrz\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.458358 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.458178 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-tmp\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.458358 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.458262 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.559104 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.559010 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvtrz\" (UniqueName: \"kubernetes.io/projected/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-kube-api-access-nvtrz\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.559104 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.559079 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-tmp\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.559497 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.559117 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.559497 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.559165 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.559497 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.559204 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-manifests\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.559630 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.559588 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-manifests\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.561397 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.561372 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-tmp\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.561621 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.561603 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.561672 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.561636 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.573192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.573169 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvtrz\" (UniqueName: \"kubernetes.io/projected/d83d4c97-9a02-45f8-9f56-8dc60cdae7da-kube-api-access-nvtrz\") pod \"opendatahub-operator-controller-manager-85b6fb79c5-49l9l\" (UID: \"d83d4c97-9a02-45f8-9f56-8dc60cdae7da\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.708886 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.708854 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:34.847798 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:34.847775 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l"] Jul 29 15:16:34.850089 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:16:34.850061 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83d4c97_9a02_45f8_9f56_8dc60cdae7da.slice/crio-728a4f8910ea93804715c742ce650a9ce31733be7e2a8aeb54884e9bcb087d5e WatchSource:0}: Error finding container 728a4f8910ea93804715c742ce650a9ce31733be7e2a8aeb54884e9bcb087d5e: Status 404 returned error can't find the container with id 728a4f8910ea93804715c742ce650a9ce31733be7e2a8aeb54884e9bcb087d5e Jul 29 15:16:35.809741 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:35.809701 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:35.855597 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:35.855558 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" event={"ID":"d83d4c97-9a02-45f8-9f56-8dc60cdae7da","Type":"ContainerStarted","Data":"728a4f8910ea93804715c742ce650a9ce31733be7e2a8aeb54884e9bcb087d5e"} Jul 29 15:16:38.871041 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:38.871003 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" event={"ID":"d83d4c97-9a02-45f8-9f56-8dc60cdae7da","Type":"ContainerStarted","Data":"cefec0acf92b7b549c48780938b3c387e632bef99c4fac44d9911b15283fd03d"} Jul 29 15:16:39.877172 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:39.877137 2554 generic.go:356] "Generic (PLEG): container finished" podID="d83d4c97-9a02-45f8-9f56-8dc60cdae7da" containerID="cefec0acf92b7b549c48780938b3c387e632bef99c4fac44d9911b15283fd03d" exitCode=0 Jul 29 15:16:39.877593 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:39.877219 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" event={"ID":"d83d4c97-9a02-45f8-9f56-8dc60cdae7da","Type":"ContainerDied","Data":"cefec0acf92b7b549c48780938b3c387e632bef99c4fac44d9911b15283fd03d"} Jul 29 15:16:40.883700 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:40.883660 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" event={"ID":"d83d4c97-9a02-45f8-9f56-8dc60cdae7da","Type":"ContainerStarted","Data":"469163807b5809657f1ed22837d0b6f3b495d881208619ac52df24d867efc89e"} Jul 29 15:16:40.884095 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:40.883753 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:40.907481 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:40.907430 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" podStartSLOduration=2.451639561 podStartE2EDuration="6.907413688s" totalImagesPullingTime="3.413406701s" totalInitContainerRuntime="1.042367426s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:16:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:16:40.904998079 +0000 UTC m=+328.891339663" watchObservedRunningTime="2026-07-29 15:16:40.907413688 +0000 UTC m=+328.893755272" Jul 29 15:16:41.838538 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:41.838492 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9bd7bffd8-mvcwt" Jul 29 15:16:51.890811 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:51.890781 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85b6fb79c5-49l9l" Jul 29 15:16:55.328742 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:55.328710 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:55.432146 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:55.432118 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:55.780548 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:55.780506 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:55.973329 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:55.973295 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:56.077920 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:56.077845 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:56.180386 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:56.180354 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:57.055072 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:57.055041 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:57.332137 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:57.332050 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:57.403007 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:57.402974 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:16:58.535377 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:16:58.535344 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:03.254256 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:03.254216 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:03.352540 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:03.352493 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:04.037649 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.037617 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl"] Jul 29 15:17:04.040118 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.040103 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.044732 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.044709 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-94xmz\"" Jul 29 15:17:04.044858 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.044777 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 29 15:17:04.059647 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.059619 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl"] Jul 29 15:17:04.088714 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.088683 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:04.116077 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.116047 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.116203 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.116085 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.116203 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.116143 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.116203 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.116185 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.116305 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.116211 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.116305 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.116235 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6httg\" (UniqueName: \"kubernetes.io/projected/c4f0c199-ceef-49b0-b97e-01c5bde4b232-kube-api-access-6httg\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.116305 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.116284 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.116305 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.116301 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.116432 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.116317 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.158460 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.158425 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:04.216854 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.216813 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.216854 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.216851 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.217172 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.216886 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.217172 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.216910 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.217172 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.216928 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.217172 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.217013 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6httg\" (UniqueName: \"kubernetes.io/projected/c4f0c199-ceef-49b0-b97e-01c5bde4b232-kube-api-access-6httg\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.217172 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.217088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.217172 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.217120 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.217172 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.217148 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.217481 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.217243 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.217481 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.217409 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.217610 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.217483 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.217610 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.217494 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.218113 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.218090 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.219315 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.219297 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.219418 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.219403 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.229251 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.229201 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4f0c199-ceef-49b0-b97e-01c5bde4b232-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.229514 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.229495 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6httg\" (UniqueName: \"kubernetes.io/projected/c4f0c199-ceef-49b0-b97e-01c5bde4b232-kube-api-access-6httg\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl\" (UID: \"c4f0c199-ceef-49b0-b97e-01c5bde4b232\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.260450 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.260388 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:04.350935 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.350847 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:04.368866 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.368806 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:04.491098 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.491050 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl"] Jul 29 15:17:04.493248 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:17:04.493226 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f0c199_ceef_49b0_b97e_01c5bde4b232.slice/crio-ebf9cfafaf5900a49c9cd6de02a888381fc237fca6a4dc58ff67e8eed9f1f54f WatchSource:0}: Error finding container ebf9cfafaf5900a49c9cd6de02a888381fc237fca6a4dc58ff67e8eed9f1f54f: Status 404 returned error can't find the container with id ebf9cfafaf5900a49c9cd6de02a888381fc237fca6a4dc58ff67e8eed9f1f54f Jul 29 15:17:04.658052 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.657966 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9"] Jul 29 15:17:04.663532 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.663496 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.666599 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.666573 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 29 15:17:04.666721 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.666580 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 29 15:17:04.666869 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.666855 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 29 15:17:04.667203 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.667187 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-99s7b\"" Jul 29 15:17:04.673400 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.673380 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9"] Jul 29 15:17:04.721034 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.720992 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7rqz\" (UniqueName: \"kubernetes.io/projected/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-kube-api-access-g7rqz\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.721034 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.721039 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.721239 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.721125 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.721239 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.721179 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.721239 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.721212 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.721239 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.721228 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.721388 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.721251 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.822243 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.822202 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.822428 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.822270 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.822428 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.822312 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.822428 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.822335 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.822428 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.822359 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.822428 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.822395 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7rqz\" (UniqueName: \"kubernetes.io/projected/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-kube-api-access-g7rqz\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.822428 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.822425 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.823135 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.823111 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.824623 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.824603 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.824703 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.824651 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.824967 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.824948 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.825045 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.825029 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.833912 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.833888 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.834144 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.834125 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7rqz\" (UniqueName: \"kubernetes.io/projected/94c7f7b9-82f0-49d0-ac75-c95c357e3cf4-kube-api-access-g7rqz\") pod \"istiod-openshift-gateway-5677ccb49b-47tx9\" (UID: \"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.973658 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.973621 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:04.983604 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:04.983574 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" event={"ID":"c4f0c199-ceef-49b0-b97e-01c5bde4b232","Type":"ContainerStarted","Data":"ebf9cfafaf5900a49c9cd6de02a888381fc237fca6a4dc58ff67e8eed9f1f54f"} Jul 29 15:17:05.111280 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:05.111254 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9"] Jul 29 15:17:05.113153 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:17:05.113132 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c7f7b9_82f0_49d0_ac75_c95c357e3cf4.slice/crio-56f78860658d16f26fcd1edfacf0ba815b38587a993ed583fed9780bc21a261d WatchSource:0}: Error finding container 56f78860658d16f26fcd1edfacf0ba815b38587a993ed583fed9780bc21a261d: Status 404 returned error can't find the container with id 56f78860658d16f26fcd1edfacf0ba815b38587a993ed583fed9780bc21a261d Jul 29 15:17:05.991715 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:05.991670 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" event={"ID":"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4","Type":"ContainerStarted","Data":"56f78860658d16f26fcd1edfacf0ba815b38587a993ed583fed9780bc21a261d"} Jul 29 15:17:07.047694 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:07.047640 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:07.177875 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:07.177836 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:07.271998 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:07.271949 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:07.531789 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:07.531738 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:08.376726 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:08.376671 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:08.479917 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:08.479882 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:08.524821 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:08.524778 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:17:08.524915 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:08.524873 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:17:08.524953 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:08.524919 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:17:08.525258 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:08.525223 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:17:08.525361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:08.525287 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:17:09.008760 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:09.008723 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" event={"ID":"94c7f7b9-82f0-49d0-ac75-c95c357e3cf4","Type":"ContainerStarted","Data":"fd6f2468ada9b83c45adfbb52463b0bbbe844954c82085bc34af026d5e2e9aa7"} Jul 29 15:17:09.008967 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:09.008916 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:09.010413 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:09.010379 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" event={"ID":"c4f0c199-ceef-49b0-b97e-01c5bde4b232","Type":"ContainerStarted","Data":"92cc4b45f073c09bf487415f85ec86467da674e121839603dc77458c7993c062"} Jul 29 15:17:09.010554 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:09.010515 2554 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-47tx9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 29 15:17:09.010615 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:09.010582 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" podUID="94c7f7b9-82f0-49d0-ac75-c95c357e3cf4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 15:17:09.035598 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:09.035556 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" podStartSLOduration=1.6257061940000002 podStartE2EDuration="5.035544354s" totalImagesPullingTime="3.40983816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:17:09.034722737 +0000 UTC m=+357.021064321" watchObservedRunningTime="2026-07-29 15:17:09.035544354 +0000 UTC m=+357.021885935" Jul 29 15:17:09.061092 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:09.061048 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" podStartSLOduration=1.031681543 podStartE2EDuration="5.061036077s" totalImagesPullingTime="4.029354534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:17:09.06018641 +0000 UTC m=+357.046528003" watchObservedRunningTime="2026-07-29 15:17:09.061036077 +0000 UTC m=+357.047377662" Jul 29 15:17:09.351463 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:09.351376 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:09.358478 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:09.358449 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:10.015377 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:10.015344 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:10.015827 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:10.015649 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-47tx9" Jul 29 15:17:10.016162 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:10.016148 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl" Jul 29 15:17:56.925642 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:56.925602 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:56.998575 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:56.998497 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:17:57.157826 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:17:57.157788 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:21.802884 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:21.802842 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:25.703284 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:25.703249 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:29.173216 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:29.173183 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:29.269941 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:29.269907 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:32.393579 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:32.393546 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:32.493393 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:32.493359 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:32.595052 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:32.595002 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:33.603278 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:33.603194 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:34.007453 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:34.007417 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:35.459905 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:35.459871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:37.007103 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:37.007072 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:37.871141 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:37.871108 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:37.990543 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:37.990492 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:39.833785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:39.833755 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:41.202512 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:41.202478 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:41.303133 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:41.303099 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:42.250430 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:42.250391 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:42.550441 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:42.550360 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:44.608175 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:44.608132 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:44.708712 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:44.708684 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:46.851096 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:46.851067 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:46.951755 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:46.951722 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:53.343078 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:53.343048 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:53.439476 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:53.439445 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:55.677048 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:55.677012 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:55.787015 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:18:55.786978 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:00.219171 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:00.219137 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:00.287185 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:00.287158 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:01.401022 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:01.400989 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:01.459577 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:01.459547 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:02.221936 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:02.221903 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:02.325299 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:02.325261 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:11.637037 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:11.637005 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:11.734372 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:11.734340 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:13.510621 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:13.510589 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:13.605540 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:13.605503 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:17.855723 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:17.855691 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:17.957191 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:17.957155 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:20.857178 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:20.857145 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:20.956702 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:20.956673 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:26.887672 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.887642 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv"] Jul 29 15:19:26.891199 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.891181 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:26.893486 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.893467 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-knc89\"" Jul 29 15:19:26.902149 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.902130 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv"] Jul 29 15:19:26.927341 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.927313 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:26.939496 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.939473 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:26.939599 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.939507 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768f20d8-98e0-472b-b26e-ce5fc2921eec-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:26.939599 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.939555 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:26.939599 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.939582 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:26.939705 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.939657 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:26.939738 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.939717 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:26.939771 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.939745 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768f20d8-98e0-472b-b26e-ce5fc2921eec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:26.939803 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.939767 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-969qc\" (UniqueName: \"kubernetes.io/projected/768f20d8-98e0-472b-b26e-ce5fc2921eec-kube-api-access-969qc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:26.939803 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:26.939786 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768f20d8-98e0-472b-b26e-ce5fc2921eec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.040245 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.040212 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.040245 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.040244 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768f20d8-98e0-472b-b26e-ce5fc2921eec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.040245 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.040260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-969qc\" (UniqueName: \"kubernetes.io/projected/768f20d8-98e0-472b-b26e-ce5fc2921eec-kube-api-access-969qc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.040577 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.040279 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768f20d8-98e0-472b-b26e-ce5fc2921eec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.040577 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.040325 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.040577 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.040477 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768f20d8-98e0-472b-b26e-ce5fc2921eec-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.040577 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.040514 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.040577 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.040557 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.040890 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.040635 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.040890 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.040676 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.041063 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.041036 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768f20d8-98e0-472b-b26e-ce5fc2921eec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.041148 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.041062 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.041148 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.041072 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.041252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.041218 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.042872 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.042842 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768f20d8-98e0-472b-b26e-ce5fc2921eec-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.042999 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.042950 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768f20d8-98e0-472b-b26e-ce5fc2921eec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.050728 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.050703 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-969qc\" (UniqueName: \"kubernetes.io/projected/768f20d8-98e0-472b-b26e-ce5fc2921eec-kube-api-access-969qc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.050892 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.050781 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768f20d8-98e0-472b-b26e-ce5fc2921eec-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-5dpfv\" (UID: \"768f20d8-98e0-472b-b26e-ce5fc2921eec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.202878 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.202844 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:27.340045 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.340023 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv"] Jul 29 15:19:27.342210 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:19:27.342185 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768f20d8_98e0_472b_b26e_ce5fc2921eec.slice/crio-cf3f1ed804bcc56b313debab2b4ee8af33e5c3c1adae538f6410060c23d418a8 WatchSource:0}: Error finding container cf3f1ed804bcc56b313debab2b4ee8af33e5c3c1adae538f6410060c23d418a8: Status 404 returned error can't find the container with id cf3f1ed804bcc56b313debab2b4ee8af33e5c3c1adae538f6410060c23d418a8 Jul 29 15:19:27.344712 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.344674 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:19:27.344801 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.344750 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:19:27.344801 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.344778 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:19:27.449115 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.449085 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:27.620398 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.620317 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" event={"ID":"768f20d8-98e0-472b-b26e-ce5fc2921eec","Type":"ContainerStarted","Data":"4dfec0585ca98e42e33ac4b6a83d65f777b33436adace90c7b8674bba05c13a9"} Jul 29 15:19:27.620398 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:27.620363 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" event={"ID":"768f20d8-98e0-472b-b26e-ce5fc2921eec","Type":"ContainerStarted","Data":"cf3f1ed804bcc56b313debab2b4ee8af33e5c3c1adae538f6410060c23d418a8"} Jul 29 15:19:28.203488 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:28.203451 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:28.208504 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:28.208481 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:28.230980 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:28.230932 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" podStartSLOduration=2.230914993 podStartE2EDuration="2.230914993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:19:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:19:27.64546369 +0000 UTC m=+495.631805275" watchObservedRunningTime="2026-07-29 15:19:28.230914993 +0000 UTC m=+496.217256577" Jul 29 15:19:28.624763 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:28.624672 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:28.625513 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:28.625497 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:19:30.846774 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:30.846744 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:30.947214 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:30.947177 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:31.257661 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:31.257632 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:31.354604 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:31.354564 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:34.263417 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:34.263388 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:34.324323 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:34.324294 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:40.459707 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:40.459675 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:40.570692 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:40.570661 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:40.671786 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:40.671749 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:41.342013 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:41.341982 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:41.401304 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:41.401274 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:54.974106 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:54.974073 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:55.073918 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:19:55.073885 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:00.419778 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:00.419737 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:00.506110 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:00.506079 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:00.938258 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:00.938222 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:13.995969 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:13.995888 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:14.291087 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:14.290997 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:21.070503 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:21.070467 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:21.155306 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:21.155278 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:21.219695 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:21.219662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:21.881239 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:21.881204 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:24.919346 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:24.919313 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:25.059575 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:25.059538 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:27.011452 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:27.011414 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:39.796205 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:39.796166 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:56.078308 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:56.078271 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:56.176727 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:56.176692 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:56.803991 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:56.803954 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:56.907473 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:56.907437 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:57.407630 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:57.407599 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:57.558657 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:20:57.558623 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:21:05.052042 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:05.052001 2554 generic.go:356] "Generic (PLEG): container finished" podID="768f20d8-98e0-472b-b26e-ce5fc2921eec" containerID="4dfec0585ca98e42e33ac4b6a83d65f777b33436adace90c7b8674bba05c13a9" exitCode=0 Jul 29 15:21:05.052042 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:05.052041 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" event={"ID":"768f20d8-98e0-472b-b26e-ce5fc2921eec","Type":"ContainerDied","Data":"4dfec0585ca98e42e33ac4b6a83d65f777b33436adace90c7b8674bba05c13a9"} Jul 29 15:21:05.052618 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:05.052425 2554 scope.go:117] "RemoveContainer" containerID="4dfec0585ca98e42e33ac4b6a83d65f777b33436adace90c7b8674bba05c13a9" Jul 29 15:21:05.053589 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:05.053549 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:21:05.053708 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:05.053642 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:21:05.053708 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:05.053690 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:21:06.058631 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:06.058598 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" event={"ID":"768f20d8-98e0-472b-b26e-ce5fc2921eec","Type":"ContainerStarted","Data":"fa7afb4cd567d3e26a0a38fbf440e5f832df1d0b3ef4cdf34bb3e01e94575814"} Jul 29 15:21:06.203247 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:06.203196 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:21:06.203761 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:06.203726 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-5dpfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 29 15:21:06.203881 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:06.203798 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" podUID="768f20d8-98e0-472b-b26e-ce5fc2921eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 29 15:21:07.015088 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:07.015046 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:21:07.203463 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:07.203415 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-5dpfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 29 15:21:07.203963 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:07.203487 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" podUID="768f20d8-98e0-472b-b26e-ce5fc2921eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 29 15:21:07.222334 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:07.222293 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:21:07.530302 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:07.530265 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:21:08.203497 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:08.203455 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-5dpfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 29 15:21:08.204009 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:08.203543 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" podUID="768f20d8-98e0-472b-b26e-ce5fc2921eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 29 15:21:09.203549 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:09.203482 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-5dpfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 29 15:21:09.204053 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:09.203583 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" podUID="768f20d8-98e0-472b-b26e-ce5fc2921eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 29 15:21:10.207088 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:10.207054 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:21:10.207537 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:10.207345 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:21:10.208012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:10.207993 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5dpfv" Jul 29 15:21:16.458709 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:16.458676 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:21:16.791878 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:16.791796 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:21:25.819974 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:25.819937 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:21:29.199066 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:29.199031 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:21:35.901084 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.901009 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t"] Jul 29 15:21:35.904383 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.904366 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:35.908109 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.908083 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 29 15:21:35.908109 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.908083 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lc787\"" Jul 29 15:21:35.908298 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.908083 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 29 15:21:35.908298 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.908125 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 29 15:21:35.921596 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.921571 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t"] Jul 29 15:21:35.945803 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.945776 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:21:35.966925 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.966896 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39d33fee-6120-466f-b979-503e70870406-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:35.967051 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.966939 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39d33fee-6120-466f-b979-503e70870406-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:35.967051 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.967020 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft6t4\" (UniqueName: \"kubernetes.io/projected/39d33fee-6120-466f-b979-503e70870406-kube-api-access-ft6t4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:35.967121 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.967062 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39d33fee-6120-466f-b979-503e70870406-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:35.967121 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.967082 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39d33fee-6120-466f-b979-503e70870406-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:35.967185 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:35.967140 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39d33fee-6120-466f-b979-503e70870406-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.068241 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.068205 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39d33fee-6120-466f-b979-503e70870406-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.068481 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.068251 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39d33fee-6120-466f-b979-503e70870406-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.068481 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.068285 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39d33fee-6120-466f-b979-503e70870406-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.068481 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.068327 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft6t4\" (UniqueName: \"kubernetes.io/projected/39d33fee-6120-466f-b979-503e70870406-kube-api-access-ft6t4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.068481 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.068347 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39d33fee-6120-466f-b979-503e70870406-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.068481 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.068365 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39d33fee-6120-466f-b979-503e70870406-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.068783 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.068669 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39d33fee-6120-466f-b979-503e70870406-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.068783 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.068715 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39d33fee-6120-466f-b979-503e70870406-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.068864 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.068805 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39d33fee-6120-466f-b979-503e70870406-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.070696 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.070665 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39d33fee-6120-466f-b979-503e70870406-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.070941 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.070924 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39d33fee-6120-466f-b979-503e70870406-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.079006 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.078986 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft6t4\" (UniqueName: \"kubernetes.io/projected/39d33fee-6120-466f-b979-503e70870406-kube-api-access-ft6t4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mc2t\" (UID: \"39d33fee-6120-466f-b979-503e70870406\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.214389 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.214359 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:36.349703 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.349673 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t"] Jul 29 15:21:36.350826 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:21:36.350803 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d33fee_6120_466f_b979_503e70870406.slice/crio-75092b07946a86e10764b8261f2c08b9c99f1ea98a7376ef58b86f2eef5e9f6f WatchSource:0}: Error finding container 75092b07946a86e10764b8261f2c08b9c99f1ea98a7376ef58b86f2eef5e9f6f: Status 404 returned error can't find the container with id 75092b07946a86e10764b8261f2c08b9c99f1ea98a7376ef58b86f2eef5e9f6f Jul 29 15:21:36.352245 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:36.352228 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:21:37.207336 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:37.207289 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" event={"ID":"39d33fee-6120-466f-b979-503e70870406","Type":"ContainerStarted","Data":"75092b07946a86e10764b8261f2c08b9c99f1ea98a7376ef58b86f2eef5e9f6f"} Jul 29 15:21:38.213026 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:38.212988 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" event={"ID":"39d33fee-6120-466f-b979-503e70870406","Type":"ContainerStarted","Data":"7c9dd711f11fdfe79126be9ec227bf5fc6c28ad419a9441f4f6832d7dd91b78f"} Jul 29 15:21:38.242217 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:38.242161 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" podStartSLOduration=2.206713178 podStartE2EDuration="3.242145821s" totalImagesPullingTime="1.035432643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:21:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:21:38.239863942 +0000 UTC m=+626.226205587" watchObservedRunningTime="2026-07-29 15:21:38.242145821 +0000 UTC m=+626.228487404" Jul 29 15:21:45.527090 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:45.527045 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:21:46.215370 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:46.215330 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:46.215599 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:46.215402 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:46.228154 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:46.228124 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:21:46.262232 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:21:46.262193 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mc2t" Jul 29 15:22:02.519383 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:02.519346 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:22:06.944360 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:06.944321 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:22:12.893602 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:12.893574 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr"] Jul 29 15:22:12.895953 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:12.895936 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:12.898713 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:12.898691 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 29 15:22:12.905795 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:12.905766 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28td2\" (UniqueName: \"kubernetes.io/projected/2c002828-7b3b-43b9-a02e-2ab8945b2443-kube-api-access-28td2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:12.905937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:12.905816 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c002828-7b3b-43b9-a02e-2ab8945b2443-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:12.905937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:12.905842 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c002828-7b3b-43b9-a02e-2ab8945b2443-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:12.905937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:12.905903 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c002828-7b3b-43b9-a02e-2ab8945b2443-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:12.906112 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:12.905995 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c002828-7b3b-43b9-a02e-2ab8945b2443-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:12.906112 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:12.906031 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c002828-7b3b-43b9-a02e-2ab8945b2443-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:12.906552 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:12.906514 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr"] Jul 29 15:22:13.006972 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.006937 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c002828-7b3b-43b9-a02e-2ab8945b2443-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.007166 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.006990 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c002828-7b3b-43b9-a02e-2ab8945b2443-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.007166 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.007017 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c002828-7b3b-43b9-a02e-2ab8945b2443-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.007166 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.007064 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28td2\" (UniqueName: \"kubernetes.io/projected/2c002828-7b3b-43b9-a02e-2ab8945b2443-kube-api-access-28td2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.007166 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.007084 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c002828-7b3b-43b9-a02e-2ab8945b2443-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.007166 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.007104 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c002828-7b3b-43b9-a02e-2ab8945b2443-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.007576 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.007551 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c002828-7b3b-43b9-a02e-2ab8945b2443-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.007665 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.007568 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c002828-7b3b-43b9-a02e-2ab8945b2443-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.007665 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.007603 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c002828-7b3b-43b9-a02e-2ab8945b2443-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.009373 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.009351 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c002828-7b3b-43b9-a02e-2ab8945b2443-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.009585 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.009571 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c002828-7b3b-43b9-a02e-2ab8945b2443-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.019364 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.019338 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28td2\" (UniqueName: \"kubernetes.io/projected/2c002828-7b3b-43b9-a02e-2ab8945b2443-kube-api-access-28td2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rm2lr\" (UID: \"2c002828-7b3b-43b9-a02e-2ab8945b2443\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.166910 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.166792 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:22:13.206967 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.206930 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:13.343850 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.343760 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr"] Jul 29 15:22:13.346470 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:22:13.346447 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c002828_7b3b_43b9_a02e_2ab8945b2443.slice/crio-ff823a7af14ed9bda313b539c895e6f58aff03042c5d52db483916192f39a1e5 WatchSource:0}: Error finding container ff823a7af14ed9bda313b539c895e6f58aff03042c5d52db483916192f39a1e5: Status 404 returned error can't find the container with id ff823a7af14ed9bda313b539c895e6f58aff03042c5d52db483916192f39a1e5 Jul 29 15:22:13.376601 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:13.376566 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" event={"ID":"2c002828-7b3b-43b9-a02e-2ab8945b2443","Type":"ContainerStarted","Data":"ff823a7af14ed9bda313b539c895e6f58aff03042c5d52db483916192f39a1e5"} Jul 29 15:22:14.383678 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:14.383643 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" event={"ID":"2c002828-7b3b-43b9-a02e-2ab8945b2443","Type":"ContainerStarted","Data":"37de480739577ae3f9181b37069319e326f2b15f5941b075196a22cd2fdefc39"} Jul 29 15:22:14.402555 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:14.402486 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" podStartSLOduration=2.097004778 podStartE2EDuration="2.402469037s" totalImagesPullingTime="305.464259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:22:14.401975502 +0000 UTC m=+662.388317083" watchObservedRunningTime="2026-07-29 15:22:14.402469037 +0000 UTC m=+662.388810670" Jul 29 15:22:23.208114 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:23.208065 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:23.208705 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:23.208168 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:23.221013 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:23.220984 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:23.441444 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:23.441415 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rm2lr" Jul 29 15:22:23.533356 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:23.533279 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:22:55.407084 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:55.407046 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:22:55.507682 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:22:55.507644 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:24:23.615642 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:24:23.615605 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:24:23.714300 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:24:23.714263 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:24:24.945267 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:24:24.945230 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:24:25.088587 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:24:25.088552 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:26:31.024596 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:26:31.024562 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:26:32.231368 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:26:32.231327 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:27:13.673921 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:27:13.673888 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:27:15.070878 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:27:15.070838 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:27:50.601351 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:27:50.601310 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:27:50.697107 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:27:50.697070 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:27:50.876909 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:27:50.876818 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:27:57.240498 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:27:57.240464 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:27:57.345779 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:27:57.345738 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:27:57.441280 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:27:57.441245 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:27:57.683843 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:27:57.683805 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:28:04.000105 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:28:04.000068 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:28:04.662647 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:28:04.662611 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:29:05.532846 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:29:05.532760 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:29:28.150490 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:29:28.150455 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:29:28.248875 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:29:28.248838 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:29:30.953083 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:29:30.953043 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:30:00.156680 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:00.156647 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755650-8j95s"] Jul 29 15:30:00.161376 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:00.161357 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755650-8j95s" Jul 29 15:30:00.164245 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:00.164223 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cgrq5\"" Jul 29 15:30:00.170739 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:00.170722 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755650-8j95s" Jul 29 15:30:00.178048 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:00.177517 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755650-8j95s"] Jul 29 15:30:00.306233 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:00.306209 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755650-8j95s"] Jul 29 15:30:00.308548 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:30:00.308496 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018077d2_91fb_461e_b2fd_35fd91481533.slice/crio-269ae504b9d7a0b94f0162642746670febc8212f600617467e6592e0f8f67acd WatchSource:0}: Error finding container 269ae504b9d7a0b94f0162642746670febc8212f600617467e6592e0f8f67acd: Status 404 returned error can't find the container with id 269ae504b9d7a0b94f0162642746670febc8212f600617467e6592e0f8f67acd Jul 29 15:30:00.310255 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:00.310237 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:30:00.540628 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:00.540599 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755650-8j95s" event={"ID":"018077d2-91fb-461e-b2fd-35fd91481533","Type":"ContainerStarted","Data":"269ae504b9d7a0b94f0162642746670febc8212f600617467e6592e0f8f67acd"} Jul 29 15:30:03.555880 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:03.555846 2554 generic.go:356] "Generic (PLEG): container finished" podID="018077d2-91fb-461e-b2fd-35fd91481533" containerID="78487896f5c99922837982ebd03524b41fd8e88b4ec74d72d0d8a72b60da3751" exitCode=0 Jul 29 15:30:03.556285 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:03.555942 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755650-8j95s" event={"ID":"018077d2-91fb-461e-b2fd-35fd91481533","Type":"ContainerDied","Data":"78487896f5c99922837982ebd03524b41fd8e88b4ec74d72d0d8a72b60da3751"} Jul 29 15:30:04.708379 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:04.708354 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755650-8j95s" Jul 29 15:30:05.565785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:05.565749 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755650-8j95s" event={"ID":"018077d2-91fb-461e-b2fd-35fd91481533","Type":"ContainerDied","Data":"269ae504b9d7a0b94f0162642746670febc8212f600617467e6592e0f8f67acd"} Jul 29 15:30:05.565785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:05.565777 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755650-8j95s" Jul 29 15:30:05.566000 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:30:05.565801 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="269ae504b9d7a0b94f0162642746670febc8212f600617467e6592e0f8f67acd" Jul 29 15:31:04.997570 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:31:04.997517 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:31:05.082710 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:31:05.082672 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:34:32.303827 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:34:32.303786 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:34:34.995011 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:34:34.994972 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:35:36.010080 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:35:36.010031 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:36:23.854996 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:36:23.854947 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:36:36.320093 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:36:36.320006 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:38:20.869148 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:38:20.869074 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:38:39.124390 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:38:39.124357 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:39:06.100478 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:39:06.100449 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:39:07.718396 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:39:07.718352 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:42:36.079475 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:42:36.079383 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:42:37.480857 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:42:37.480810 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:42:55.135480 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:42:55.135447 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:02.935973 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:02.935928 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:39.333418 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:39.333382 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:42.737479 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:42.737442 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:42.840832 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:42.840799 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:43.263668 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:43.263633 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:49.756788 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:49.756748 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:49.851740 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:49.851704 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:50.025346 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.025258 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:50.350187 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.350102 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j"] Jul 29 15:43:50.350566 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.350548 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="018077d2-91fb-461e-b2fd-35fd91481533" containerName="cleanup" Jul 29 15:43:50.350675 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.350569 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="018077d2-91fb-461e-b2fd-35fd91481533" containerName="cleanup" Jul 29 15:43:50.350675 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.350656 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="018077d2-91fb-461e-b2fd-35fd91481533" containerName="cleanup" Jul 29 15:43:50.353457 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.353437 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.355860 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.355837 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-93e16c15-openshift-default-dockercfg-wdtvk\"" Jul 29 15:43:50.374628 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.374600 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j"] Jul 29 15:43:50.377360 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.377328 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:50.477572 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.477513 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-credential-socket\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.477572 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.477570 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-workload-certs\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.477777 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.477704 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847a393a-1090-45f7-9558-d50de8dba4cc-istio-token\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.477777 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.477737 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-istio-data\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.477847 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.477802 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-workload-socket\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.477847 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.477823 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-istio-envoy\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.477847 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.477842 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847a393a-1090-45f7-9558-d50de8dba4cc-istio-podinfo\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.477939 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.477886 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847a393a-1090-45f7-9558-d50de8dba4cc-istiod-ca-cert\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.477939 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.477915 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh54t\" (UniqueName: \"kubernetes.io/projected/847a393a-1090-45f7-9558-d50de8dba4cc-kube-api-access-xh54t\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.578380 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.578344 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847a393a-1090-45f7-9558-d50de8dba4cc-istio-token\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.578380 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.578385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-istio-data\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.578663 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.578426 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-workload-socket\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.578663 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.578449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-istio-envoy\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.578663 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.578470 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847a393a-1090-45f7-9558-d50de8dba4cc-istio-podinfo\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.578663 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.578503 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847a393a-1090-45f7-9558-d50de8dba4cc-istiod-ca-cert\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.578663 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.578568 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh54t\" (UniqueName: \"kubernetes.io/projected/847a393a-1090-45f7-9558-d50de8dba4cc-kube-api-access-xh54t\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.578663 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.578602 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-credential-socket\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.578663 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.578625 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-workload-certs\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.579013 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.578867 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-istio-data\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.579013 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.578915 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-workload-socket\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.579013 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.578977 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-workload-certs\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.579167 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.579139 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-credential-socket\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.579579 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.579550 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847a393a-1090-45f7-9558-d50de8dba4cc-istiod-ca-cert\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.580929 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.580901 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-istio-envoy\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.581046 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.581029 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847a393a-1090-45f7-9558-d50de8dba4cc-istio-podinfo\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.588052 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.588032 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847a393a-1090-45f7-9558-d50de8dba4cc-istio-token\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.588143 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.588062 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh54t\" (UniqueName: \"kubernetes.io/projected/847a393a-1090-45f7-9558-d50de8dba4cc-kube-api-access-xh54t\") pod \"e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.663809 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.663726 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:50.803612 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.803585 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j"] Jul 29 15:43:50.805844 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:43:50.805816 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847a393a_1090_45f7_9558_d50de8dba4cc.slice/crio-a0d6bf0c4a9ee62b4185e457f8bcae8ddefee360d3fa06233ff0e5eba0784edb WatchSource:0}: Error finding container a0d6bf0c4a9ee62b4185e457f8bcae8ddefee360d3fa06233ff0e5eba0784edb: Status 404 returned error can't find the container with id a0d6bf0c4a9ee62b4185e457f8bcae8ddefee360d3fa06233ff0e5eba0784edb Jul 29 15:43:50.807943 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.807906 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:43:50.808038 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.807973 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:43:50.808038 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:50.808003 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:43:51.143596 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:51.143558 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:51.395474 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:51.395383 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" event={"ID":"847a393a-1090-45f7-9558-d50de8dba4cc","Type":"ContainerStarted","Data":"4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48"} Jul 29 15:43:51.395474 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:51.395447 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" event={"ID":"847a393a-1090-45f7-9558-d50de8dba4cc","Type":"ContainerStarted","Data":"a0d6bf0c4a9ee62b4185e457f8bcae8ddefee360d3fa06233ff0e5eba0784edb"} Jul 29 15:43:51.418274 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:51.418223 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" podStartSLOduration=1.418208417 podStartE2EDuration="1.418208417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:43:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:43:51.415883483 +0000 UTC m=+1959.402225094" watchObservedRunningTime="2026-07-29 15:43:51.418208417 +0000 UTC m=+1959.404550000" Jul 29 15:43:51.664174 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:51.664086 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:51.668979 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:51.668953 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:52.399475 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:52.399442 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:52.400496 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:52.400477 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:43:52.878422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:52.878388 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:52.978339 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:52.978305 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:53.131565 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:53.131463 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:53.440589 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:53.440559 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:53.732321 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:53.732244 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:43:53.832234 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:43:53.832199 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:04.025385 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:04.025351 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:04.460511 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:04.460475 2554 generic.go:356] "Generic (PLEG): container finished" podID="847a393a-1090-45f7-9558-d50de8dba4cc" containerID="4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48" exitCode=0 Jul 29 15:44:04.460697 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:04.460549 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" event={"ID":"847a393a-1090-45f7-9558-d50de8dba4cc","Type":"ContainerDied","Data":"4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48"} Jul 29 15:44:04.460958 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:04.460944 2554 scope.go:117] "RemoveContainer" containerID="4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48" Jul 29 15:44:04.461997 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:04.461962 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:44:04.462128 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:04.462034 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:44:04.462128 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:04.462071 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:44:05.467707 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:05.467669 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" event={"ID":"847a393a-1090-45f7-9558-d50de8dba4cc","Type":"ContainerStarted","Data":"594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d"} Jul 29 15:44:05.664816 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:05.664770 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:44:05.665846 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:05.665819 2554 patch_prober.go:28] interesting pod/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 29 15:44:05.665962 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:05.665868 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 29 15:44:06.664874 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:06.664832 2554 patch_prober.go:28] interesting pod/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 29 15:44:06.665331 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:06.664896 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 29 15:44:07.399862 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:07.399816 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:44:07.664239 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:07.664148 2554 patch_prober.go:28] interesting pod/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 29 15:44:07.664239 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:07.664212 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 29 15:44:08.664330 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:08.664295 2554 patch_prober.go:28] interesting pod/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 29 15:44:08.664749 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:08.664349 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 29 15:44:09.664271 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:09.664233 2554 patch_prober.go:28] interesting pod/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 29 15:44:09.664493 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:09.664293 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 29 15:44:10.668450 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:10.668419 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:44:10.669651 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:10.669631 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:44:33.809142 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:33.809097 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:33.899171 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:33.899135 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:33.962605 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:33.962567 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:34.033902 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:34.033871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:34.204880 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:34.204850 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j"] Jul 29 15:44:34.205088 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:34.205063 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" containerName="istio-proxy" containerID="cri-o://594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d" gracePeriod=30 Jul 29 15:44:34.236081 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:34.236050 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:34.518560 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:34.518456 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:34.822318 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:34.822208 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:34.939714 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:34.939686 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:35.140373 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.140287 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:35.486248 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.486221 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb"] Jul 29 15:44:35.489498 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.489474 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.492387 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.492354 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-adc0e91c-gw-openshift-default-dockercfg-rgqxq\"" Jul 29 15:44:35.504220 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.504198 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb"] Jul 29 15:44:35.556140 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.556102 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:35.602188 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.602151 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-workload-certs\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.602469 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.602435 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-envoy\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.602636 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.602487 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-podinfo\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.602636 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.602570 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-data\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.602636 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.602593 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-workload-socket\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.602636 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.602617 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-credential-socket\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.602874 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.602701 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b9j5\" (UniqueName: \"kubernetes.io/projected/b9739b57-1bd8-421e-b13b-91a625a73d64-kube-api-access-7b9j5\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.602874 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.602750 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-token\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.602874 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.602793 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9739b57-1bd8-421e-b13b-91a625a73d64-istiod-ca-cert\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.703374 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.703335 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-workload-certs\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.703579 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.703387 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-envoy\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.703579 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.703431 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-podinfo\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.703579 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.703461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-data\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.703579 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.703489 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-workload-socket\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.703579 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.703513 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-credential-socket\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.703579 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.703567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b9j5\" (UniqueName: \"kubernetes.io/projected/b9739b57-1bd8-421e-b13b-91a625a73d64-kube-api-access-7b9j5\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.703887 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.703604 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-token\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.703887 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.703638 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9739b57-1bd8-421e-b13b-91a625a73d64-istiod-ca-cert\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.703887 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.703865 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-workload-certs\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.704023 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.703978 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-credential-socket\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.704207 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.704187 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-workload-socket\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.704404 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.704384 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9739b57-1bd8-421e-b13b-91a625a73d64-istiod-ca-cert\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.704441 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.704410 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-data\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.705771 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.705743 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-envoy\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.706065 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.706048 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-podinfo\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.715448 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.715424 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-token\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.715740 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.715718 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b9j5\" (UniqueName: \"kubernetes.io/projected/b9739b57-1bd8-421e-b13b-91a625a73d64-kube-api-access-7b9j5\") pod \"e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.800782 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.800694 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:35.946062 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.945974 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb"] Jul 29 15:44:35.949739 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:44:35.949707 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9739b57_1bd8_421e_b13b_91a625a73d64.slice/crio-09cb34c4a4502a2fda1636084c5156ee3d042caac3479bf27e5ae7898ff31966 WatchSource:0}: Error finding container 09cb34c4a4502a2fda1636084c5156ee3d042caac3479bf27e5ae7898ff31966: Status 404 returned error can't find the container with id 09cb34c4a4502a2fda1636084c5156ee3d042caac3479bf27e5ae7898ff31966 Jul 29 15:44:35.952026 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.951993 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:44:35.952091 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.952059 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:44:35.952091 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.952087 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:44:35.964564 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:35.964506 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:36.619273 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:36.619230 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" event={"ID":"b9739b57-1bd8-421e-b13b-91a625a73d64","Type":"ContainerStarted","Data":"5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24"} Jul 29 15:44:36.619438 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:36.619292 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" event={"ID":"b9739b57-1bd8-421e-b13b-91a625a73d64","Type":"ContainerStarted","Data":"09cb34c4a4502a2fda1636084c5156ee3d042caac3479bf27e5ae7898ff31966"} Jul 29 15:44:36.643752 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:36.643705 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" podStartSLOduration=1.643687907 podStartE2EDuration="1.643687907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:44:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:44:36.641686332 +0000 UTC m=+2004.628027918" watchObservedRunningTime="2026-07-29 15:44:36.643687907 +0000 UTC m=+2004.630029491" Jul 29 15:44:36.801733 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:36.801701 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:37.806309 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:37.806275 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:38.195513 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:38.195479 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:38.334071 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:38.334014 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:38.453572 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:38.453458 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:38.628454 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:38.628427 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:38.629481 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:38.629462 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:38.960583 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:38.960546 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:39.058854 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.058818 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:44:39.457218 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.457193 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:44:39.634673 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.634581 2554 generic.go:356] "Generic (PLEG): container finished" podID="847a393a-1090-45f7-9558-d50de8dba4cc" containerID="594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d" exitCode=0 Jul 29 15:44:39.634673 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.634627 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" Jul 29 15:44:39.634673 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.634659 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" event={"ID":"847a393a-1090-45f7-9558-d50de8dba4cc","Type":"ContainerDied","Data":"594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d"} Jul 29 15:44:39.634947 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.634704 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j" event={"ID":"847a393a-1090-45f7-9558-d50de8dba4cc","Type":"ContainerDied","Data":"a0d6bf0c4a9ee62b4185e457f8bcae8ddefee360d3fa06233ff0e5eba0784edb"} Jul 29 15:44:39.634947 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.634728 2554 scope.go:117] "RemoveContainer" containerID="594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d" Jul 29 15:44:39.639037 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.639021 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh54t\" (UniqueName: \"kubernetes.io/projected/847a393a-1090-45f7-9558-d50de8dba4cc-kube-api-access-xh54t\") pod \"847a393a-1090-45f7-9558-d50de8dba4cc\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " Jul 29 15:44:39.639134 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.639082 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-workload-socket\") pod \"847a393a-1090-45f7-9558-d50de8dba4cc\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " Jul 29 15:44:39.639134 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.639103 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847a393a-1090-45f7-9558-d50de8dba4cc-istiod-ca-cert\") pod \"847a393a-1090-45f7-9558-d50de8dba4cc\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " Jul 29 15:44:39.639134 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.639123 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-istio-data\") pod \"847a393a-1090-45f7-9558-d50de8dba4cc\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " Jul 29 15:44:39.639279 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.639148 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847a393a-1090-45f7-9558-d50de8dba4cc-istio-token\") pod \"847a393a-1090-45f7-9558-d50de8dba4cc\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " Jul 29 15:44:39.639279 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.639183 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-istio-envoy\") pod \"847a393a-1090-45f7-9558-d50de8dba4cc\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " Jul 29 15:44:39.639381 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.639304 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "847a393a-1090-45f7-9558-d50de8dba4cc" (UID: "847a393a-1090-45f7-9558-d50de8dba4cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:44:39.639381 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.639320 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-credential-socket\") pod \"847a393a-1090-45f7-9558-d50de8dba4cc\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " Jul 29 15:44:39.639483 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.639422 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847a393a-1090-45f7-9558-d50de8dba4cc-istio-podinfo\") pod \"847a393a-1090-45f7-9558-d50de8dba4cc\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " Jul 29 15:44:39.639557 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.639502 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-workload-certs\") pod \"847a393a-1090-45f7-9558-d50de8dba4cc\" (UID: \"847a393a-1090-45f7-9558-d50de8dba4cc\") " Jul 29 15:44:39.639761 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.639692 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "847a393a-1090-45f7-9558-d50de8dba4cc" (UID: "847a393a-1090-45f7-9558-d50de8dba4cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:44:39.639978 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.639910 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "847a393a-1090-45f7-9558-d50de8dba4cc" (UID: "847a393a-1090-45f7-9558-d50de8dba4cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:44:39.640065 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.640027 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:44:39.640065 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.640048 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:44:39.640065 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.640061 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:44:39.640278 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.640252 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "847a393a-1090-45f7-9558-d50de8dba4cc" (UID: "847a393a-1090-45f7-9558-d50de8dba4cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:44:39.640438 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.640415 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/847a393a-1090-45f7-9558-d50de8dba4cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "847a393a-1090-45f7-9558-d50de8dba4cc" (UID: "847a393a-1090-45f7-9558-d50de8dba4cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:44:39.641436 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.641413 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847a393a-1090-45f7-9558-d50de8dba4cc-kube-api-access-xh54t" (OuterVolumeSpecName: "kube-api-access-xh54t") pod "847a393a-1090-45f7-9558-d50de8dba4cc" (UID: "847a393a-1090-45f7-9558-d50de8dba4cc"). InnerVolumeSpecName "kube-api-access-xh54t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:44:39.641603 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.641448 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "847a393a-1090-45f7-9558-d50de8dba4cc" (UID: "847a393a-1090-45f7-9558-d50de8dba4cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:44:39.641816 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.641798 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847a393a-1090-45f7-9558-d50de8dba4cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "847a393a-1090-45f7-9558-d50de8dba4cc" (UID: "847a393a-1090-45f7-9558-d50de8dba4cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:44:39.641975 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.641951 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/847a393a-1090-45f7-9558-d50de8dba4cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "847a393a-1090-45f7-9558-d50de8dba4cc" (UID: "847a393a-1090-45f7-9558-d50de8dba4cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 15:44:39.644323 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.644307 2554 scope.go:117] "RemoveContainer" containerID="4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48" Jul 29 15:44:39.658656 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.658622 2554 scope.go:117] "RemoveContainer" containerID="594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d" Jul 29 15:44:39.658893 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:44:39.658871 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d\": container with ID starting with 594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d not found: ID does not exist" containerID="594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d" Jul 29 15:44:39.658976 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.658898 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d"} err="failed to get container status \"594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d\": rpc error: code = NotFound desc = could not find container \"594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d\": container with ID starting with 594ed61670d7bf5da1728c47883954fe43c08374ce7cdd83f6e96aec1a8e6a7d not found: ID does not exist" Jul 29 15:44:39.658976 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.658917 2554 scope.go:117] "RemoveContainer" containerID="4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48" Jul 29 15:44:39.659164 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:44:39.659146 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48\": container with ID starting with 4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48 not found: ID does not exist" containerID="4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48" Jul 29 15:44:39.659209 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.659170 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48"} err="failed to get container status \"4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48\": rpc error: code = NotFound desc = could not find container \"4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48\": container with ID starting with 4801e02d3ab6abba90befd22e768053858566ad9ad672e6a73a0e10d39851b48 not found: ID does not exist" Jul 29 15:44:39.741096 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.741053 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh54t\" (UniqueName: \"kubernetes.io/projected/847a393a-1090-45f7-9558-d50de8dba4cc-kube-api-access-xh54t\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:44:39.741096 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.741092 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847a393a-1090-45f7-9558-d50de8dba4cc-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:44:39.741338 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.741106 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:44:39.741338 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.741121 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847a393a-1090-45f7-9558-d50de8dba4cc-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:44:39.741338 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.741134 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847a393a-1090-45f7-9558-d50de8dba4cc-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:44:39.741338 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.741146 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847a393a-1090-45f7-9558-d50de8dba4cc-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:44:39.957209 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.957178 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j"] Jul 29 15:44:39.961651 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:39.961627 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-93e16c15-openshift-default-56d8f6f78-pnx9j"] Jul 29 15:44:40.590450 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:40.590417 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" path="/var/lib/kubelet/pods/847a393a-1090-45f7-9558-d50de8dba4cc/volumes" Jul 29 15:44:52.696469 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:52.696436 2554 generic.go:356] "Generic (PLEG): container finished" podID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerID="5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24" exitCode=0 Jul 29 15:44:52.696897 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:52.696540 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" event={"ID":"b9739b57-1bd8-421e-b13b-91a625a73d64","Type":"ContainerDied","Data":"5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24"} Jul 29 15:44:52.696940 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:52.696927 2554 scope.go:117] "RemoveContainer" containerID="5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24" Jul 29 15:44:52.697961 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:52.697930 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:44:52.698073 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:52.698035 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:44:52.698140 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:52.698086 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:44:53.628494 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:53.628458 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:53.712326 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:53.712262 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" event={"ID":"b9739b57-1bd8-421e-b13b-91a625a73d64","Type":"ContainerStarted","Data":"0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246"} Jul 29 15:44:53.801735 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:53.801701 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:53.802932 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:53.802893 2554 patch_prober.go:28] interesting pod/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 29 15:44:53.803075 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:53.802970 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 29 15:44:54.802003 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:54.801953 2554 patch_prober.go:28] interesting pod/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 29 15:44:54.802502 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:54.802032 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 29 15:44:55.801844 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:55.801799 2554 patch_prober.go:28] interesting pod/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 29 15:44:55.802064 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:55.801865 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 29 15:44:56.802368 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:56.802320 2554 patch_prober.go:28] interesting pod/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 29 15:44:56.802894 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:56.802395 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 29 15:44:57.805215 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:57.805185 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:57.805624 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:57.805556 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:44:57.806204 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:44:57.806187 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:45:09.728687 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:09.728656 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:09.801049 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:09.801014 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:09.870378 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:09.870322 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:09.931215 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:09.931178 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:10.100722 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:10.100640 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb"] Jul 29 15:45:10.100876 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:10.100846 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerName="istio-proxy" containerID="cri-o://0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246" gracePeriod=30 Jul 29 15:45:10.116944 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:10.116916 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:10.401948 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:10.401856 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:10.692495 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:10.692459 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:11.029685 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.029610 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm"] Jul 29 15:45:11.030035 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.029983 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" containerName="istio-proxy" Jul 29 15:45:11.030035 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.029994 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" containerName="istio-proxy" Jul 29 15:45:11.030035 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.030003 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" containerName="istio-proxy" Jul 29 15:45:11.030035 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.030008 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" containerName="istio-proxy" Jul 29 15:45:11.030160 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.030083 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" containerName="istio-proxy" Jul 29 15:45:11.032116 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.032101 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.034828 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.034803 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-16426b01-openshift-default-dockercfg-447wz\"" Jul 29 15:45:11.046363 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.046282 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm"] Jul 29 15:45:11.055116 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.055094 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:11.143571 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.143512 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-workload-certs\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.143780 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.143582 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-workload-socket\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.143780 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.143613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-token\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.143780 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.143635 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-envoy\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.143780 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.143720 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-podinfo\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.143991 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.143797 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-data\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.143991 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.143826 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76638789-63b5-412d-a1e6-9aa76177ef6e-istiod-ca-cert\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.143991 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.143898 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-credential-socket\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.143991 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.143921 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n5jh\" (UniqueName: \"kubernetes.io/projected/76638789-63b5-412d-a1e6-9aa76177ef6e-kube-api-access-8n5jh\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.245072 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.245036 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-podinfo\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.245272 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.245091 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-data\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.245272 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.245113 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76638789-63b5-412d-a1e6-9aa76177ef6e-istiod-ca-cert\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.245272 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.245162 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-credential-socket\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.245444 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.245314 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n5jh\" (UniqueName: \"kubernetes.io/projected/76638789-63b5-412d-a1e6-9aa76177ef6e-kube-api-access-8n5jh\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.245444 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.245404 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-workload-certs\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.245444 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.245435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-workload-socket\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.245636 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.245463 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-token\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.245636 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.245488 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-envoy\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.245636 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.245572 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-credential-socket\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.245636 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.245582 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-data\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.245833 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.245820 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-workload-socket\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.246034 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.246004 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-workload-certs\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.246230 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.246210 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76638789-63b5-412d-a1e6-9aa76177ef6e-istiod-ca-cert\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.247758 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.247733 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-envoy\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.247909 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.247885 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-podinfo\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.256765 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.256742 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-token\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.256919 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.256899 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n5jh\" (UniqueName: \"kubernetes.io/projected/76638789-63b5-412d-a1e6-9aa76177ef6e-kube-api-access-8n5jh\") pod \"e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.274730 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.274695 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:11.353510 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.353419 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:11.490929 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.490896 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm"] Jul 29 15:45:11.494141 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:45:11.494111 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76638789_63b5_412d_a1e6_9aa76177ef6e.slice/crio-6bcee14e6a89dd1daff14989454e06256aba8659551a7a6af74b9da32dbcd8a2 WatchSource:0}: Error finding container 6bcee14e6a89dd1daff14989454e06256aba8659551a7a6af74b9da32dbcd8a2: Status 404 returned error can't find the container with id 6bcee14e6a89dd1daff14989454e06256aba8659551a7a6af74b9da32dbcd8a2 Jul 29 15:45:11.496178 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.496140 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:45:11.496261 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.496210 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:45:11.496261 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.496247 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:45:11.805798 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.805750 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" event={"ID":"76638789-63b5-412d-a1e6-9aa76177ef6e","Type":"ContainerStarted","Data":"23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715"} Jul 29 15:45:11.805989 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.805816 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" event={"ID":"76638789-63b5-412d-a1e6-9aa76177ef6e","Type":"ContainerStarted","Data":"6bcee14e6a89dd1daff14989454e06256aba8659551a7a6af74b9da32dbcd8a2"} Jul 29 15:45:11.826903 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:11.826845 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" podStartSLOduration=0.826826482 podStartE2EDuration="826.826482ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:45:11.825103748 +0000 UTC m=+2039.811445343" watchObservedRunningTime="2026-07-29 15:45:11.826826482 +0000 UTC m=+2039.813168065" Jul 29 15:45:12.353715 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:12.353676 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:12.358935 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:12.358912 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:12.808148 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:12.808117 2554 patch_prober.go:28] interesting pod/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 29 15:45:12.808293 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:12.808176 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 15:45:12.810502 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:12.810483 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:12.811354 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:12.811337 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:13.211426 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:13.211392 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:13.312697 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:13.312653 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:13.444298 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:13.444258 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:13.940664 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:13.940630 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:14.038657 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:14.038599 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:14.133654 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:14.133622 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:15.348880 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.348853 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:45:15.488866 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.488829 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9739b57-1bd8-421e-b13b-91a625a73d64-istiod-ca-cert\") pod \"b9739b57-1bd8-421e-b13b-91a625a73d64\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " Jul 29 15:45:15.489099 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.488886 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-data\") pod \"b9739b57-1bd8-421e-b13b-91a625a73d64\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " Jul 29 15:45:15.489099 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.488934 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-workload-socket\") pod \"b9739b57-1bd8-421e-b13b-91a625a73d64\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " Jul 29 15:45:15.489099 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.488985 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-envoy\") pod \"b9739b57-1bd8-421e-b13b-91a625a73d64\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " Jul 29 15:45:15.489099 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.489018 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-workload-certs\") pod \"b9739b57-1bd8-421e-b13b-91a625a73d64\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " Jul 29 15:45:15.489099 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.489047 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-podinfo\") pod \"b9739b57-1bd8-421e-b13b-91a625a73d64\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " Jul 29 15:45:15.489099 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.489072 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b9j5\" (UniqueName: \"kubernetes.io/projected/b9739b57-1bd8-421e-b13b-91a625a73d64-kube-api-access-7b9j5\") pod \"b9739b57-1bd8-421e-b13b-91a625a73d64\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " Jul 29 15:45:15.489949 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.489106 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-credential-socket\") pod \"b9739b57-1bd8-421e-b13b-91a625a73d64\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " Jul 29 15:45:15.489949 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.489135 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-token\") pod \"b9739b57-1bd8-421e-b13b-91a625a73d64\" (UID: \"b9739b57-1bd8-421e-b13b-91a625a73d64\") " Jul 29 15:45:15.489949 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.489329 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9739b57-1bd8-421e-b13b-91a625a73d64-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9739b57-1bd8-421e-b13b-91a625a73d64" (UID: "b9739b57-1bd8-421e-b13b-91a625a73d64"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:45:15.489949 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.489606 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9739b57-1bd8-421e-b13b-91a625a73d64-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:15.489949 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.489617 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9739b57-1bd8-421e-b13b-91a625a73d64" (UID: "b9739b57-1bd8-421e-b13b-91a625a73d64"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:45:15.489949 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.489691 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9739b57-1bd8-421e-b13b-91a625a73d64" (UID: "b9739b57-1bd8-421e-b13b-91a625a73d64"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:45:15.489949 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.489777 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9739b57-1bd8-421e-b13b-91a625a73d64" (UID: "b9739b57-1bd8-421e-b13b-91a625a73d64"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:45:15.490333 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.490080 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9739b57-1bd8-421e-b13b-91a625a73d64" (UID: "b9739b57-1bd8-421e-b13b-91a625a73d64"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:45:15.491475 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.491437 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9739b57-1bd8-421e-b13b-91a625a73d64" (UID: "b9739b57-1bd8-421e-b13b-91a625a73d64"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 15:45:15.491633 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.491487 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9739b57-1bd8-421e-b13b-91a625a73d64" (UID: "b9739b57-1bd8-421e-b13b-91a625a73d64"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:45:15.491633 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.491544 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9739b57-1bd8-421e-b13b-91a625a73d64" (UID: "b9739b57-1bd8-421e-b13b-91a625a73d64"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:45:15.491711 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.491646 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9739b57-1bd8-421e-b13b-91a625a73d64-kube-api-access-7b9j5" (OuterVolumeSpecName: "kube-api-access-7b9j5") pod "b9739b57-1bd8-421e-b13b-91a625a73d64" (UID: "b9739b57-1bd8-421e-b13b-91a625a73d64"). InnerVolumeSpecName "kube-api-access-7b9j5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:45:15.590037 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.589999 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:15.590037 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.590034 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b9j5\" (UniqueName: \"kubernetes.io/projected/b9739b57-1bd8-421e-b13b-91a625a73d64-kube-api-access-7b9j5\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:15.590037 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.590045 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:15.590289 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.590054 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:15.590289 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.590063 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:15.590289 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.590073 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:15.590289 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.590080 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:15.590289 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.590089 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9739b57-1bd8-421e-b13b-91a625a73d64-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:15.827396 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.827303 2554 generic.go:356] "Generic (PLEG): container finished" podID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerID="0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246" exitCode=0 Jul 29 15:45:15.827396 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.827352 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" Jul 29 15:45:15.827396 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.827354 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" event={"ID":"b9739b57-1bd8-421e-b13b-91a625a73d64","Type":"ContainerDied","Data":"0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246"} Jul 29 15:45:15.827690 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.827406 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb" event={"ID":"b9739b57-1bd8-421e-b13b-91a625a73d64","Type":"ContainerDied","Data":"09cb34c4a4502a2fda1636084c5156ee3d042caac3479bf27e5ae7898ff31966"} Jul 29 15:45:15.827690 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.827437 2554 scope.go:117] "RemoveContainer" containerID="0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246" Jul 29 15:45:15.836494 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.836477 2554 scope.go:117] "RemoveContainer" containerID="5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24" Jul 29 15:45:15.843944 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.843926 2554 scope.go:117] "RemoveContainer" containerID="0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246" Jul 29 15:45:15.844192 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:45:15.844173 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246\": container with ID starting with 0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246 not found: ID does not exist" containerID="0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246" Jul 29 15:45:15.844235 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.844202 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246"} err="failed to get container status \"0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246\": rpc error: code = NotFound desc = could not find container \"0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246\": container with ID starting with 0d1adc6a76e66cc2085091d0bb822d0eb3a37d642aec7f5fc7687850aadd3246 not found: ID does not exist" Jul 29 15:45:15.844235 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.844220 2554 scope.go:117] "RemoveContainer" containerID="5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24" Jul 29 15:45:15.844463 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:45:15.844441 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24\": container with ID starting with 5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24 not found: ID does not exist" containerID="5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24" Jul 29 15:45:15.844578 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.844466 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24"} err="failed to get container status \"5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24\": rpc error: code = NotFound desc = could not find container \"5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24\": container with ID starting with 5f5ab3e0e486b8c8af0e9efb68306604ee15643c5fc076e14b23399e72b5cf24 not found: ID does not exist" Jul 29 15:45:15.850067 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.850047 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb"] Jul 29 15:45:15.854554 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:15.854516 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-adc0e91c-gw-openshift-default-85d4bb958d-d8gxb"] Jul 29 15:45:16.590072 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:16.590038 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" path="/var/lib/kubelet/pods/b9739b57-1bd8-421e-b13b-91a625a73d64/volumes" Jul 29 15:45:28.184832 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:28.184647 2554 patch_prober.go:28] interesting pod/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": read tcp 10.134.0.2:46130->10.134.0.32:15021: read: connection reset by peer" start-of-body= Jul 29 15:45:28.184832 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:28.184722 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": read tcp 10.134.0.2:46130->10.134.0.32:15021: read: connection reset by peer" Jul 29 15:45:28.885197 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:28.885161 2554 generic.go:356] "Generic (PLEG): container finished" podID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerID="23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715" exitCode=0 Jul 29 15:45:28.885363 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:28.885225 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" event={"ID":"76638789-63b5-412d-a1e6-9aa76177ef6e","Type":"ContainerDied","Data":"23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715"} Jul 29 15:45:28.885705 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:28.885689 2554 scope.go:117] "RemoveContainer" containerID="23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715" Jul 29 15:45:28.886820 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:28.886787 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:45:28.886909 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:28.886892 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:45:28.886956 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:28.886934 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:45:29.891476 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:29.891424 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" event={"ID":"76638789-63b5-412d-a1e6-9aa76177ef6e","Type":"ContainerStarted","Data":"2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb"} Jul 29 15:45:30.104311 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:30.104271 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:30.354169 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:30.354137 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:30.354397 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:30.354373 2554 patch_prober.go:28] interesting pod/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 29 15:45:30.354442 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:30.354426 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 29 15:45:31.354513 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:31.354479 2554 patch_prober.go:28] interesting pod/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 29 15:45:31.354941 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:31.354559 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 29 15:45:32.354169 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:32.354129 2554 patch_prober.go:28] interesting pod/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 29 15:45:32.354379 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:32.354193 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 29 15:45:33.354691 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:33.354652 2554 patch_prober.go:28] interesting pod/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 29 15:45:33.355082 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:33.354718 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 29 15:45:34.357999 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:34.357970 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:34.358471 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:34.358346 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:34.358940 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:34.358922 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:44.157209 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:44.157155 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:44.252097 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:44.252060 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:44.385396 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:44.385364 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:45.682330 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:45.682300 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm"] Jul 29 15:45:45.682835 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:45.682494 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" containerID="cri-o://2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb" gracePeriod=30 Jul 29 15:45:45.692884 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:45.692852 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:45.973572 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:45.973465 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:46.291841 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.291749 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:46.591061 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.590988 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp"] Jul 29 15:45:46.591328 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.591317 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerName="istio-proxy" Jul 29 15:45:46.591368 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.591330 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerName="istio-proxy" Jul 29 15:45:46.591368 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.591340 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerName="istio-proxy" Jul 29 15:45:46.591368 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.591346 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerName="istio-proxy" Jul 29 15:45:46.591457 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.591429 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerName="istio-proxy" Jul 29 15:45:46.591457 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.591437 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9739b57-1bd8-421e-b13b-91a625a73d64" containerName="istio-proxy" Jul 29 15:45:46.591457 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.591444 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="847a393a-1090-45f7-9558-d50de8dba4cc" containerName="istio-proxy" Jul 29 15:45:46.594172 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.594155 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.596898 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.596884 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1609e886-openshift-default-dockercfg-478m6\"" Jul 29 15:45:46.605943 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.605920 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp"] Jul 29 15:45:46.627750 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.627722 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:46.678765 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.678728 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skjqm\" (UniqueName: \"kubernetes.io/projected/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-kube-api-access-skjqm\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.679039 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.679018 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-workload-certs\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.679137 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.679062 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-envoy\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.679137 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.679118 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-data\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.679259 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.679155 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-token\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.679259 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.679219 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-workload-socket\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.679359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.679284 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-credential-socket\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.679421 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.679403 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-podinfo\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.679467 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.679440 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istiod-ca-cert\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.780712 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.780682 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-podinfo\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.780723 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istiod-ca-cert\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.780807 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skjqm\" (UniqueName: \"kubernetes.io/projected/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-kube-api-access-skjqm\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.780843 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-workload-certs\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.780879 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-envoy\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.780916 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-data\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.780949 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-token\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.780999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-workload-socket\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.781028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-credential-socket\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781603 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.781308 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-workload-certs\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781603 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.781391 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-workload-socket\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781603 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.781448 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-credential-socket\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781603 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.781481 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-data\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.781732 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.781618 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istiod-ca-cert\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.783142 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.783120 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-envoy\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.783548 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.783509 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-podinfo\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.790180 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.790154 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-token\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.790361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.790340 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skjqm\" (UniqueName: \"kubernetes.io/projected/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-kube-api-access-skjqm\") pod \"e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:46.821260 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.821227 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:46.905125 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:46.905046 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:47.042503 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:47.042472 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp"] Jul 29 15:45:47.045267 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:45:47.045240 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cec1ccb_c38b_4d5f_a325_eaaa8a53a1b8.slice/crio-ee63a21161ee4e9c2dd4f52b9493814d0cf712c87e950b79f0a219e3808cfdb9 WatchSource:0}: Error finding container ee63a21161ee4e9c2dd4f52b9493814d0cf712c87e950b79f0a219e3808cfdb9: Status 404 returned error can't find the container with id ee63a21161ee4e9c2dd4f52b9493814d0cf712c87e950b79f0a219e3808cfdb9 Jul 29 15:45:47.047596 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:47.047551 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:45:47.047691 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:47.047650 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:45:47.047751 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:47.047700 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:45:47.995416 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:47.995381 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" event={"ID":"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8","Type":"ContainerStarted","Data":"8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f"} Jul 29 15:45:47.995882 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:47.995455 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" event={"ID":"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8","Type":"ContainerStarted","Data":"ee63a21161ee4e9c2dd4f52b9493814d0cf712c87e950b79f0a219e3808cfdb9"} Jul 29 15:45:48.027148 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:48.027084 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" podStartSLOduration=2.027069949 podStartE2EDuration="2.027069949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:45:48.025666333 +0000 UTC m=+2076.012007915" watchObservedRunningTime="2026-07-29 15:45:48.027069949 +0000 UTC m=+2076.013411532" Jul 29 15:45:48.905800 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:48.905765 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:48.910380 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:48.910356 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:49.000017 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:48.999995 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:49.000783 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:49.000764 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:45:49.361080 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:49.361047 2554 patch_prober.go:28] interesting pod/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 29 15:45:49.361292 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:49.361102 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 15:45:49.434462 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:49.434426 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:49.530312 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:49.530283 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:49.629828 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:49.629731 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:49.787971 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:49.787940 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:50.240277 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:50.240240 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:50.341687 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:50.341653 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:45:50.937333 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:50.937310 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:51.010102 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.009988 2554 generic.go:356] "Generic (PLEG): container finished" podID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerID="2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb" exitCode=0 Jul 29 15:45:51.010102 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.010036 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" Jul 29 15:45:51.010102 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.010034 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" event={"ID":"76638789-63b5-412d-a1e6-9aa76177ef6e","Type":"ContainerDied","Data":"2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb"} Jul 29 15:45:51.010385 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.010117 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm" event={"ID":"76638789-63b5-412d-a1e6-9aa76177ef6e","Type":"ContainerDied","Data":"6bcee14e6a89dd1daff14989454e06256aba8659551a7a6af74b9da32dbcd8a2"} Jul 29 15:45:51.010385 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.010149 2554 scope.go:117] "RemoveContainer" containerID="2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb" Jul 29 15:45:51.019199 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.019148 2554 scope.go:117] "RemoveContainer" containerID="23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715" Jul 29 15:45:51.026896 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.026868 2554 scope.go:117] "RemoveContainer" containerID="2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb" Jul 29 15:45:51.027138 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:45:51.027118 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb\": container with ID starting with 2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb not found: ID does not exist" containerID="2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb" Jul 29 15:45:51.027204 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.027147 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb"} err="failed to get container status \"2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb\": rpc error: code = NotFound desc = could not find container \"2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb\": container with ID starting with 2aa0a73cc5062141bec0cb6c751dea739c0dc2246f9059381ee9b2b5cb67fadb not found: ID does not exist" Jul 29 15:45:51.027204 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.027166 2554 scope.go:117] "RemoveContainer" containerID="23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715" Jul 29 15:45:51.027403 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:45:51.027386 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715\": container with ID starting with 23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715 not found: ID does not exist" containerID="23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715" Jul 29 15:45:51.027442 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.027409 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715"} err="failed to get container status \"23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715\": rpc error: code = NotFound desc = could not find container \"23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715\": container with ID starting with 23e0c1b3aadaa4f1e371705e906f9c77082d29a5a91bf2467e2e376b73a4d715 not found: ID does not exist" Jul 29 15:45:51.120784 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.120754 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-token\") pod \"76638789-63b5-412d-a1e6-9aa76177ef6e\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " Jul 29 15:45:51.120784 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.120798 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-podinfo\") pod \"76638789-63b5-412d-a1e6-9aa76177ef6e\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " Jul 29 15:45:51.121044 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.120856 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-credential-socket\") pod \"76638789-63b5-412d-a1e6-9aa76177ef6e\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " Jul 29 15:45:51.121044 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.120903 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-workload-certs\") pod \"76638789-63b5-412d-a1e6-9aa76177ef6e\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " Jul 29 15:45:51.121044 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.120934 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n5jh\" (UniqueName: \"kubernetes.io/projected/76638789-63b5-412d-a1e6-9aa76177ef6e-kube-api-access-8n5jh\") pod \"76638789-63b5-412d-a1e6-9aa76177ef6e\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " Jul 29 15:45:51.121044 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.120984 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-envoy\") pod \"76638789-63b5-412d-a1e6-9aa76177ef6e\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " Jul 29 15:45:51.121044 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.121043 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-data\") pod \"76638789-63b5-412d-a1e6-9aa76177ef6e\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " Jul 29 15:45:51.121285 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.121085 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-workload-socket\") pod \"76638789-63b5-412d-a1e6-9aa76177ef6e\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " Jul 29 15:45:51.121285 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.121127 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76638789-63b5-412d-a1e6-9aa76177ef6e-istiod-ca-cert\") pod \"76638789-63b5-412d-a1e6-9aa76177ef6e\" (UID: \"76638789-63b5-412d-a1e6-9aa76177ef6e\") " Jul 29 15:45:51.121285 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.121234 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76638789-63b5-412d-a1e6-9aa76177ef6e" (UID: "76638789-63b5-412d-a1e6-9aa76177ef6e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:45:51.122672 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.122633 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-data" (OuterVolumeSpecName: "istio-data") pod "76638789-63b5-412d-a1e6-9aa76177ef6e" (UID: "76638789-63b5-412d-a1e6-9aa76177ef6e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:45:51.123094 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.123074 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76638789-63b5-412d-a1e6-9aa76177ef6e" (UID: "76638789-63b5-412d-a1e6-9aa76177ef6e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:45:51.123483 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.123464 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76638789-63b5-412d-a1e6-9aa76177ef6e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76638789-63b5-412d-a1e6-9aa76177ef6e" (UID: "76638789-63b5-412d-a1e6-9aa76177ef6e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:45:51.124303 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.124282 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76638789-63b5-412d-a1e6-9aa76177ef6e" (UID: "76638789-63b5-412d-a1e6-9aa76177ef6e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:45:51.124647 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.124623 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:51.124736 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.124653 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:51.124736 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.124669 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:51.124855 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.124740 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76638789-63b5-412d-a1e6-9aa76177ef6e-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:51.124855 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.124758 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:51.125901 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.125869 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-token" (OuterVolumeSpecName: "istio-token") pod "76638789-63b5-412d-a1e6-9aa76177ef6e" (UID: "76638789-63b5-412d-a1e6-9aa76177ef6e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:45:51.126075 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.125959 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76638789-63b5-412d-a1e6-9aa76177ef6e" (UID: "76638789-63b5-412d-a1e6-9aa76177ef6e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:45:51.127002 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.126963 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76638789-63b5-412d-a1e6-9aa76177ef6e" (UID: "76638789-63b5-412d-a1e6-9aa76177ef6e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 15:45:51.127385 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.127356 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76638789-63b5-412d-a1e6-9aa76177ef6e-kube-api-access-8n5jh" (OuterVolumeSpecName: "kube-api-access-8n5jh") pod "76638789-63b5-412d-a1e6-9aa76177ef6e" (UID: "76638789-63b5-412d-a1e6-9aa76177ef6e"). InnerVolumeSpecName "kube-api-access-8n5jh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:45:51.225999 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.225961 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:51.225999 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.225992 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:51.225999 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.226000 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76638789-63b5-412d-a1e6-9aa76177ef6e-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:51.226305 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.226010 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n5jh\" (UniqueName: \"kubernetes.io/projected/76638789-63b5-412d-a1e6-9aa76177ef6e-kube-api-access-8n5jh\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:45:51.343032 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.343001 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm"] Jul 29 15:45:51.351870 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:51.351841 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-16426b01-openshift-default-58db6bdf68-wslgm"] Jul 29 15:45:52.590797 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:45:52.590766 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" path="/var/lib/kubelet/pods/76638789-63b5-412d-a1e6-9aa76177ef6e/volumes" Jul 29 15:46:03.068697 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:03.068665 2554 generic.go:356] "Generic (PLEG): container finished" podID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerID="8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f" exitCode=0 Jul 29 15:46:03.069102 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:03.068702 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" event={"ID":"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8","Type":"ContainerDied","Data":"8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f"} Jul 29 15:46:03.069155 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:03.069139 2554 scope.go:117] "RemoveContainer" containerID="8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f" Jul 29 15:46:03.070170 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:03.070138 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:46:03.070234 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:03.070212 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:46:03.070269 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:03.070254 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:46:04.001013 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:04.000913 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:46:04.075116 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:04.075081 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" event={"ID":"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8","Type":"ContainerStarted","Data":"b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1"} Jul 29 15:46:04.906137 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:04.906098 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:46:04.907324 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:04.907285 2554 patch_prober.go:28] interesting pod/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 29 15:46:04.907468 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:04.907352 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" podUID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 29 15:46:05.906608 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:05.906557 2554 patch_prober.go:28] interesting pod/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 29 15:46:05.907131 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:05.906632 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" podUID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 29 15:46:06.905694 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:06.905645 2554 patch_prober.go:28] interesting pod/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 29 15:46:06.905919 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:06.905717 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" podUID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 29 15:46:07.916847 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:07.916807 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:46:07.917259 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:07.917056 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:46:07.917739 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:07.917723 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:46:20.266387 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:20.266355 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:20.638915 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:20.638827 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp"] Jul 29 15:46:20.639084 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:20.639053 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" podUID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerName="istio-proxy" containerID="cri-o://b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1" gracePeriod=30 Jul 29 15:46:20.784764 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:20.784725 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:20.887372 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:20.887333 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:20.984967 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:20.984937 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:21.450679 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:21.450643 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:21.555737 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:21.555677 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:21.691865 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:21.691833 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:22.919551 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:22.919505 2554 patch_prober.go:28] interesting pod/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 29 15:46:22.919959 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:22.919591 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" podUID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 15:46:25.890722 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:25.890699 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:46:26.060385 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.060358 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-workload-socket\") pod \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " Jul 29 15:46:26.060584 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.060404 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-envoy\") pod \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " Jul 29 15:46:26.060584 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.060453 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-podinfo\") pod \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " Jul 29 15:46:26.060584 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.060476 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-workload-certs\") pod \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " Jul 29 15:46:26.060584 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.060513 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-credential-socket\") pod \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " Jul 29 15:46:26.060584 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.060555 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skjqm\" (UniqueName: \"kubernetes.io/projected/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-kube-api-access-skjqm\") pod \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " Jul 29 15:46:26.060853 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.060640 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-data\") pod \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " Jul 29 15:46:26.060853 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.060645 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" (UID: "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:46:26.060853 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.060661 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istiod-ca-cert\") pod \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " Jul 29 15:46:26.060853 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.060689 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-token\") pod \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\" (UID: \"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8\") " Jul 29 15:46:26.060853 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.060803 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" (UID: "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:46:26.061082 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.060829 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" (UID: "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:46:26.061082 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.061045 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:46:26.061082 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.061065 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:46:26.061082 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.061080 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:46:26.061236 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.061118 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" (UID: "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:46:26.061553 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.061508 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" (UID: "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:46:26.062780 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.062753 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" (UID: "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:46:26.063053 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.063036 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" (UID: "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 15:46:26.063128 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.063054 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" (UID: "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:46:26.063167 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.063152 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-kube-api-access-skjqm" (OuterVolumeSpecName: "kube-api-access-skjqm") pod "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" (UID: "3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8"). InnerVolumeSpecName "kube-api-access-skjqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:46:26.162452 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.162414 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skjqm\" (UniqueName: \"kubernetes.io/projected/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-kube-api-access-skjqm\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:46:26.162452 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.162446 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:46:26.162452 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.162456 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:46:26.162452 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.162463 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:46:26.162732 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.162471 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:46:26.162732 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.162478 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:46:26.179051 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.179022 2554 generic.go:356] "Generic (PLEG): container finished" podID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerID="b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1" exitCode=0 Jul 29 15:46:26.179184 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.179078 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" Jul 29 15:46:26.179184 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.179111 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" event={"ID":"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8","Type":"ContainerDied","Data":"b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1"} Jul 29 15:46:26.179184 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.179171 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp" event={"ID":"3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8","Type":"ContainerDied","Data":"ee63a21161ee4e9c2dd4f52b9493814d0cf712c87e950b79f0a219e3808cfdb9"} Jul 29 15:46:26.179308 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.179202 2554 scope.go:117] "RemoveContainer" containerID="b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1" Jul 29 15:46:26.188689 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.188673 2554 scope.go:117] "RemoveContainer" containerID="8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f" Jul 29 15:46:26.199269 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.199235 2554 scope.go:117] "RemoveContainer" containerID="b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1" Jul 29 15:46:26.199516 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:46:26.199497 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1\": container with ID starting with b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1 not found: ID does not exist" containerID="b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1" Jul 29 15:46:26.199516 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.199538 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1"} err="failed to get container status \"b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1\": rpc error: code = NotFound desc = could not find container \"b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1\": container with ID starting with b8ad5b772f3b18c84126956765353872e0f58ebb50284f45072822d55e627cc1 not found: ID does not exist" Jul 29 15:46:26.199516 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.199557 2554 scope.go:117] "RemoveContainer" containerID="8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f" Jul 29 15:46:26.199802 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:46:26.199786 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f\": container with ID starting with 8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f not found: ID does not exist" containerID="8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f" Jul 29 15:46:26.199848 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.199806 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f"} err="failed to get container status \"8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f\": rpc error: code = NotFound desc = could not find container \"8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f\": container with ID starting with 8a2d7bdee0a062de90551a4d974790bdb679d14e0ae0ff4cd33df7a47189991f not found: ID does not exist" Jul 29 15:46:26.203179 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.203154 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp"] Jul 29 15:46:26.207648 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.207629 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1609e886-openshift-default-fcb4746d8-zpxbp"] Jul 29 15:46:26.590335 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:26.590299 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" path="/var/lib/kubelet/pods/3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8/volumes" Jul 29 15:46:43.783659 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:43.783620 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:51.075717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:51.075680 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:51.177736 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:51.177701 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:51.281751 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:51.281716 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:51.378857 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:51.378762 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:52.520516 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:46:52.520481 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:17.991066 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:47:17.991024 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:25.634494 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:47:25.634463 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:25.698203 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:47:25.698169 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:25.778827 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:47:25.778794 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:25.876670 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:47:25.876600 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:41.901008 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:47:41.900973 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:48.578804 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:47:48.578764 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:48.756038 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:47:48.756002 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:48.899500 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:47:48.899398 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:59.391247 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:47:59.391203 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:48:10.529885 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:48:10.529851 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:48:17.505942 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:48:17.505897 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:48:17.657801 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:48:17.657760 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:48:17.804543 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:48:17.804409 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:48:46.933966 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:48:46.933928 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:49:41.865407 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:49:41.865368 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:49:41.966937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:49:41.966900 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:08.021968 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:08.021885 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:08.125957 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:08.125925 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:20.485620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:20.485585 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:23.376562 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:23.376504 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:27.544963 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:27.544923 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:27.614254 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:27.614219 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:28.346282 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.346247 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:28.738223 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738188 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm"] Jul 29 15:50:28.738732 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738717 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerName="istio-proxy" Jul 29 15:50:28.738779 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738735 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerName="istio-proxy" Jul 29 15:50:28.738779 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738755 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" Jul 29 15:50:28.738779 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738763 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" Jul 29 15:50:28.738779 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738774 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" Jul 29 15:50:28.738906 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738783 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" Jul 29 15:50:28.738906 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738795 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerName="istio-proxy" Jul 29 15:50:28.738906 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738803 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerName="istio-proxy" Jul 29 15:50:28.738906 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738899 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" Jul 29 15:50:28.739025 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738909 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerName="istio-proxy" Jul 29 15:50:28.739025 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738919 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cec1ccb-c38b-4d5f-a325-eaaa8a53a1b8" containerName="istio-proxy" Jul 29 15:50:28.739025 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.738931 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="76638789-63b5-412d-a1e6-9aa76177ef6e" containerName="istio-proxy" Jul 29 15:50:28.742141 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.742115 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.748217 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.748194 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f2a43d0f-openshift-default-dockercfg-w54wt\"" Jul 29 15:50:28.796100 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.796055 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:28.818452 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.818402 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm"] Jul 29 15:50:28.843753 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.843720 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-workload-socket\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.843753 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.843756 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-token\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.844011 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.843880 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-workload-certs\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.844011 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.843942 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istiod-ca-cert\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.844011 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.843977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-envoy\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.844011 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.844001 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-data\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.844224 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.844033 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-podinfo\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.844224 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.844058 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-credential-socket\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.844224 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.844131 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p6tw\" (UniqueName: \"kubernetes.io/projected/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-kube-api-access-4p6tw\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.945394 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.945362 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p6tw\" (UniqueName: \"kubernetes.io/projected/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-kube-api-access-4p6tw\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.945602 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.945407 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-workload-socket\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.945668 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.945616 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-token\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.945723 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.945676 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-workload-certs\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.945776 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.945728 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istiod-ca-cert\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.945776 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.945761 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-envoy\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.945876 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.945785 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-data\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.945876 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.945853 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-podinfo\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.945876 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.945858 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-workload-socket\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.946081 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.945888 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-credential-socket\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.946081 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.946054 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-workload-certs\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.946186 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.946109 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-data\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.946387 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.946362 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-credential-socket\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.946477 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.946460 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istiod-ca-cert\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.948136 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.948116 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-envoy\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.948244 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.948227 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-podinfo\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.955085 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.955067 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-token\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:28.955406 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:28.955381 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p6tw\" (UniqueName: \"kubernetes.io/projected/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-kube-api-access-4p6tw\") pod \"e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:29.052724 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:29.052635 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:29.068614 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:29.068583 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:29.195385 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:50:29.195360 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2bc7c44_ea5a_485d_829c_f3fc5d34be8b.slice/crio-1493d02ca24bd761ef1fda90dc40849949e8752778419328526031b07f507f8c WatchSource:0}: Error finding container 1493d02ca24bd761ef1fda90dc40849949e8752778419328526031b07f507f8c: Status 404 returned error can't find the container with id 1493d02ca24bd761ef1fda90dc40849949e8752778419328526031b07f507f8c Jul 29 15:50:29.198019 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:29.197967 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:50:29.198109 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:29.198079 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:50:29.198149 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:29.198125 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:50:29.209286 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:29.209264 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm"] Jul 29 15:50:29.303605 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:29.303515 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" event={"ID":"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b","Type":"ContainerStarted","Data":"bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883"} Jul 29 15:50:29.303605 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:29.303585 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" event={"ID":"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b","Type":"ContainerStarted","Data":"1493d02ca24bd761ef1fda90dc40849949e8752778419328526031b07f507f8c"} Jul 29 15:50:29.341416 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:29.341358 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" podStartSLOduration=1.341339742 podStartE2EDuration="1.341339742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:50:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:50:29.338592465 +0000 UTC m=+2357.324934049" watchObservedRunningTime="2026-07-29 15:50:29.341339742 +0000 UTC m=+2357.327681326" Jul 29 15:50:30.053605 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:30.053571 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:30.058327 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:30.058304 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:30.314356 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:30.314267 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:30.315288 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:30.315270 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:31.633690 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:31.633655 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:31.719926 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:31.719892 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:31.936020 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:31.935990 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:32.290850 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:32.290760 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:32.634012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:32.633917 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:32.727646 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:32.727612 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:45.629149 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:45.628145 2554 patch_prober.go:28] interesting pod/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:53956->10.134.0.34:15021: read: connection reset by peer" start-of-body= Jul 29 15:50:45.629149 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:45.628218 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:53956->10.134.0.34:15021: read: connection reset by peer" Jul 29 15:50:46.389387 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:46.389355 2554 generic.go:356] "Generic (PLEG): container finished" podID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerID="bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883" exitCode=0 Jul 29 15:50:46.389600 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:46.389426 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" event={"ID":"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b","Type":"ContainerDied","Data":"bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883"} Jul 29 15:50:46.389852 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:46.389839 2554 scope.go:117] "RemoveContainer" containerID="bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883" Jul 29 15:50:46.390943 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:46.390914 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:50:46.391064 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:46.391038 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:50:46.391131 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:46.391102 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:50:47.400010 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:47.399964 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" event={"ID":"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b","Type":"ContainerStarted","Data":"2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8"} Jul 29 15:50:48.053735 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:48.053695 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:48.053941 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:48.053918 2554 patch_prober.go:28] interesting pod/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 29 15:50:48.053986 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:48.053967 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 29 15:50:49.053733 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:49.053695 2554 patch_prober.go:28] interesting pod/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 29 15:50:49.054148 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:49.053762 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 29 15:50:50.053249 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:50.053201 2554 patch_prober.go:28] interesting pod/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 29 15:50:50.053469 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:50.053273 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 29 15:50:51.053124 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:51.053087 2554 patch_prober.go:28] interesting pod/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 29 15:50:51.053562 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:51.053150 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 29 15:50:52.056615 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:52.056577 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:52.057099 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:52.056826 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:52.057569 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:52.057550 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:50:56.683488 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:56.683440 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:57.418047 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:57.418016 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:57.519085 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:57.519034 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:50:57.900734 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:50:57.900703 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:04.161320 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:04.161283 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:04.259368 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:04.259330 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:15.096592 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:15.096557 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:15.174153 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:15.174122 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:15.238477 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:15.238438 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:15.323967 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:15.323932 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:15.725879 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:15.725841 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:22.255477 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:22.255434 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:22.353669 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:22.353637 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:22.520783 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:22.520706 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm"] Jul 29 15:51:22.520987 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:22.520962 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerName="istio-proxy" containerID="cri-o://2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8" gracePeriod=30 Jul 29 15:51:22.545131 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:22.545095 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:22.815915 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:22.815810 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:22.952108 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:22.952067 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:23.051278 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:23.051246 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:23.219664 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:23.219623 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:27.778041 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.778009 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:51:27.806465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.806386 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p6tw\" (UniqueName: \"kubernetes.io/projected/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-kube-api-access-4p6tw\") pod \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " Jul 29 15:51:27.806465 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.806426 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-token\") pod \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " Jul 29 15:51:27.806678 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.806486 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-credential-socket\") pod \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " Jul 29 15:51:27.806678 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.806589 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-envoy\") pod \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " Jul 29 15:51:27.806678 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.806618 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-podinfo\") pod \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " Jul 29 15:51:27.806678 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.806648 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-workload-socket\") pod \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " Jul 29 15:51:27.806892 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.806707 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istiod-ca-cert\") pod \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " Jul 29 15:51:27.806892 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.806749 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-data\") pod \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " Jul 29 15:51:27.806892 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.806779 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-workload-certs\") pod \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\" (UID: \"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b\") " Jul 29 15:51:27.806892 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.806813 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" (UID: "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:51:27.807111 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.807082 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" (UID: "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:51:27.807169 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.807121 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:51:27.807455 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.807303 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" (UID: "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:51:27.807608 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.807573 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" (UID: "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:51:27.807837 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.807815 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" (UID: "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:51:27.808919 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.808889 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" (UID: "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:51:27.809226 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.809198 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-kube-api-access-4p6tw" (OuterVolumeSpecName: "kube-api-access-4p6tw") pod "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" (UID: "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b"). InnerVolumeSpecName "kube-api-access-4p6tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:51:27.809226 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.809217 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" (UID: "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:51:27.809353 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.809292 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" (UID: "b2bc7c44-ea5a-485d-829c-f3fc5d34be8b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 15:51:27.908085 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.908052 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p6tw\" (UniqueName: \"kubernetes.io/projected/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-kube-api-access-4p6tw\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:51:27.908085 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.908080 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:51:27.908085 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.908090 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:51:27.908085 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.908098 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:51:27.908343 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.908107 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:51:27.908343 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.908115 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:51:27.908343 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.908123 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:51:27.908343 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:27.908131 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:51:28.596125 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:28.596085 2554 generic.go:356] "Generic (PLEG): container finished" podID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerID="2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8" exitCode=0 Jul 29 15:51:28.596297 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:28.596133 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" Jul 29 15:51:28.596297 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:28.596157 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" event={"ID":"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b","Type":"ContainerDied","Data":"2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8"} Jul 29 15:51:28.596297 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:28.596207 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm" event={"ID":"b2bc7c44-ea5a-485d-829c-f3fc5d34be8b","Type":"ContainerDied","Data":"1493d02ca24bd761ef1fda90dc40849949e8752778419328526031b07f507f8c"} Jul 29 15:51:28.596297 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:28.596229 2554 scope.go:117] "RemoveContainer" containerID="2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8" Jul 29 15:51:28.608551 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:28.608507 2554 scope.go:117] "RemoveContainer" containerID="bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883" Jul 29 15:51:28.616721 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:28.616703 2554 scope.go:117] "RemoveContainer" containerID="2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8" Jul 29 15:51:28.616979 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:51:28.616952 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8\": container with ID starting with 2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8 not found: ID does not exist" containerID="2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8" Jul 29 15:51:28.617022 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:28.616983 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8"} err="failed to get container status \"2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8\": rpc error: code = NotFound desc = could not find container \"2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8\": container with ID starting with 2526b1455f066b9fb97657a3b1cd33e16ef05b1f69eb702dd38e400a6ca0a0a8 not found: ID does not exist" Jul 29 15:51:28.617022 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:28.617000 2554 scope.go:117] "RemoveContainer" containerID="bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883" Jul 29 15:51:28.617247 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:51:28.617225 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883\": container with ID starting with bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883 not found: ID does not exist" containerID="bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883" Jul 29 15:51:28.617293 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:28.617246 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883"} err="failed to get container status \"bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883\": rpc error: code = NotFound desc = could not find container \"bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883\": container with ID starting with bb36cdea1eb1bbcc1c29ece1d4edca649f738fa98399a90575f2fbc8545f8883 not found: ID does not exist" Jul 29 15:51:28.620705 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:28.620680 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm"] Jul 29 15:51:28.627688 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:28.627663 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f2a43d0f-openshift-default-64947bf6fb-cdvzm"] Jul 29 15:51:29.527892 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:29.527854 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:29.593183 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:29.593149 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:29.677474 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:29.677433 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:29.776550 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:29.776503 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:29.906291 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:29.906196 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:30.591641 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:30.591609 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" path="/var/lib/kubelet/pods/b2bc7c44-ea5a-485d-829c-f3fc5d34be8b/volumes" Jul 29 15:51:36.063299 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:36.063210 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:51:36.158930 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:51:36.158893 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:53:39.874501 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:39.874425 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:53:40.142012 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.141918 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs"] Jul 29 15:53:40.142384 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.142366 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerName="istio-proxy" Jul 29 15:53:40.142469 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.142387 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerName="istio-proxy" Jul 29 15:53:40.142543 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.142507 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerName="istio-proxy" Jul 29 15:53:40.142543 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.142538 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerName="istio-proxy" Jul 29 15:53:40.145605 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.145585 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.147922 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.147901 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-87cc52d8-openshift-default-dockercfg-2vfgc\"" Jul 29 15:53:40.157941 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.157921 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs"] Jul 29 15:53:40.330050 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.330011 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ada1130-991f-446c-9091-3ace62858b4a-istio-token\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.330269 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.330088 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ada1130-991f-446c-9091-3ace62858b4a-istiod-ca-cert\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.330269 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.330176 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-workload-socket\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.330269 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.330218 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-istio-envoy\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.330269 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.330252 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx94n\" (UniqueName: \"kubernetes.io/projected/4ada1130-991f-446c-9091-3ace62858b4a-kube-api-access-vx94n\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.330455 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.330326 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-workload-certs\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.330455 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.330362 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-istio-data\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.330535 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.330470 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-credential-socket\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.330535 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.330501 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ada1130-991f-446c-9091-3ace62858b4a-istio-podinfo\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.431490 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.431458 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ada1130-991f-446c-9091-3ace62858b4a-istiod-ca-cert\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.431689 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.431509 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-workload-socket\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.431689 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.431564 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-istio-envoy\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.431689 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.431587 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx94n\" (UniqueName: \"kubernetes.io/projected/4ada1130-991f-446c-9091-3ace62858b4a-kube-api-access-vx94n\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.431689 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.431618 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-workload-certs\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.431689 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.431643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-istio-data\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.431958 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.431776 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-credential-socket\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.431958 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.431835 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ada1130-991f-446c-9091-3ace62858b4a-istio-podinfo\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.431958 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.431875 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ada1130-991f-446c-9091-3ace62858b4a-istio-token\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.432113 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.431972 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-workload-socket\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.432170 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.432156 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-istio-data\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.432214 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.432172 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-credential-socket\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.432252 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.432220 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-workload-certs\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.432288 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.432248 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ada1130-991f-446c-9091-3ace62858b4a-istiod-ca-cert\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.434023 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.433995 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-istio-envoy\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.434324 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.434310 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ada1130-991f-446c-9091-3ace62858b4a-istio-podinfo\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.443361 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.443335 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ada1130-991f-446c-9091-3ace62858b4a-istio-token\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.443594 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.443344 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx94n\" (UniqueName: \"kubernetes.io/projected/4ada1130-991f-446c-9091-3ace62858b4a-kube-api-access-vx94n\") pod \"e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.457120 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.457095 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:40.601228 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.601203 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs"] Jul 29 15:53:40.603110 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:53:40.603077 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ada1130_991f_446c_9091_3ace62858b4a.slice/crio-c73d94b0faf813d10a7986c842a6769bf0616efd57a486fab07f23a3f0e294ef WatchSource:0}: Error finding container c73d94b0faf813d10a7986c842a6769bf0616efd57a486fab07f23a3f0e294ef: Status 404 returned error can't find the container with id c73d94b0faf813d10a7986c842a6769bf0616efd57a486fab07f23a3f0e294ef Jul 29 15:53:40.605247 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.605211 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:53:40.605359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.605291 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:53:40.605359 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:40.605339 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:53:41.224477 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:41.224434 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" event={"ID":"4ada1130-991f-446c-9091-3ace62858b4a","Type":"ContainerStarted","Data":"9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a"} Jul 29 15:53:41.224937 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:41.224496 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" event={"ID":"4ada1130-991f-446c-9091-3ace62858b4a","Type":"ContainerStarted","Data":"c73d94b0faf813d10a7986c842a6769bf0616efd57a486fab07f23a3f0e294ef"} Jul 29 15:53:41.245356 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:41.245294 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" podStartSLOduration=1.2452773289999999 podStartE2EDuration="1.245277329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:53:41.245151125 +0000 UTC m=+2549.231492711" watchObservedRunningTime="2026-07-29 15:53:41.245277329 +0000 UTC m=+2549.231618917" Jul 29 15:53:41.457606 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:41.457578 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:41.462415 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:41.462391 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:41.624483 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:41.624397 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:53:42.229312 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:42.229279 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:42.230393 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:42.230370 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:53:43.232393 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:43.232358 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:53:43.327408 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:43.327364 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:53:43.406683 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:43.406583 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:53:44.010741 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:44.010683 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:53:44.099829 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:53:44.099797 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:54:00.338545 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:00.338445 2554 generic.go:356] "Generic (PLEG): container finished" podID="4ada1130-991f-446c-9091-3ace62858b4a" containerID="9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a" exitCode=0 Jul 29 15:54:00.338930 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:00.338538 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" event={"ID":"4ada1130-991f-446c-9091-3ace62858b4a","Type":"ContainerDied","Data":"9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a"} Jul 29 15:54:00.339020 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:00.338998 2554 scope.go:117] "RemoveContainer" containerID="9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a" Jul 29 15:54:00.340020 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:00.339991 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:54:00.340070 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:00.340061 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:54:00.340125 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:00.340113 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:54:01.345085 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:01.345048 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" event={"ID":"4ada1130-991f-446c-9091-3ace62858b4a","Type":"ContainerStarted","Data":"d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8"} Jul 29 15:54:01.458153 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:01.458118 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:54:01.458347 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:01.458326 2554 patch_prober.go:28] interesting pod/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 29 15:54:01.458424 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:01.458377 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" podUID="4ada1130-991f-446c-9091-3ace62858b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 29 15:54:02.458317 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:02.458281 2554 patch_prober.go:28] interesting pod/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 29 15:54:02.458745 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:02.458336 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" podUID="4ada1130-991f-446c-9091-3ace62858b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 29 15:54:03.457805 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:03.457766 2554 patch_prober.go:28] interesting pod/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 29 15:54:03.458014 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:03.457836 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" podUID="4ada1130-991f-446c-9091-3ace62858b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 29 15:54:04.458266 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:04.458229 2554 patch_prober.go:28] interesting pod/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 29 15:54:04.458663 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:04.458281 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" podUID="4ada1130-991f-446c-9091-3ace62858b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 29 15:54:05.461451 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:05.461420 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:54:05.461889 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:05.461767 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:54:05.462562 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:05.462543 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:54:08.319984 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:08.319952 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:54:25.817130 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:25.817083 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:54:48.273782 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:48.273749 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46"] Jul 29 15:54:48.274205 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:48.274122 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerName="istio-proxy" Jul 29 15:54:48.274205 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:48.274134 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2bc7c44-ea5a-485d-829c-f3fc5d34be8b" containerName="istio-proxy" Jul 29 15:54:48.277265 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:48.277250 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46" Jul 29 15:54:48.279491 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:48.279468 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cgrq5\"" Jul 29 15:54:48.279491 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:48.279480 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 29 15:54:48.286570 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:48.286549 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46"] Jul 29 15:54:48.370620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:48.370591 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46\" (UID: \"39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46" Jul 29 15:54:48.471317 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:48.471282 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46\" (UID: \"39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46" Jul 29 15:54:48.471910 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:48.471892 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46\" (UID: \"39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46" Jul 29 15:54:48.588118 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:48.588038 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46" Jul 29 15:54:48.725819 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:48.725795 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46"] Jul 29 15:54:48.728928 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:54:48.728899 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a5f950_d9e0_4eb7_8c55_ca4a9f89c3c0.slice/crio-ab45cc8d3b7762e5b45a248de46bf51b2d6d40729c62cdcc40a7107eaca7c142 WatchSource:0}: Error finding container ab45cc8d3b7762e5b45a248de46bf51b2d6d40729c62cdcc40a7107eaca7c142: Status 404 returned error can't find the container with id ab45cc8d3b7762e5b45a248de46bf51b2d6d40729c62cdcc40a7107eaca7c142 Jul 29 15:54:49.579972 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:49.579878 2554 generic.go:356] "Generic (PLEG): container finished" podID="39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0" containerID="16f87ec5a097e03a0d560782b508b28fa70c3c70e9ec1ab718deae035e405616" exitCode=0 Jul 29 15:54:49.580367 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:49.579963 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46" event={"ID":"39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0","Type":"ContainerDied","Data":"16f87ec5a097e03a0d560782b508b28fa70c3c70e9ec1ab718deae035e405616"} Jul 29 15:54:49.580367 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:49.580019 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46" event={"ID":"39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0","Type":"ContainerStarted","Data":"ab45cc8d3b7762e5b45a248de46bf51b2d6d40729c62cdcc40a7107eaca7c142"} Jul 29 15:54:50.711137 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:50.711106 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46" Jul 29 15:54:50.792319 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:50.792286 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0-maas-api-service-ca\") pod \"39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0\" (UID: \"39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0\") " Jul 29 15:54:50.792670 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:50.792647 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0" (UID: "39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:54:50.893975 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:50.893892 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0-maas-api-service-ca\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:54:51.589917 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:51.589888 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46" Jul 29 15:54:51.589917 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:51.589906 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46" event={"ID":"39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0","Type":"ContainerDied","Data":"ab45cc8d3b7762e5b45a248de46bf51b2d6d40729c62cdcc40a7107eaca7c142"} Jul 29 15:54:51.590135 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:51.589950 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab45cc8d3b7762e5b45a248de46bf51b2d6d40729c62cdcc40a7107eaca7c142" Jul 29 15:54:57.923198 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:57.923160 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:54:58.000780 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:58.000695 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:54:58.061087 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:58.061056 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46"] Jul 29 15:54:58.066011 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:58.065977 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-87cc52d8-kbq46"] Jul 29 15:54:58.066171 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:58.066016 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:54:58.590246 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:54:58.590215 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0" path="/var/lib/kubelet/pods/39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0/volumes" Jul 29 15:55:01.661016 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:55:01.660978 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:55:06.582798 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:55:06.582765 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:55:44.348020 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:55:44.347983 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:55:44.656150 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:55:44.656045 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:55:50.649492 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:55:50.649455 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:55:56.622233 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:55:56.622198 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:55:56.693772 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:55:56.693736 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:55:56.897251 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:55:56.897161 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs"] Jul 29 15:55:56.897400 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:55:56.897370 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" podUID="4ada1130-991f-446c-9091-3ace62858b4a" containerName="istio-proxy" containerID="cri-o://d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8" gracePeriod=30 Jul 29 15:55:56.937654 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:55:56.937621 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:55:57.175115 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:55:57.175035 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:02.143004 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.142982 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:56:02.254281 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.254246 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-workload-certs\") pod \"4ada1130-991f-446c-9091-3ace62858b4a\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " Jul 29 15:56:02.254281 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.254283 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-istio-data\") pod \"4ada1130-991f-446c-9091-3ace62858b4a\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " Jul 29 15:56:02.254569 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.254330 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-workload-socket\") pod \"4ada1130-991f-446c-9091-3ace62858b4a\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " Jul 29 15:56:02.254569 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.254372 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ada1130-991f-446c-9091-3ace62858b4a-istio-podinfo\") pod \"4ada1130-991f-446c-9091-3ace62858b4a\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " Jul 29 15:56:02.254569 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.254426 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-istio-envoy\") pod \"4ada1130-991f-446c-9091-3ace62858b4a\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " Jul 29 15:56:02.254569 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.254448 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-credential-socket\") pod \"4ada1130-991f-446c-9091-3ace62858b4a\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " Jul 29 15:56:02.254829 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.254595 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ada1130-991f-446c-9091-3ace62858b4a" (UID: "4ada1130-991f-446c-9091-3ace62858b4a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:56:02.254829 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.254605 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ada1130-991f-446c-9091-3ace62858b4a-istio-token\") pod \"4ada1130-991f-446c-9091-3ace62858b4a\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " Jul 29 15:56:02.254829 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.254687 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vx94n\" (UniqueName: \"kubernetes.io/projected/4ada1130-991f-446c-9091-3ace62858b4a-kube-api-access-vx94n\") pod \"4ada1130-991f-446c-9091-3ace62858b4a\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " Jul 29 15:56:02.254829 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.254721 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ada1130-991f-446c-9091-3ace62858b4a-istiod-ca-cert\") pod \"4ada1130-991f-446c-9091-3ace62858b4a\" (UID: \"4ada1130-991f-446c-9091-3ace62858b4a\") " Jul 29 15:56:02.254829 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.254732 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ada1130-991f-446c-9091-3ace62858b4a" (UID: "4ada1130-991f-446c-9091-3ace62858b4a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:56:02.255095 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.255070 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:56:02.255095 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.255089 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:56:02.255192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.255097 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ada1130-991f-446c-9091-3ace62858b4a" (UID: "4ada1130-991f-446c-9091-3ace62858b4a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:56:02.255192 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.255138 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ada1130-991f-446c-9091-3ace62858b4a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ada1130-991f-446c-9091-3ace62858b4a" (UID: "4ada1130-991f-446c-9091-3ace62858b4a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:56:02.255348 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.255303 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ada1130-991f-446c-9091-3ace62858b4a" (UID: "4ada1130-991f-446c-9091-3ace62858b4a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:56:02.256803 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.256779 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ada1130-991f-446c-9091-3ace62858b4a-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ada1130-991f-446c-9091-3ace62858b4a" (UID: "4ada1130-991f-446c-9091-3ace62858b4a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:56:02.256904 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.256867 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ada1130-991f-446c-9091-3ace62858b4a" (UID: "4ada1130-991f-446c-9091-3ace62858b4a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:56:02.257106 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.257084 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ada1130-991f-446c-9091-3ace62858b4a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ada1130-991f-446c-9091-3ace62858b4a" (UID: "4ada1130-991f-446c-9091-3ace62858b4a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 15:56:02.257230 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.257207 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ada1130-991f-446c-9091-3ace62858b4a-kube-api-access-vx94n" (OuterVolumeSpecName: "kube-api-access-vx94n") pod "4ada1130-991f-446c-9091-3ace62858b4a" (UID: "4ada1130-991f-446c-9091-3ace62858b4a"). InnerVolumeSpecName "kube-api-access-vx94n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:56:02.356163 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.356113 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ada1130-991f-446c-9091-3ace62858b4a-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:56:02.356163 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.356156 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:56:02.356163 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.356169 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:56:02.356412 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.356181 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ada1130-991f-446c-9091-3ace62858b4a-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:56:02.356412 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.356194 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vx94n\" (UniqueName: \"kubernetes.io/projected/4ada1130-991f-446c-9091-3ace62858b4a-kube-api-access-vx94n\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:56:02.356412 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.356205 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ada1130-991f-446c-9091-3ace62858b4a-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:56:02.356412 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.356215 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ada1130-991f-446c-9091-3ace62858b4a-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 15:56:02.930614 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.930583 2554 generic.go:356] "Generic (PLEG): container finished" podID="4ada1130-991f-446c-9091-3ace62858b4a" containerID="d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8" exitCode=0 Jul 29 15:56:02.930762 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.930669 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" Jul 29 15:56:02.930762 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.930698 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" event={"ID":"4ada1130-991f-446c-9091-3ace62858b4a","Type":"ContainerDied","Data":"d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8"} Jul 29 15:56:02.930910 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.930893 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs" event={"ID":"4ada1130-991f-446c-9091-3ace62858b4a","Type":"ContainerDied","Data":"c73d94b0faf813d10a7986c842a6769bf0616efd57a486fab07f23a3f0e294ef"} Jul 29 15:56:02.930947 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.930927 2554 scope.go:117] "RemoveContainer" containerID="d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8" Jul 29 15:56:02.939763 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.939747 2554 scope.go:117] "RemoveContainer" containerID="9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a" Jul 29 15:56:02.947227 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.947206 2554 scope.go:117] "RemoveContainer" containerID="d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8" Jul 29 15:56:02.947484 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:56:02.947466 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8\": container with ID starting with d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8 not found: ID does not exist" containerID="d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8" Jul 29 15:56:02.947549 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.947493 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8"} err="failed to get container status \"d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8\": rpc error: code = NotFound desc = could not find container \"d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8\": container with ID starting with d46d58ee1bd4458ad3e2bc7a5cf9e2296c0fdb257e05926eecd586ab822762a8 not found: ID does not exist" Jul 29 15:56:02.947549 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.947510 2554 scope.go:117] "RemoveContainer" containerID="9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a" Jul 29 15:56:02.947766 ip-10-0-130-249 kubenswrapper[2554]: E0729 15:56:02.947748 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a\": container with ID starting with 9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a not found: ID does not exist" containerID="9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a" Jul 29 15:56:02.947803 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.947773 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a"} err="failed to get container status \"9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a\": rpc error: code = NotFound desc = could not find container \"9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a\": container with ID starting with 9e927c390cf87b935c2a9682d74a2290254414590fbd43931f29d46b5ec3155a not found: ID does not exist" Jul 29 15:56:02.950691 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.950674 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs"] Jul 29 15:56:02.962453 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:02.962435 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-87cc52d8-openshift-default-567795795b-gbpcs"] Jul 29 15:56:04.589997 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:04.589919 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ada1130-991f-446c-9091-3ace62858b4a" path="/var/lib/kubelet/pods/4ada1130-991f-446c-9091-3ace62858b4a/volumes" Jul 29 15:56:12.521239 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:12.521205 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:12.596374 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:12.596338 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:18.842890 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:18.842840 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:18.939438 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:18.939403 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:19.038692 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:19.038656 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:30.172202 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:30.172169 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:30.323871 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:30.323835 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:30.422120 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:30.422091 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:31.912087 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:31.912054 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:38.834814 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:38.834776 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:38.982116 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:38.982078 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:39.568936 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:39.568906 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:45.908298 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:45.908262 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:46.006760 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:46.006727 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:46.101356 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:46.101333 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:56:56.674286 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:56:56.674238 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:07.327107 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:07.327067 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:28.367488 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:28.367455 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:35.510411 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:35.510335 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:35.592391 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:35.592350 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:35.882740 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:35.882654 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:36.195182 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.195153 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd"] Jul 29 15:57:36.195598 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.195582 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0" containerName="revoke-keys" Jul 29 15:57:36.195598 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.195598 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0" containerName="revoke-keys" Jul 29 15:57:36.195724 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.195608 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ada1130-991f-446c-9091-3ace62858b4a" containerName="istio-proxy" Jul 29 15:57:36.195724 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.195614 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ada1130-991f-446c-9091-3ace62858b4a" containerName="istio-proxy" Jul 29 15:57:36.195724 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.195622 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ada1130-991f-446c-9091-3ace62858b4a" containerName="istio-proxy" Jul 29 15:57:36.195724 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.195627 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ada1130-991f-446c-9091-3ace62858b4a" containerName="istio-proxy" Jul 29 15:57:36.195724 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.195684 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ada1130-991f-446c-9091-3ace62858b4a" containerName="istio-proxy" Jul 29 15:57:36.195724 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.195691 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="39a5f950-d9e0-4eb7-8c55-ca4a9f89c3c0" containerName="revoke-keys" Jul 29 15:57:36.198620 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.198594 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.201161 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.201140 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-9750ef-openshift-default-dockercfg-jf7ss\"" Jul 29 15:57:36.226351 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.226324 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd"] Jul 29 15:57:36.232112 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.232087 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:36.333338 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.333307 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkn4x\" (UniqueName: \"kubernetes.io/projected/32370b17-b2e0-47fa-bbe5-187e81602956-kube-api-access-xkn4x\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.333560 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.333353 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-workload-certs\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.333560 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.333381 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-istio-data\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.333560 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.333418 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32370b17-b2e0-47fa-bbe5-187e81602956-istio-token\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.333560 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.333439 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-workload-socket\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.333560 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.333456 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32370b17-b2e0-47fa-bbe5-187e81602956-istiod-ca-cert\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.333560 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.333484 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-credential-socket\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.333885 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.333607 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-istio-envoy\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.333885 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.333640 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32370b17-b2e0-47fa-bbe5-187e81602956-istio-podinfo\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.422553 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.422496 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:36.434903 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.434875 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-credential-socket\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.435086 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.434928 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-istio-envoy\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.435086 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.435038 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32370b17-b2e0-47fa-bbe5-187e81602956-istio-podinfo\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.435213 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.435123 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkn4x\" (UniqueName: \"kubernetes.io/projected/32370b17-b2e0-47fa-bbe5-187e81602956-kube-api-access-xkn4x\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.435213 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.435172 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-workload-certs\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.435213 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.435188 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-istio-data\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.435213 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.435207 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32370b17-b2e0-47fa-bbe5-187e81602956-istio-token\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.435422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.435230 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-workload-socket\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.435422 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.435392 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-credential-socket\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.435556 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.435499 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-workload-certs\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.435623 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.435568 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32370b17-b2e0-47fa-bbe5-187e81602956-istiod-ca-cert\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.435623 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.435579 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-istio-data\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.435729 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.435642 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-workload-socket\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.436238 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.436217 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32370b17-b2e0-47fa-bbe5-187e81602956-istiod-ca-cert\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.437463 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.437436 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-istio-envoy\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.437674 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.437657 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32370b17-b2e0-47fa-bbe5-187e81602956-istio-podinfo\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.444876 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.444850 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32370b17-b2e0-47fa-bbe5-187e81602956-istio-token\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.445049 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.445028 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkn4x\" (UniqueName: \"kubernetes.io/projected/32370b17-b2e0-47fa-bbe5-187e81602956-kube-api-access-xkn4x\") pod \"e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.508368 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.508258 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:36.657552 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.657507 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd"] Jul 29 15:57:36.659777 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:57:36.659749 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32370b17_b2e0_47fa_bbe5_187e81602956.slice/crio-dd50b8ce567de85ef39c6835f7c99243dd904b693263195f43e7b740000c21b5 WatchSource:0}: Error finding container dd50b8ce567de85ef39c6835f7c99243dd904b693263195f43e7b740000c21b5: Status 404 returned error can't find the container with id dd50b8ce567de85ef39c6835f7c99243dd904b693263195f43e7b740000c21b5 Jul 29 15:57:36.661801 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.661769 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:57:36.661881 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.661831 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:57:36.661881 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:36.661859 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:57:37.371815 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:37.371776 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" event={"ID":"32370b17-b2e0-47fa-bbe5-187e81602956","Type":"ContainerStarted","Data":"b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958"} Jul 29 15:57:37.372000 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:37.371833 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" event={"ID":"32370b17-b2e0-47fa-bbe5-187e81602956","Type":"ContainerStarted","Data":"dd50b8ce567de85ef39c6835f7c99243dd904b693263195f43e7b740000c21b5"} Jul 29 15:57:37.397029 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:37.396972 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" podStartSLOduration=1.3969554610000001 podStartE2EDuration="1.396955461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:57:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:57:37.394489306 +0000 UTC m=+2785.380830890" watchObservedRunningTime="2026-07-29 15:57:37.396955461 +0000 UTC m=+2785.383297044" Jul 29 15:57:37.509137 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:37.509097 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:37.515985 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:37.515950 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:38.378373 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:38.378339 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:38.379338 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:38.379317 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:39.376850 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:39.376811 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:39.503633 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:39.503604 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:39.610397 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:39.610364 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:39.801976 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:39.801949 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:40.201767 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:40.201738 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:40.309334 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:40.309301 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:57:52.449406 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:52.449371 2554 generic.go:356] "Generic (PLEG): container finished" podID="32370b17-b2e0-47fa-bbe5-187e81602956" containerID="b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958" exitCode=0 Jul 29 15:57:52.449859 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:52.449445 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" event={"ID":"32370b17-b2e0-47fa-bbe5-187e81602956","Type":"ContainerDied","Data":"b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958"} Jul 29 15:57:52.449859 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:52.449852 2554 scope.go:117] "RemoveContainer" containerID="b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958" Jul 29 15:57:52.450885 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:52.450858 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:57:52.450955 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:52.450923 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:57:52.450996 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:52.450956 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:57:53.378277 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:53.378242 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:53.456462 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:53.456434 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" event={"ID":"32370b17-b2e0-47fa-bbe5-187e81602956","Type":"ContainerStarted","Data":"d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4"} Jul 29 15:57:53.509247 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:53.509209 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:53.510308 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:53.510284 2554 patch_prober.go:28] interesting pod/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 29 15:57:53.510391 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:53.510331 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 29 15:57:54.509754 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:54.509717 2554 patch_prober.go:28] interesting pod/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 29 15:57:54.510381 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:54.510346 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 29 15:57:55.509931 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:55.509890 2554 patch_prober.go:28] interesting pod/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 29 15:57:55.510505 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:55.510470 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 29 15:57:56.509363 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:56.509311 2554 patch_prober.go:28] interesting pod/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 29 15:57:56.509598 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:56.509384 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 29 15:57:57.509729 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:57.509681 2554 patch_prober.go:28] interesting pod/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 29 15:57:57.510364 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:57.510307 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 29 15:57:58.512111 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:58.512077 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:58.512623 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:58.512449 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:57:58.512997 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:57:58.512977 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 15:58:04.424979 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:04.424951 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:58:04.795216 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:04.795182 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:58:05.085590 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.085489 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8"] Jul 29 15:58:05.085956 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.085941 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ada1130-991f-446c-9091-3ace62858b4a" containerName="istio-proxy" Jul 29 15:58:05.089177 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.089155 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.091441 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.091418 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-dfc210-openshift-default-dockercfg-sm5wm\"" Jul 29 15:58:05.102896 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.102870 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8"] Jul 29 15:58:05.122381 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.122342 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:58:05.212817 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.212773 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-credential-socket\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.212817 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.212820 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-istio-data\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.213033 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.212852 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzg6b\" (UniqueName: \"kubernetes.io/projected/dd27a911-6281-4b51-8a77-ac10d787b224-kube-api-access-wzg6b\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.213033 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.212945 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd27a911-6281-4b51-8a77-ac10d787b224-istiod-ca-cert\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.213033 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.213005 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-istio-envoy\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.213127 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.213036 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd27a911-6281-4b51-8a77-ac10d787b224-istio-token\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.213127 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.213103 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-workload-certs\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.213194 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.213125 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-workload-socket\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.213194 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.213161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd27a911-6281-4b51-8a77-ac10d787b224-istio-podinfo\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.225394 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.225351 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:58:05.313858 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.313821 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd27a911-6281-4b51-8a77-ac10d787b224-istiod-ca-cert\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314070 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.313878 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-istio-envoy\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314070 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.313899 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd27a911-6281-4b51-8a77-ac10d787b224-istio-token\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314070 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.313943 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-workload-certs\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314070 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.313965 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-workload-socket\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314070 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.313990 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd27a911-6281-4b51-8a77-ac10d787b224-istio-podinfo\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314070 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.314027 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-credential-socket\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314394 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.314145 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-istio-data\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314394 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.314195 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzg6b\" (UniqueName: \"kubernetes.io/projected/dd27a911-6281-4b51-8a77-ac10d787b224-kube-api-access-wzg6b\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314513 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.314441 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-credential-socket\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314513 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.314483 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-workload-socket\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314661 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.314641 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-workload-certs\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.314693 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-istio-data\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.314717 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.314691 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd27a911-6281-4b51-8a77-ac10d787b224-istiod-ca-cert\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.316406 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.316386 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-istio-envoy\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.316545 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.316509 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd27a911-6281-4b51-8a77-ac10d787b224-istio-podinfo\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.328711 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.328683 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd27a911-6281-4b51-8a77-ac10d787b224-istio-token\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.328843 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.328761 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzg6b\" (UniqueName: \"kubernetes.io/projected/dd27a911-6281-4b51-8a77-ac10d787b224-kube-api-access-wzg6b\") pod \"e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.399775 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.399678 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:05.424902 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.424872 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:58:05.547681 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.547653 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8"] Jul 29 15:58:05.549462 ip-10-0-130-249 kubenswrapper[2554]: W0729 15:58:05.549435 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd27a911_6281_4b51_8a77_ac10d787b224.slice/crio-1b3f3786b0be95c996d7fec2da6788d9d83b6efa5e604c52297b17426e6ab953 WatchSource:0}: Error finding container 1b3f3786b0be95c996d7fec2da6788d9d83b6efa5e604c52297b17426e6ab953: Status 404 returned error can't find the container with id 1b3f3786b0be95c996d7fec2da6788d9d83b6efa5e604c52297b17426e6ab953 Jul 29 15:58:05.551686 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.551653 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:58:05.551785 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.551737 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:58:05.551849 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:05.551781 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:58:06.523389 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:06.523350 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" event={"ID":"dd27a911-6281-4b51-8a77-ac10d787b224","Type":"ContainerStarted","Data":"aa4fa642849f0b9e25267d5c301ae3fbdfe564898380eed764235569716ac199"} Jul 29 15:58:06.523652 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:06.523411 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" event={"ID":"dd27a911-6281-4b51-8a77-ac10d787b224","Type":"ContainerStarted","Data":"1b3f3786b0be95c996d7fec2da6788d9d83b6efa5e604c52297b17426e6ab953"} Jul 29 15:58:06.553061 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:06.553006 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" podStartSLOduration=1.552986008 podStartE2EDuration="1.552986008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:58:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:58:06.550888575 +0000 UTC m=+2814.537230156" watchObservedRunningTime="2026-07-29 15:58:06.552986008 +0000 UTC m=+2814.539327650" Jul 29 15:58:07.400501 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:07.400465 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:07.405210 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:07.405184 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:07.530285 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:07.530250 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:07.531194 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:07.531176 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:08.572458 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:08.572423 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:58:08.672626 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:08.672597 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:58:08.891718 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:08.891614 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:58:09.093021 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:09.092990 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:58:09.533325 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:09.533293 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:58:09.656514 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:09.656480 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:58:22.532019 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:22.531978 2554 patch_prober.go:28] interesting pod/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 29 15:58:22.532501 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:22.532054 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 29 15:58:22.605386 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:22.605355 2554 generic.go:356] "Generic (PLEG): container finished" podID="dd27a911-6281-4b51-8a77-ac10d787b224" containerID="aa4fa642849f0b9e25267d5c301ae3fbdfe564898380eed764235569716ac199" exitCode=0 Jul 29 15:58:22.605573 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:22.605427 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" event={"ID":"dd27a911-6281-4b51-8a77-ac10d787b224","Type":"ContainerDied","Data":"aa4fa642849f0b9e25267d5c301ae3fbdfe564898380eed764235569716ac199"} Jul 29 15:58:22.605852 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:22.605838 2554 scope.go:117] "RemoveContainer" containerID="aa4fa642849f0b9e25267d5c301ae3fbdfe564898380eed764235569716ac199" Jul 29 15:58:22.606962 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:22.606935 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:58:22.607023 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:22.607005 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:58:22.607058 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:22.607046 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 15:58:23.615261 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:23.615225 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" event={"ID":"dd27a911-6281-4b51-8a77-ac10d787b224","Type":"ContainerStarted","Data":"8d84304f8a44cb5c5270e0c7cabf25046b401f5b171e7a1b0b74df87a2afc95c"} Jul 29 15:58:24.400918 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:24.400874 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:24.401143 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:24.401007 2554 patch_prober.go:28] interesting pod/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 29 15:58:24.401143 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:24.401058 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 29 15:58:25.400204 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:25.400155 2554 patch_prober.go:28] interesting pod/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 29 15:58:25.400764 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:25.400231 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 29 15:58:26.402983 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:26.402941 2554 patch_prober.go:28] interesting pod/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 29 15:58:26.404031 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:26.403596 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 29 15:58:27.400967 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:27.400925 2554 patch_prober.go:28] interesting pod/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 29 15:58:27.401282 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:27.401250 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 29 15:58:28.403782 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:28.403744 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:28.404171 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:28.404048 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:28.404831 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:28.404813 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 15:58:33.654969 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:33.654936 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:58:43.909139 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:58:43.909107 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:59:07.112442 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:59:07.112326 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:59:07.213952 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:59:07.213914 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 15:59:29.716430 ip-10-0-130-249 kubenswrapper[2554]: I0729 15:59:29.716395 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:00.139508 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.139472 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq"] Jul 29 16:00:00.142884 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.142867 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv"] Jul 29 16:00:00.142997 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.142979 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq" Jul 29 16:00:00.145360 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.145340 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cgrq5\"" Jul 29 16:00:00.146052 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.146038 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755680-69nh2"] Jul 29 16:00:00.146152 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.146138 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv" Jul 29 16:00:00.149354 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.149337 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755680-69nh2" Jul 29 16:00:00.154005 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.153984 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq"] Jul 29 16:00:00.155219 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.155202 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq" Jul 29 16:00:00.156200 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.156178 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv"] Jul 29 16:00:00.158703 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.158567 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755680-69nh2"] Jul 29 16:00:00.167246 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.167227 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv" Jul 29 16:00:00.201946 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.201923 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755680-69nh2" Jul 29 16:00:00.521909 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.521876 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq"] Jul 29 16:00:00.525584 ip-10-0-130-249 kubenswrapper[2554]: W0729 16:00:00.525561 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011b03ef_8c6b_4214_bd09_91f777b3a956.slice/crio-5d376eeb8b25e39dfd2ac40982bd3d8760e409f09a3d15b16df409e06f991ef3 WatchSource:0}: Error finding container 5d376eeb8b25e39dfd2ac40982bd3d8760e409f09a3d15b16df409e06f991ef3: Status 404 returned error can't find the container with id 5d376eeb8b25e39dfd2ac40982bd3d8760e409f09a3d15b16df409e06f991ef3 Jul 29 16:00:00.544881 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.544854 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv"] Jul 29 16:00:00.548062 ip-10-0-130-249 kubenswrapper[2554]: W0729 16:00:00.548031 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a656c28_75ff_4e05_a88d_2cac8d674ba6.slice/crio-8eb46c354ff6bfc661239e670ffdfd94b5c9e93c269a37016a18af39a10577b6 WatchSource:0}: Error finding container 8eb46c354ff6bfc661239e670ffdfd94b5c9e93c269a37016a18af39a10577b6: Status 404 returned error can't find the container with id 8eb46c354ff6bfc661239e670ffdfd94b5c9e93c269a37016a18af39a10577b6 Jul 29 16:00:00.569992 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:00.569964 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755680-69nh2"] Jul 29 16:00:00.580624 ip-10-0-130-249 kubenswrapper[2554]: W0729 16:00:00.580601 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bef0bd6_c535_4508_a575_46cedfb719bd.slice/crio-8e4b17e68afe30fe3bfc9b65309dafcbadbada02371abb674a0c017bb2566b9b WatchSource:0}: Error finding container 8e4b17e68afe30fe3bfc9b65309dafcbadbada02371abb674a0c017bb2566b9b: Status 404 returned error can't find the container with id 8e4b17e68afe30fe3bfc9b65309dafcbadbada02371abb674a0c017bb2566b9b Jul 29 16:00:01.082903 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:01.082797 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv" event={"ID":"2a656c28-75ff-4e05-a88d-2cac8d674ba6","Type":"ContainerStarted","Data":"84006755a4f6389b2b158911cb5f0aa6bacb4a758d456ef9bf4b315a191decaa"} Jul 29 16:00:01.082903 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:01.082894 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv" event={"ID":"2a656c28-75ff-4e05-a88d-2cac8d674ba6","Type":"ContainerStarted","Data":"8eb46c354ff6bfc661239e670ffdfd94b5c9e93c269a37016a18af39a10577b6"} Jul 29 16:00:01.084664 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:01.084639 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755680-69nh2" event={"ID":"6bef0bd6-c535-4508-a575-46cedfb719bd","Type":"ContainerStarted","Data":"a33728302998f69ecbee31149d3f77e232cf7b15200ae6e93dc515aa1556cb12"} Jul 29 16:00:01.084793 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:01.084680 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755680-69nh2" event={"ID":"6bef0bd6-c535-4508-a575-46cedfb719bd","Type":"ContainerStarted","Data":"8e4b17e68afe30fe3bfc9b65309dafcbadbada02371abb674a0c017bb2566b9b"} Jul 29 16:00:01.086032 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:01.086001 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq" event={"ID":"011b03ef-8c6b-4214-bd09-91f777b3a956","Type":"ContainerStarted","Data":"f60f1d6106f7cd742274f825063aab818134798ce1709e807dedbba7026eff08"} Jul 29 16:00:01.086118 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:01.086043 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq" event={"ID":"011b03ef-8c6b-4214-bd09-91f777b3a956","Type":"ContainerStarted","Data":"5d376eeb8b25e39dfd2ac40982bd3d8760e409f09a3d15b16df409e06f991ef3"} Jul 29 16:00:01.104067 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:01.104018 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv" podStartSLOduration=1.104005101 podStartE2EDuration="1.104005101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:00:01.100974041 +0000 UTC m=+2929.087315625" watchObservedRunningTime="2026-07-29 16:00:01.104005101 +0000 UTC m=+2929.090346685" Jul 29 16:00:01.124128 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:01.124074 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755680-69nh2" podStartSLOduration=1.124055134 podStartE2EDuration="1.124055134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:00:01.121183257 +0000 UTC m=+2929.107524841" watchObservedRunningTime="2026-07-29 16:00:01.124055134 +0000 UTC m=+2929.110396722" Jul 29 16:00:01.143401 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:01.143358 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq" podStartSLOduration=1.1433451940000001 podStartE2EDuration="1.143345194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:00:01.141343776 +0000 UTC m=+2929.127685359" watchObservedRunningTime="2026-07-29 16:00:01.143345194 +0000 UTC m=+2929.129686777" Jul 29 16:00:02.093680 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:02.093639 2554 generic.go:356] "Generic (PLEG): container finished" podID="011b03ef-8c6b-4214-bd09-91f777b3a956" containerID="f60f1d6106f7cd742274f825063aab818134798ce1709e807dedbba7026eff08" exitCode=0 Jul 29 16:00:02.093846 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:02.093725 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq" event={"ID":"011b03ef-8c6b-4214-bd09-91f777b3a956","Type":"ContainerDied","Data":"f60f1d6106f7cd742274f825063aab818134798ce1709e807dedbba7026eff08"} Jul 29 16:00:02.095158 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:02.095128 2554 generic.go:356] "Generic (PLEG): container finished" podID="2a656c28-75ff-4e05-a88d-2cac8d674ba6" containerID="84006755a4f6389b2b158911cb5f0aa6bacb4a758d456ef9bf4b315a191decaa" exitCode=0 Jul 29 16:00:02.095291 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:02.095219 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv" event={"ID":"2a656c28-75ff-4e05-a88d-2cac8d674ba6","Type":"ContainerDied","Data":"84006755a4f6389b2b158911cb5f0aa6bacb4a758d456ef9bf4b315a191decaa"} Jul 29 16:00:02.096482 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:02.096461 2554 generic.go:356] "Generic (PLEG): container finished" podID="6bef0bd6-c535-4508-a575-46cedfb719bd" containerID="a33728302998f69ecbee31149d3f77e232cf7b15200ae6e93dc515aa1556cb12" exitCode=0 Jul 29 16:00:02.096581 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:02.096505 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755680-69nh2" event={"ID":"6bef0bd6-c535-4508-a575-46cedfb719bd","Type":"ContainerDied","Data":"a33728302998f69ecbee31149d3f77e232cf7b15200ae6e93dc515aa1556cb12"} Jul 29 16:00:03.239468 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:03.239441 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv" Jul 29 16:00:03.281224 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:03.281193 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755680-69nh2" Jul 29 16:00:03.285040 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:03.285018 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq" Jul 29 16:00:04.108449 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:04.108423 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv" Jul 29 16:00:04.108654 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:04.108459 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv" event={"ID":"2a656c28-75ff-4e05-a88d-2cac8d674ba6","Type":"ContainerDied","Data":"8eb46c354ff6bfc661239e670ffdfd94b5c9e93c269a37016a18af39a10577b6"} Jul 29 16:00:04.108654 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:04.108506 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8eb46c354ff6bfc661239e670ffdfd94b5c9e93c269a37016a18af39a10577b6" Jul 29 16:00:04.109716 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:04.109697 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755680-69nh2" Jul 29 16:00:04.109716 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:04.109706 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755680-69nh2" event={"ID":"6bef0bd6-c535-4508-a575-46cedfb719bd","Type":"ContainerDied","Data":"8e4b17e68afe30fe3bfc9b65309dafcbadbada02371abb674a0c017bb2566b9b"} Jul 29 16:00:04.109877 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:04.109747 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e4b17e68afe30fe3bfc9b65309dafcbadbada02371abb674a0c017bb2566b9b" Jul 29 16:00:04.110955 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:04.110938 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq" Jul 29 16:00:04.111044 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:04.110952 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq" event={"ID":"011b03ef-8c6b-4214-bd09-91f777b3a956","Type":"ContainerDied","Data":"5d376eeb8b25e39dfd2ac40982bd3d8760e409f09a3d15b16df409e06f991ef3"} Jul 29 16:00:04.111044 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:04.110991 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d376eeb8b25e39dfd2ac40982bd3d8760e409f09a3d15b16df409e06f991ef3" Jul 29 16:00:14.285892 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:14.285857 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:15.299842 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.299808 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:15.402552 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.402497 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9"] Jul 29 16:00:15.402882 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.402870 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bef0bd6-c535-4508-a575-46cedfb719bd" containerName="cleanup" Jul 29 16:00:15.402924 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.402883 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bef0bd6-c535-4508-a575-46cedfb719bd" containerName="cleanup" Jul 29 16:00:15.402924 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.402896 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a656c28-75ff-4e05-a88d-2cac8d674ba6" containerName="cleanup" Jul 29 16:00:15.402924 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.402902 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a656c28-75ff-4e05-a88d-2cac8d674ba6" containerName="cleanup" Jul 29 16:00:15.402924 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.402920 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011b03ef-8c6b-4214-bd09-91f777b3a956" containerName="cleanup" Jul 29 16:00:15.403039 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.402926 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="011b03ef-8c6b-4214-bd09-91f777b3a956" containerName="cleanup" Jul 29 16:00:15.403039 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.402987 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bef0bd6-c535-4508-a575-46cedfb719bd" containerName="cleanup" Jul 29 16:00:15.403039 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.402995 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="011b03ef-8c6b-4214-bd09-91f777b3a956" containerName="cleanup" Jul 29 16:00:15.403039 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.403002 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a656c28-75ff-4e05-a88d-2cac8d674ba6" containerName="cleanup" Jul 29 16:00:15.406041 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.406025 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9" Jul 29 16:00:15.408512 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.408495 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 29 16:00:15.408596 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.408552 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cgrq5\"" Jul 29 16:00:15.414603 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.414579 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9"] Jul 29 16:00:15.566639 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.566548 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b4c6f4-e107-498a-8967-a8a9628ea72a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9\" (UID: \"14b4c6f4-e107-498a-8967-a8a9628ea72a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9" Jul 29 16:00:15.667572 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.667539 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b4c6f4-e107-498a-8967-a8a9628ea72a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9\" (UID: \"14b4c6f4-e107-498a-8967-a8a9628ea72a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9" Jul 29 16:00:15.668136 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.668118 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b4c6f4-e107-498a-8967-a8a9628ea72a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9\" (UID: \"14b4c6f4-e107-498a-8967-a8a9628ea72a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9" Jul 29 16:00:15.717513 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:15.717471 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9" Jul 29 16:00:16.059048 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:16.055705 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9"] Jul 29 16:00:16.063572 ip-10-0-130-249 kubenswrapper[2554]: W0729 16:00:16.063501 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b4c6f4_e107_498a_8967_a8a9628ea72a.slice/crio-18a482d479e727842a4caf0c920b40aecfdefc91beb9b1babddd4255dd7fd58c WatchSource:0}: Error finding container 18a482d479e727842a4caf0c920b40aecfdefc91beb9b1babddd4255dd7fd58c: Status 404 returned error can't find the container with id 18a482d479e727842a4caf0c920b40aecfdefc91beb9b1babddd4255dd7fd58c Jul 29 16:00:16.172755 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:16.172716 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9" event={"ID":"14b4c6f4-e107-498a-8967-a8a9628ea72a","Type":"ContainerStarted","Data":"18a482d479e727842a4caf0c920b40aecfdefc91beb9b1babddd4255dd7fd58c"} Jul 29 16:00:17.178937 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:17.178839 2554 generic.go:356] "Generic (PLEG): container finished" podID="14b4c6f4-e107-498a-8967-a8a9628ea72a" containerID="385e75e4b53be2ce025eb3bdecb7b7b21a5e5b8932e597193f96eb847a35cb27" exitCode=0 Jul 29 16:00:17.178937 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:17.178923 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9" event={"ID":"14b4c6f4-e107-498a-8967-a8a9628ea72a","Type":"ContainerDied","Data":"385e75e4b53be2ce025eb3bdecb7b7b21a5e5b8932e597193f96eb847a35cb27"} Jul 29 16:00:18.317650 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:18.317626 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9" Jul 29 16:00:18.493115 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:18.493009 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b4c6f4-e107-498a-8967-a8a9628ea72a-maas-api-service-ca\") pod \"14b4c6f4-e107-498a-8967-a8a9628ea72a\" (UID: \"14b4c6f4-e107-498a-8967-a8a9628ea72a\") " Jul 29 16:00:18.493379 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:18.493355 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14b4c6f4-e107-498a-8967-a8a9628ea72a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "14b4c6f4-e107-498a-8967-a8a9628ea72a" (UID: "14b4c6f4-e107-498a-8967-a8a9628ea72a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:00:18.593848 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:18.593818 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b4c6f4-e107-498a-8967-a8a9628ea72a-maas-api-service-ca\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:19.190862 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:19.190827 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9" event={"ID":"14b4c6f4-e107-498a-8967-a8a9628ea72a","Type":"ContainerDied","Data":"18a482d479e727842a4caf0c920b40aecfdefc91beb9b1babddd4255dd7fd58c"} Jul 29 16:00:19.190862 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:19.190862 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9" Jul 29 16:00:19.191064 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:19.190884 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18a482d479e727842a4caf0c920b40aecfdefc91beb9b1babddd4255dd7fd58c" Jul 29 16:00:26.204972 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:26.204934 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv"] Jul 29 16:00:26.210454 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:26.210427 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9750ef-29755680-9b2rv"] Jul 29 16:00:26.210624 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:26.210604 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:26.289194 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:26.289167 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:26.362803 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:26.362770 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:26.441146 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:26.441107 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9"] Jul 29 16:00:26.443103 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:26.443074 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9750ef-lrpj9"] Jul 29 16:00:26.446499 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:26.446466 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:26.590622 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:26.590543 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14b4c6f4-e107-498a-8967-a8a9628ea72a" path="/var/lib/kubelet/pods/14b4c6f4-e107-498a-8967-a8a9628ea72a/volumes" Jul 29 16:00:26.590852 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:26.590838 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a656c28-75ff-4e05-a88d-2cac8d674ba6" path="/var/lib/kubelet/pods/2a656c28-75ff-4e05-a88d-2cac8d674ba6/volumes" Jul 29 16:00:26.852903 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:26.852783 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:33.129934 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:33.129901 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:33.213150 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:33.213113 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:33.424247 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:33.424173 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd"] Jul 29 16:00:33.424401 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:33.424381 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" containerName="istio-proxy" containerID="cri-o://d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4" gracePeriod=30 Jul 29 16:00:33.452536 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:33.452473 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:33.718873 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:33.718836 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:38.680362 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.680338 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 16:00:38.785989 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.785905 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-workload-certs\") pod \"32370b17-b2e0-47fa-bbe5-187e81602956\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " Jul 29 16:00:38.785989 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.785950 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32370b17-b2e0-47fa-bbe5-187e81602956-istio-podinfo\") pod \"32370b17-b2e0-47fa-bbe5-187e81602956\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " Jul 29 16:00:38.786184 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786003 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkn4x\" (UniqueName: \"kubernetes.io/projected/32370b17-b2e0-47fa-bbe5-187e81602956-kube-api-access-xkn4x\") pod \"32370b17-b2e0-47fa-bbe5-187e81602956\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " Jul 29 16:00:38.786184 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786034 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32370b17-b2e0-47fa-bbe5-187e81602956-istiod-ca-cert\") pod \"32370b17-b2e0-47fa-bbe5-187e81602956\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " Jul 29 16:00:38.786184 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786068 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-istio-envoy\") pod \"32370b17-b2e0-47fa-bbe5-187e81602956\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " Jul 29 16:00:38.786184 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786132 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32370b17-b2e0-47fa-bbe5-187e81602956-istio-token\") pod \"32370b17-b2e0-47fa-bbe5-187e81602956\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " Jul 29 16:00:38.786368 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786197 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-istio-data\") pod \"32370b17-b2e0-47fa-bbe5-187e81602956\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " Jul 29 16:00:38.786368 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786213 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "32370b17-b2e0-47fa-bbe5-187e81602956" (UID: "32370b17-b2e0-47fa-bbe5-187e81602956"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:00:38.786368 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786231 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-credential-socket\") pod \"32370b17-b2e0-47fa-bbe5-187e81602956\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " Jul 29 16:00:38.786368 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786262 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-workload-socket\") pod \"32370b17-b2e0-47fa-bbe5-187e81602956\" (UID: \"32370b17-b2e0-47fa-bbe5-187e81602956\") " Jul 29 16:00:38.786617 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786555 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "32370b17-b2e0-47fa-bbe5-187e81602956" (UID: "32370b17-b2e0-47fa-bbe5-187e81602956"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:00:38.786676 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786611 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32370b17-b2e0-47fa-bbe5-187e81602956-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "32370b17-b2e0-47fa-bbe5-187e81602956" (UID: "32370b17-b2e0-47fa-bbe5-187e81602956"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:00:38.786733 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786688 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:38.786786 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786742 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:38.786786 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.786767 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "32370b17-b2e0-47fa-bbe5-187e81602956" (UID: "32370b17-b2e0-47fa-bbe5-187e81602956"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:00:38.787230 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.787205 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-istio-data" (OuterVolumeSpecName: "istio-data") pod "32370b17-b2e0-47fa-bbe5-187e81602956" (UID: "32370b17-b2e0-47fa-bbe5-187e81602956"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:00:38.788281 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.788260 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32370b17-b2e0-47fa-bbe5-187e81602956-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "32370b17-b2e0-47fa-bbe5-187e81602956" (UID: "32370b17-b2e0-47fa-bbe5-187e81602956"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 16:00:38.788496 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.788481 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "32370b17-b2e0-47fa-bbe5-187e81602956" (UID: "32370b17-b2e0-47fa-bbe5-187e81602956"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:00:38.788652 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.788634 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32370b17-b2e0-47fa-bbe5-187e81602956-kube-api-access-xkn4x" (OuterVolumeSpecName: "kube-api-access-xkn4x") pod "32370b17-b2e0-47fa-bbe5-187e81602956" (UID: "32370b17-b2e0-47fa-bbe5-187e81602956"). InnerVolumeSpecName "kube-api-access-xkn4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:00:38.788698 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.788660 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32370b17-b2e0-47fa-bbe5-187e81602956-istio-token" (OuterVolumeSpecName: "istio-token") pod "32370b17-b2e0-47fa-bbe5-187e81602956" (UID: "32370b17-b2e0-47fa-bbe5-187e81602956"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:00:38.888154 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.888115 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32370b17-b2e0-47fa-bbe5-187e81602956-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:38.888154 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.888146 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:38.888154 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.888161 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:38.888402 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.888175 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32370b17-b2e0-47fa-bbe5-187e81602956-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:38.888402 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.888187 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkn4x\" (UniqueName: \"kubernetes.io/projected/32370b17-b2e0-47fa-bbe5-187e81602956-kube-api-access-xkn4x\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:38.888402 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.888200 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32370b17-b2e0-47fa-bbe5-187e81602956-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:38.888402 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:38.888210 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32370b17-b2e0-47fa-bbe5-187e81602956-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:39.059245 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.059162 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq"] Jul 29 16:00:39.063437 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.063415 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dfc210-29755680-7b8zq"] Jul 29 16:00:39.068064 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.068043 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:39.169643 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.169611 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:39.268916 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.268868 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:39.293745 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.293711 2554 generic.go:356] "Generic (PLEG): container finished" podID="32370b17-b2e0-47fa-bbe5-187e81602956" containerID="d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4" exitCode=0 Jul 29 16:00:39.293931 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.293762 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" Jul 29 16:00:39.293931 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.293794 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" event={"ID":"32370b17-b2e0-47fa-bbe5-187e81602956","Type":"ContainerDied","Data":"d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4"} Jul 29 16:00:39.293931 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.293845 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd" event={"ID":"32370b17-b2e0-47fa-bbe5-187e81602956","Type":"ContainerDied","Data":"dd50b8ce567de85ef39c6835f7c99243dd904b693263195f43e7b740000c21b5"} Jul 29 16:00:39.293931 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.293876 2554 scope.go:117] "RemoveContainer" containerID="d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4" Jul 29 16:00:39.306110 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.306094 2554 scope.go:117] "RemoveContainer" containerID="b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958" Jul 29 16:00:39.314743 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.314727 2554 scope.go:117] "RemoveContainer" containerID="d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4" Jul 29 16:00:39.315012 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:00:39.314994 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4\": container with ID starting with d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4 not found: ID does not exist" containerID="d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4" Jul 29 16:00:39.315065 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.315021 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4"} err="failed to get container status \"d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4\": rpc error: code = NotFound desc = could not find container \"d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4\": container with ID starting with d374f812507950e5a854f2d75aa301c3f24d0b4e6c7c108957c0e77a9c726dc4 not found: ID does not exist" Jul 29 16:00:39.315065 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.315046 2554 scope.go:117] "RemoveContainer" containerID="b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958" Jul 29 16:00:39.315239 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:00:39.315220 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958\": container with ID starting with b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958 not found: ID does not exist" containerID="b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958" Jul 29 16:00:39.315305 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.315245 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958"} err="failed to get container status \"b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958\": rpc error: code = NotFound desc = could not find container \"b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958\": container with ID starting with b96f9ba29cd1655acfd46cc3544cbf0ec17567850057dfa99ebb036bdb1f9958 not found: ID does not exist" Jul 29 16:00:39.323383 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.323363 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd"] Jul 29 16:00:39.328207 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.328190 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-9750ef-openshift-default-7d7bfc569d-lbbsd"] Jul 29 16:00:39.335472 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.335451 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:39.662337 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:39.662250 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:40.589624 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:40.589588 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="011b03ef-8c6b-4214-bd09-91f777b3a956" path="/var/lib/kubelet/pods/011b03ef-8c6b-4214-bd09-91f777b3a956/volumes" Jul 29 16:00:40.590008 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:40.589994 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" path="/var/lib/kubelet/pods/32370b17-b2e0-47fa-bbe5-187e81602956/volumes" Jul 29 16:00:45.858964 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:45.858921 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:45.935559 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:45.935508 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:46.128174 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:46.128096 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8"] Jul 29 16:00:46.128344 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:46.128320 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" containerName="istio-proxy" containerID="cri-o://8d84304f8a44cb5c5270e0c7cabf25046b401f5b171e7a1b0b74df87a2afc95c" gracePeriod=30 Jul 29 16:00:46.153796 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:46.153769 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:46.387496 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:46.387402 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:46.752791 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:46.752748 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:47.098914 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.098833 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr"] Jul 29 16:00:47.099296 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.099207 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" containerName="istio-proxy" Jul 29 16:00:47.099296 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.099217 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" containerName="istio-proxy" Jul 29 16:00:47.099296 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.099228 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14b4c6f4-e107-498a-8967-a8a9628ea72a" containerName="revoke-keys" Jul 29 16:00:47.099296 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.099234 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="14b4c6f4-e107-498a-8967-a8a9628ea72a" containerName="revoke-keys" Jul 29 16:00:47.099296 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.099249 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" containerName="istio-proxy" Jul 29 16:00:47.099296 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.099254 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" containerName="istio-proxy" Jul 29 16:00:47.099507 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.099338 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="14b4c6f4-e107-498a-8967-a8a9628ea72a" containerName="revoke-keys" Jul 29 16:00:47.099507 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.099349 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" containerName="istio-proxy" Jul 29 16:00:47.099507 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.099355 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="32370b17-b2e0-47fa-bbe5-187e81602956" containerName="istio-proxy" Jul 29 16:00:47.103890 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.103872 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.112254 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.112231 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-31add0-openshift-default-dockercfg-xd9mf\"" Jul 29 16:00:47.119316 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.119289 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:47.120314 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.120292 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr"] Jul 29 16:00:47.163354 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.163321 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-workload-certs\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.163665 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.163635 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e56a2c-f247-457f-99f6-e2940fe10226-istio-podinfo\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.163801 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.163720 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x55m7\" (UniqueName: \"kubernetes.io/projected/37e56a2c-f247-457f-99f6-e2940fe10226-kube-api-access-x55m7\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.163801 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.163753 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37e56a2c-f247-457f-99f6-e2940fe10226-istio-token\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.163801 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.163774 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-istio-envoy\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.163969 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.163857 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-workload-socket\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.163969 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.163883 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e56a2c-f247-457f-99f6-e2940fe10226-istiod-ca-cert\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.163969 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.163907 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-istio-data\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.163969 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.163956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-credential-socket\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.264896 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.264851 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-istio-envoy\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265096 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.264920 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-workload-socket\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265096 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.264948 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e56a2c-f247-457f-99f6-e2940fe10226-istiod-ca-cert\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265096 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.264981 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-istio-data\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265096 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.265018 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-credential-socket\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265096 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.265066 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-workload-certs\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265355 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.265115 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e56a2c-f247-457f-99f6-e2940fe10226-istio-podinfo\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265355 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.265177 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x55m7\" (UniqueName: \"kubernetes.io/projected/37e56a2c-f247-457f-99f6-e2940fe10226-kube-api-access-x55m7\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265355 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.265204 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37e56a2c-f247-457f-99f6-e2940fe10226-istio-token\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265508 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.265385 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-workload-socket\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265639 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.265620 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-credential-socket\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265786 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.265760 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e56a2c-f247-457f-99f6-e2940fe10226-istiod-ca-cert\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265866 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.265844 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-workload-certs\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.265927 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.265891 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-istio-data\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.267363 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.267338 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-istio-envoy\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.267779 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.267758 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e56a2c-f247-457f-99f6-e2940fe10226-istio-podinfo\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.276164 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.276138 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x55m7\" (UniqueName: \"kubernetes.io/projected/37e56a2c-f247-457f-99f6-e2940fe10226-kube-api-access-x55m7\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.276329 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.276311 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37e56a2c-f247-457f-99f6-e2940fe10226-istio-token\") pod \"e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.414132 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.414028 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:47.445502 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.445460 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:47.566949 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.566926 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr"] Jul 29 16:00:47.567658 ip-10-0-130-249 kubenswrapper[2554]: W0729 16:00:47.567632 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e56a2c_f247_457f_99f6_e2940fe10226.slice/crio-00a5d302fd7c1963facced9231f1d251a614ab66403ceba1155979f5f42e7701 WatchSource:0}: Error finding container 00a5d302fd7c1963facced9231f1d251a614ab66403ceba1155979f5f42e7701: Status 404 returned error can't find the container with id 00a5d302fd7c1963facced9231f1d251a614ab66403ceba1155979f5f42e7701 Jul 29 16:00:47.569729 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.569694 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:00:47.569815 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.569764 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:00:47.569815 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:47.569796 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:00:48.341127 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:48.341093 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" event={"ID":"37e56a2c-f247-457f-99f6-e2940fe10226","Type":"ContainerStarted","Data":"93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2"} Jul 29 16:00:48.341622 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:48.341153 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" event={"ID":"37e56a2c-f247-457f-99f6-e2940fe10226","Type":"ContainerStarted","Data":"00a5d302fd7c1963facced9231f1d251a614ab66403ceba1155979f5f42e7701"} Jul 29 16:00:48.363671 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:48.363620 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" podStartSLOduration=1.363606638 podStartE2EDuration="1.363606638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:00:48.362817121 +0000 UTC m=+2976.349158707" watchObservedRunningTime="2026-07-29 16:00:48.363606638 +0000 UTC m=+2976.349948220" Jul 29 16:00:48.414390 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:48.414355 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:48.415904 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:48.415881 2554 patch_prober.go:28] interesting pod/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 29 16:00:48.416031 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:48.415927 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 29 16:00:49.419429 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:49.419398 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:50.351848 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:50.351815 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:50.352871 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:50.352852 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:00:50.356183 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:50.356161 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:50.456443 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:50.456417 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:50.553643 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:50.553605 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:50.660783 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:50.660701 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:51.169851 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.169820 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:51.271339 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.271306 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:00:51.359517 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.359487 2554 generic.go:356] "Generic (PLEG): container finished" podID="dd27a911-6281-4b51-8a77-ac10d787b224" containerID="8d84304f8a44cb5c5270e0c7cabf25046b401f5b171e7a1b0b74df87a2afc95c" exitCode=0 Jul 29 16:00:51.359726 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.359556 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" event={"ID":"dd27a911-6281-4b51-8a77-ac10d787b224","Type":"ContainerDied","Data":"8d84304f8a44cb5c5270e0c7cabf25046b401f5b171e7a1b0b74df87a2afc95c"} Jul 29 16:00:51.359726 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.359621 2554 scope.go:117] "RemoveContainer" containerID="aa4fa642849f0b9e25267d5c301ae3fbdfe564898380eed764235569716ac199" Jul 29 16:00:51.399829 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.399743 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 16:00:51.507209 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.507173 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd27a911-6281-4b51-8a77-ac10d787b224-istio-podinfo\") pod \"dd27a911-6281-4b51-8a77-ac10d787b224\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " Jul 29 16:00:51.507209 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.507214 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-workload-socket\") pod \"dd27a911-6281-4b51-8a77-ac10d787b224\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " Jul 29 16:00:51.507803 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.507235 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd27a911-6281-4b51-8a77-ac10d787b224-istio-token\") pod \"dd27a911-6281-4b51-8a77-ac10d787b224\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " Jul 29 16:00:51.507803 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.507336 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-istio-envoy\") pod \"dd27a911-6281-4b51-8a77-ac10d787b224\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " Jul 29 16:00:51.507803 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.507388 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzg6b\" (UniqueName: \"kubernetes.io/projected/dd27a911-6281-4b51-8a77-ac10d787b224-kube-api-access-wzg6b\") pod \"dd27a911-6281-4b51-8a77-ac10d787b224\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " Jul 29 16:00:51.507803 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.507412 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-workload-certs\") pod \"dd27a911-6281-4b51-8a77-ac10d787b224\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " Jul 29 16:00:51.507803 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.507456 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-istio-data\") pod \"dd27a911-6281-4b51-8a77-ac10d787b224\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " Jul 29 16:00:51.507803 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.507508 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-credential-socket\") pod \"dd27a911-6281-4b51-8a77-ac10d787b224\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " Jul 29 16:00:51.507803 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.507553 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd27a911-6281-4b51-8a77-ac10d787b224" (UID: "dd27a911-6281-4b51-8a77-ac10d787b224"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:00:51.507803 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.507564 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd27a911-6281-4b51-8a77-ac10d787b224-istiod-ca-cert\") pod \"dd27a911-6281-4b51-8a77-ac10d787b224\" (UID: \"dd27a911-6281-4b51-8a77-ac10d787b224\") " Jul 29 16:00:51.507803 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.507724 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd27a911-6281-4b51-8a77-ac10d787b224" (UID: "dd27a911-6281-4b51-8a77-ac10d787b224"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:00:51.507803 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.507782 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd27a911-6281-4b51-8a77-ac10d787b224" (UID: "dd27a911-6281-4b51-8a77-ac10d787b224"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:00:51.508319 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.508027 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:51.508319 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.508048 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:51.508319 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.508060 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd27a911-6281-4b51-8a77-ac10d787b224-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd27a911-6281-4b51-8a77-ac10d787b224" (UID: "dd27a911-6281-4b51-8a77-ac10d787b224"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:00:51.508319 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.508064 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:51.508559 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.508484 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd27a911-6281-4b51-8a77-ac10d787b224" (UID: "dd27a911-6281-4b51-8a77-ac10d787b224"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:00:51.509756 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.509731 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd27a911-6281-4b51-8a77-ac10d787b224-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd27a911-6281-4b51-8a77-ac10d787b224" (UID: "dd27a911-6281-4b51-8a77-ac10d787b224"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 16:00:51.509876 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.509754 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd27a911-6281-4b51-8a77-ac10d787b224-kube-api-access-wzg6b" (OuterVolumeSpecName: "kube-api-access-wzg6b") pod "dd27a911-6281-4b51-8a77-ac10d787b224" (UID: "dd27a911-6281-4b51-8a77-ac10d787b224"). InnerVolumeSpecName "kube-api-access-wzg6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:00:51.509876 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.509733 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd27a911-6281-4b51-8a77-ac10d787b224" (UID: "dd27a911-6281-4b51-8a77-ac10d787b224"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:00:51.510139 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.510124 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd27a911-6281-4b51-8a77-ac10d787b224-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd27a911-6281-4b51-8a77-ac10d787b224" (UID: "dd27a911-6281-4b51-8a77-ac10d787b224"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:00:51.608798 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.608766 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:51.608798 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.608791 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzg6b\" (UniqueName: \"kubernetes.io/projected/dd27a911-6281-4b51-8a77-ac10d787b224-kube-api-access-wzg6b\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:51.608798 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.608801 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd27a911-6281-4b51-8a77-ac10d787b224-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:51.608798 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.608810 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd27a911-6281-4b51-8a77-ac10d787b224-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:51.609067 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.608817 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd27a911-6281-4b51-8a77-ac10d787b224-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:51.609067 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:51.608825 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd27a911-6281-4b51-8a77-ac10d787b224-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:00:52.365219 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:52.365187 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" Jul 29 16:00:52.365387 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:52.365223 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8" event={"ID":"dd27a911-6281-4b51-8a77-ac10d787b224","Type":"ContainerDied","Data":"1b3f3786b0be95c996d7fec2da6788d9d83b6efa5e604c52297b17426e6ab953"} Jul 29 16:00:52.365387 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:52.365274 2554 scope.go:117] "RemoveContainer" containerID="8d84304f8a44cb5c5270e0c7cabf25046b401f5b171e7a1b0b74df87a2afc95c" Jul 29 16:00:52.390585 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:52.390554 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8"] Jul 29 16:00:52.394978 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:52.394954 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-dfc210-openshift-default-74dc84dcbd-6p5d8"] Jul 29 16:00:52.590376 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:00:52.590339 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" path="/var/lib/kubelet/pods/dd27a911-6281-4b51-8a77-ac10d787b224/volumes" Jul 29 16:01:04.438133 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:04.438099 2554 generic.go:356] "Generic (PLEG): container finished" podID="37e56a2c-f247-457f-99f6-e2940fe10226" containerID="93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2" exitCode=0 Jul 29 16:01:04.438585 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:04.438173 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" event={"ID":"37e56a2c-f247-457f-99f6-e2940fe10226","Type":"ContainerDied","Data":"93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2"} Jul 29 16:01:04.438659 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:04.438596 2554 scope.go:117] "RemoveContainer" containerID="93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2" Jul 29 16:01:04.439674 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:04.439645 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:01:04.439748 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:04.439711 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:01:04.439748 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:04.439742 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:01:05.352071 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:05.352030 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:01:05.444561 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:05.444514 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" event={"ID":"37e56a2c-f247-457f-99f6-e2940fe10226","Type":"ContainerStarted","Data":"4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50"} Jul 29 16:01:06.414736 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:06.414697 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:01:06.415961 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:06.415934 2554 patch_prober.go:28] interesting pod/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 29 16:01:06.416085 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:06.415983 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 29 16:01:07.414796 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:07.414757 2554 patch_prober.go:28] interesting pod/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 29 16:01:07.415196 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:07.414814 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 29 16:01:08.415292 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:08.415244 2554 patch_prober.go:28] interesting pod/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 29 16:01:08.415728 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:08.415323 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 29 16:01:09.415339 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:09.415296 2554 patch_prober.go:28] interesting pod/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 29 16:01:09.415835 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:09.415361 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 29 16:01:10.419079 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:10.419047 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:01:10.419455 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:10.419415 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:01:10.420013 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:10.419993 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:01:12.788131 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:12.788094 2554 scope.go:117] "RemoveContainer" containerID="16f87ec5a097e03a0d560782b508b28fa70c3c70e9ec1ab718deae035e405616" Jul 29 16:01:15.404416 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:15.404380 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:01:15.922806 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:15.922777 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:01:16.218249 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.218216 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7"] Jul 29 16:01:16.218719 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.218701 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" containerName="istio-proxy" Jul 29 16:01:16.218835 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.218721 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" containerName="istio-proxy" Jul 29 16:01:16.218835 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.218732 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" containerName="istio-proxy" Jul 29 16:01:16.218835 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.218740 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" containerName="istio-proxy" Jul 29 16:01:16.218988 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.218860 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" containerName="istio-proxy" Jul 29 16:01:16.218988 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.218874 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd27a911-6281-4b51-8a77-ac10d787b224" containerName="istio-proxy" Jul 29 16:01:16.223474 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.223447 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.226468 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.226447 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e5a566-openshift-default-dockercfg-tdm68\"" Jul 29 16:01:16.236255 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.236232 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7"] Jul 29 16:01:16.245837 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.245804 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-envoy\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.245951 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.245862 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptf6l\" (UniqueName: \"kubernetes.io/projected/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-kube-api-access-ptf6l\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.245951 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.245933 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-token\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.246040 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.245977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istiod-ca-cert\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.246040 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.246018 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-workload-certs\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.246123 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.246049 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-workload-socket\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.246123 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.246079 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-credential-socket\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.246123 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.246117 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-podinfo\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.246218 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.246162 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-data\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.259827 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.259797 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:01:16.347302 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.347267 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-podinfo\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.347514 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.347334 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-data\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.347514 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.347370 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-envoy\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.347514 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.347413 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptf6l\" (UniqueName: \"kubernetes.io/projected/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-kube-api-access-ptf6l\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.347514 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.347461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-token\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.347760 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.347661 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istiod-ca-cert\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.347760 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.347725 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-workload-certs\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.347870 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.347762 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-workload-socket\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.347870 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.347809 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-credential-socket\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.347870 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.347827 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-data\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.348077 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.348053 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-workload-certs\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.348159 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.348138 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-workload-socket\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.348212 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.348191 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-credential-socket\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.348395 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.348377 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istiod-ca-cert\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.350045 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.350025 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-envoy\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.350137 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.350066 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-podinfo\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.357637 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.357604 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-token\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.357812 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.357794 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptf6l\" (UniqueName: \"kubernetes.io/projected/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-kube-api-access-ptf6l\") pod \"e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.536297 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.536202 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:16.679715 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.679685 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7"] Jul 29 16:01:16.681700 ip-10-0-130-249 kubenswrapper[2554]: W0729 16:01:16.681670 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36935e3b_cdd3_4ca7_8272_0c1b3b8cd148.slice/crio-3f432699391487975f7478ba83cfe4e6c2dcfba715afb7a61c58bcfbfcda7dd2 WatchSource:0}: Error finding container 3f432699391487975f7478ba83cfe4e6c2dcfba715afb7a61c58bcfbfcda7dd2: Status 404 returned error can't find the container with id 3f432699391487975f7478ba83cfe4e6c2dcfba715afb7a61c58bcfbfcda7dd2 Jul 29 16:01:16.684036 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.684005 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:01:16.684126 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.684069 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:01:16.684126 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:16.684096 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:01:17.141170 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:17.141132 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:01:17.506360 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:17.506321 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" event={"ID":"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148","Type":"ContainerStarted","Data":"ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b"} Jul 29 16:01:17.506595 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:17.506378 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" event={"ID":"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148","Type":"ContainerStarted","Data":"3f432699391487975f7478ba83cfe4e6c2dcfba715afb7a61c58bcfbfcda7dd2"} Jul 29 16:01:17.536806 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:17.536756 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" podStartSLOduration=1.536739733 podStartE2EDuration="1.536739733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:01:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:01:17.53451464 +0000 UTC m=+3005.520856495" watchObservedRunningTime="2026-07-29 16:01:17.536739733 +0000 UTC m=+3005.523081317" Jul 29 16:01:17.537207 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:17.537187 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:17.542146 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:17.542121 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:18.511455 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:18.511421 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:18.512657 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:18.512632 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:19.602921 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:19.602891 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:01:19.699680 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:19.699643 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:01:19.935785 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:19.935747 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:01:20.178929 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:20.178897 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:01:20.638825 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:20.638790 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:01:20.741974 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:20.741945 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:01:31.573856 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:31.573821 2554 generic.go:356] "Generic (PLEG): container finished" podID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerID="ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b" exitCode=0 Jul 29 16:01:31.574272 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:31.573895 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" event={"ID":"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148","Type":"ContainerDied","Data":"ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b"} Jul 29 16:01:31.574322 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:31.574301 2554 scope.go:117] "RemoveContainer" containerID="ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b" Jul 29 16:01:31.575288 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:31.575261 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:01:31.575393 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:31.575324 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:01:31.575393 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:31.575354 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:01:32.582170 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:32.582135 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" event={"ID":"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148","Type":"ContainerStarted","Data":"4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39"} Jul 29 16:01:33.492104 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:33.492055 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:01:33.511715 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:33.511680 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:33.537084 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:33.537054 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:33.538477 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:33.538452 2554 patch_prober.go:28] interesting pod/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 29 16:01:33.538600 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:33.538509 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 29 16:01:33.591242 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:33.591213 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:01:34.537541 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:34.537488 2554 patch_prober.go:28] interesting pod/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 29 16:01:34.537748 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:34.537615 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 29 16:01:35.537211 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:35.537175 2554 patch_prober.go:28] interesting pod/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 29 16:01:35.537645 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:35.537227 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 29 16:01:36.536593 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:36.536555 2554 patch_prober.go:28] interesting pod/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 29 16:01:36.536777 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:36.536636 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 29 16:01:37.540763 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:37.540729 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:37.541749 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:37.541730 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:01:44.617753 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:01:44.617720 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:03.271907 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:03.271867 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:04.960601 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:04.960572 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:05.024578 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:05.024537 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:10.117883 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:10.117850 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:10.249441 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:10.249402 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:10.411256 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:10.411170 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr"] Jul 29 16:02:10.411449 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:10.411405 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" containerID="cri-o://4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50" gracePeriod=30 Jul 29 16:02:10.421816 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:10.421786 2554 patch_prober.go:28] interesting pod/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 29 16:02:10.421938 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:10.421839 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 16:02:10.432057 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:10.432031 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:10.666219 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:10.666128 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:15.654143 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.654117 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:02:15.809549 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.809499 2554 generic.go:356] "Generic (PLEG): container finished" podID="37e56a2c-f247-457f-99f6-e2940fe10226" containerID="4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50" exitCode=0 Jul 29 16:02:15.809720 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.809566 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" event={"ID":"37e56a2c-f247-457f-99f6-e2940fe10226","Type":"ContainerDied","Data":"4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50"} Jul 29 16:02:15.809720 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.809568 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" Jul 29 16:02:15.809720 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.809609 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr" event={"ID":"37e56a2c-f247-457f-99f6-e2940fe10226","Type":"ContainerDied","Data":"00a5d302fd7c1963facced9231f1d251a614ab66403ceba1155979f5f42e7701"} Jul 29 16:02:15.809720 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.809631 2554 scope.go:117] "RemoveContainer" containerID="4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50" Jul 29 16:02:15.818268 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.818248 2554 scope.go:117] "RemoveContainer" containerID="93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2" Jul 29 16:02:15.825618 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.825599 2554 scope.go:117] "RemoveContainer" containerID="4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50" Jul 29 16:02:15.825854 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:02:15.825833 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50\": container with ID starting with 4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50 not found: ID does not exist" containerID="4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50" Jul 29 16:02:15.825925 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.825863 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50"} err="failed to get container status \"4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50\": rpc error: code = NotFound desc = could not find container \"4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50\": container with ID starting with 4b77b995d3f9f6f4dc3adba7f44e5e65a1890dab769f9e526ffd52ea3217fd50 not found: ID does not exist" Jul 29 16:02:15.825925 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.825879 2554 scope.go:117] "RemoveContainer" containerID="93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2" Jul 29 16:02:15.826137 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:02:15.826119 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2\": container with ID starting with 93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2 not found: ID does not exist" containerID="93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2" Jul 29 16:02:15.826188 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.826142 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2"} err="failed to get container status \"93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2\": rpc error: code = NotFound desc = could not find container \"93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2\": container with ID starting with 93974bd302db4edfb7adf63bd10727dbfd44c51b532ba0b378270ce44f9405e2 not found: ID does not exist" Jul 29 16:02:15.828441 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.828423 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e56a2c-f247-457f-99f6-e2940fe10226-istiod-ca-cert\") pod \"37e56a2c-f247-457f-99f6-e2940fe10226\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " Jul 29 16:02:15.828646 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.828462 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-workload-certs\") pod \"37e56a2c-f247-457f-99f6-e2940fe10226\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " Jul 29 16:02:15.828646 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.828490 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-istio-data\") pod \"37e56a2c-f247-457f-99f6-e2940fe10226\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " Jul 29 16:02:15.828646 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.828598 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37e56a2c-f247-457f-99f6-e2940fe10226-istio-token\") pod \"37e56a2c-f247-457f-99f6-e2940fe10226\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " Jul 29 16:02:15.828646 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.828635 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-istio-envoy\") pod \"37e56a2c-f247-457f-99f6-e2940fe10226\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " Jul 29 16:02:15.828866 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.828680 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-credential-socket\") pod \"37e56a2c-f247-457f-99f6-e2940fe10226\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " Jul 29 16:02:15.828866 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.828723 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37e56a2c-f247-457f-99f6-e2940fe10226" (UID: "37e56a2c-f247-457f-99f6-e2940fe10226"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:02:15.828866 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.828756 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e56a2c-f247-457f-99f6-e2940fe10226-istio-podinfo\") pod \"37e56a2c-f247-457f-99f6-e2940fe10226\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " Jul 29 16:02:15.828866 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.828786 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x55m7\" (UniqueName: \"kubernetes.io/projected/37e56a2c-f247-457f-99f6-e2940fe10226-kube-api-access-x55m7\") pod \"37e56a2c-f247-457f-99f6-e2940fe10226\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " Jul 29 16:02:15.828866 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.828808 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37e56a2c-f247-457f-99f6-e2940fe10226-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37e56a2c-f247-457f-99f6-e2940fe10226" (UID: "37e56a2c-f247-457f-99f6-e2940fe10226"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:02:15.828866 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.828818 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-workload-socket\") pod \"37e56a2c-f247-457f-99f6-e2940fe10226\" (UID: \"37e56a2c-f247-457f-99f6-e2940fe10226\") " Jul 29 16:02:15.829160 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.828947 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37e56a2c-f247-457f-99f6-e2940fe10226" (UID: "37e56a2c-f247-457f-99f6-e2940fe10226"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:02:15.829215 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.829155 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37e56a2c-f247-457f-99f6-e2940fe10226" (UID: "37e56a2c-f247-457f-99f6-e2940fe10226"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:02:15.829215 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.829204 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:15.829300 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.829226 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e56a2c-f247-457f-99f6-e2940fe10226-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:15.829300 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.829239 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:15.829300 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.829267 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-istio-data" (OuterVolumeSpecName: "istio-data") pod "37e56a2c-f247-457f-99f6-e2940fe10226" (UID: "37e56a2c-f247-457f-99f6-e2940fe10226"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:02:15.830765 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.830742 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e56a2c-f247-457f-99f6-e2940fe10226-istio-token" (OuterVolumeSpecName: "istio-token") pod "37e56a2c-f247-457f-99f6-e2940fe10226" (UID: "37e56a2c-f247-457f-99f6-e2940fe10226"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:02:15.830901 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.830851 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37e56a2c-f247-457f-99f6-e2940fe10226-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37e56a2c-f247-457f-99f6-e2940fe10226" (UID: "37e56a2c-f247-457f-99f6-e2940fe10226"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 16:02:15.831066 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.831041 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37e56a2c-f247-457f-99f6-e2940fe10226" (UID: "37e56a2c-f247-457f-99f6-e2940fe10226"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:02:15.831128 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.831116 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e56a2c-f247-457f-99f6-e2940fe10226-kube-api-access-x55m7" (OuterVolumeSpecName: "kube-api-access-x55m7") pod "37e56a2c-f247-457f-99f6-e2940fe10226" (UID: "37e56a2c-f247-457f-99f6-e2940fe10226"). InnerVolumeSpecName "kube-api-access-x55m7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:02:15.930227 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.930184 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37e56a2c-f247-457f-99f6-e2940fe10226-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:15.930227 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.930223 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:15.930227 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.930232 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e56a2c-f247-457f-99f6-e2940fe10226-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:15.930227 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.930241 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x55m7\" (UniqueName: \"kubernetes.io/projected/37e56a2c-f247-457f-99f6-e2940fe10226-kube-api-access-x55m7\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:15.930486 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.930250 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:15.930486 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:15.930259 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e56a2c-f247-457f-99f6-e2940fe10226-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:16.133913 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:16.133879 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr"] Jul 29 16:02:16.140508 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:16.140487 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-31add0-openshift-default-7c7697cb6b-jqfjr"] Jul 29 16:02:16.590842 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:16.590812 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" path="/var/lib/kubelet/pods/37e56a2c-f247-457f-99f6-e2940fe10226/volumes" Jul 29 16:02:26.353279 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:26.353234 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:26.426314 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:26.426280 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:26.494229 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:26.494193 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:26.569832 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:26.569796 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:26.961244 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:26.961210 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:33.585176 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:33.585144 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:33.658123 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:33.658094 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:33.841897 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:33.841808 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7"] Jul 29 16:02:33.842058 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:33.842025 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerName="istio-proxy" containerID="cri-o://4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39" gracePeriod=30 Jul 29 16:02:33.892699 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:33.892664 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:33.995798 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:33.995754 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:34.149614 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.149517 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:34.471691 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.471662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:34.778796 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.778718 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk"] Jul 29 16:02:34.779253 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.779239 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" Jul 29 16:02:34.779296 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.779257 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" Jul 29 16:02:34.779296 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.779280 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" Jul 29 16:02:34.779296 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.779288 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" Jul 29 16:02:34.779390 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.779371 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" Jul 29 16:02:34.781684 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.781663 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:34.784155 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.784132 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-02add2-openshift-default-dockercfg-bklnv\"" Jul 29 16:02:34.795678 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.795656 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk"] Jul 29 16:02:34.815373 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.815351 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:34.899023 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.898987 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-workload-socket\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:34.899023 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.899022 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcmd9\" (UniqueName: \"kubernetes.io/projected/52583d21-6ef7-47b8-8915-cdda58af68f8-kube-api-access-gcmd9\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:34.899209 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.899076 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52583d21-6ef7-47b8-8915-cdda58af68f8-istiod-ca-cert\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:34.899209 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.899114 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-workload-certs\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:34.899209 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.899131 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-envoy\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:34.899209 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.899160 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-podinfo\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:34.899209 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.899184 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-data\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:34.899369 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.899213 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-token\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:34.899369 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:34.899234 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-credential-socket\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.000295 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.000265 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52583d21-6ef7-47b8-8915-cdda58af68f8-istiod-ca-cert\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.000295 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.000299 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-workload-certs\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.000569 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.000318 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-envoy\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.000569 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.000440 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-podinfo\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.000569 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.000477 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-data\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.000569 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.000499 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-token\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.000569 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.000548 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-credential-socket\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.000783 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.000617 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-workload-socket\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.000783 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.000681 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-workload-certs\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.000883 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.000801 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcmd9\" (UniqueName: \"kubernetes.io/projected/52583d21-6ef7-47b8-8915-cdda58af68f8-kube-api-access-gcmd9\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.001101 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.001076 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-data\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.001225 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.001119 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-credential-socket\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.001225 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.001156 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-workload-socket\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.001355 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.001295 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52583d21-6ef7-47b8-8915-cdda58af68f8-istiod-ca-cert\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.002781 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.002762 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-envoy\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.002878 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.002865 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-podinfo\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.009082 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.009059 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-token\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.009172 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.009089 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcmd9\" (UniqueName: \"kubernetes.io/projected/52583d21-6ef7-47b8-8915-cdda58af68f8-kube-api-access-gcmd9\") pod \"e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.026481 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.026462 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:35.091801 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.091730 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:35.226609 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.226582 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk"] Jul 29 16:02:35.229152 ip-10-0-130-249 kubenswrapper[2554]: W0729 16:02:35.229121 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52583d21_6ef7_47b8_8915_cdda58af68f8.slice/crio-45ce4fd956f10f3169b3e1dd12a1074e3c3596ec8a535af700620203ed0eed9f WatchSource:0}: Error finding container 45ce4fd956f10f3169b3e1dd12a1074e3c3596ec8a535af700620203ed0eed9f: Status 404 returned error can't find the container with id 45ce4fd956f10f3169b3e1dd12a1074e3c3596ec8a535af700620203ed0eed9f Jul 29 16:02:35.231461 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.231430 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:02:35.231537 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.231496 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:02:35.231591 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.231544 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:02:35.913829 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.913796 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" event={"ID":"52583d21-6ef7-47b8-8915-cdda58af68f8","Type":"ContainerStarted","Data":"86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79"} Jul 29 16:02:35.914214 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.913855 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" event={"ID":"52583d21-6ef7-47b8-8915-cdda58af68f8","Type":"ContainerStarted","Data":"45ce4fd956f10f3169b3e1dd12a1074e3c3596ec8a535af700620203ed0eed9f"} Jul 29 16:02:35.937563 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:35.937501 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" podStartSLOduration=1.937485719 podStartE2EDuration="1.937485719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:02:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:02:35.935395533 +0000 UTC m=+3083.921737130" watchObservedRunningTime="2026-07-29 16:02:35.937485719 +0000 UTC m=+3083.923827303" Jul 29 16:02:36.091923 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:36.091894 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:36.096730 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:36.096703 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:36.918541 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:36.918498 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:36.919570 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:36.919551 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:37.543494 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:37.543457 2554 patch_prober.go:28] interesting pod/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 29 16:02:37.543672 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:37.543557 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 16:02:37.898462 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:37.898381 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:37.981765 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:37.981736 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:38.081787 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:38.081755 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:38.269638 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:38.269608 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:38.681301 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:38.681272 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:38.779848 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:38.779817 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:02:39.095765 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.095739 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:02:39.145595 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.145571 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-podinfo\") pod \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " Jul 29 16:02:39.145764 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.145619 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-envoy\") pod \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " Jul 29 16:02:39.145764 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.145662 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-token\") pod \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " Jul 29 16:02:39.145764 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.145684 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-data\") pod \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " Jul 29 16:02:39.145764 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.145716 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-credential-socket\") pod \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " Jul 29 16:02:39.145969 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.145779 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-workload-socket\") pod \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " Jul 29 16:02:39.145969 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.145805 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-workload-certs\") pod \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " Jul 29 16:02:39.145969 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.145871 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptf6l\" (UniqueName: \"kubernetes.io/projected/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-kube-api-access-ptf6l\") pod \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " Jul 29 16:02:39.145969 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.145916 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istiod-ca-cert\") pod \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\" (UID: \"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148\") " Jul 29 16:02:39.146543 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.146246 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" (UID: "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:02:39.146543 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.146261 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" (UID: "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:02:39.146543 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.146486 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" (UID: "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:02:39.146777 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.146592 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" (UID: "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:02:39.146872 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.146842 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-data" (OuterVolumeSpecName: "istio-data") pod "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" (UID: "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:02:39.148112 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.148083 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" (UID: "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:02:39.148236 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.148217 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" (UID: "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 16:02:39.148816 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.148783 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-kube-api-access-ptf6l" (OuterVolumeSpecName: "kube-api-access-ptf6l") pod "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" (UID: "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148"). InnerVolumeSpecName "kube-api-access-ptf6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:02:39.148816 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.148799 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-token" (OuterVolumeSpecName: "istio-token") pod "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" (UID: "36935e3b-cdd3-4ca7-8272-0c1b3b8cd148"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:02:39.247643 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.247559 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:39.247643 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.247584 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:39.247643 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.247594 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:39.247643 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.247603 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:39.247643 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.247612 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:39.247643 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.247621 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:39.247643 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.247629 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptf6l\" (UniqueName: \"kubernetes.io/projected/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-kube-api-access-ptf6l\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:39.247643 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.247637 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:39.247643 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.247645 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:02:39.938376 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.938334 2554 generic.go:356] "Generic (PLEG): container finished" podID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerID="4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39" exitCode=0 Jul 29 16:02:39.938602 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.938394 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" Jul 29 16:02:39.938602 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.938418 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" event={"ID":"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148","Type":"ContainerDied","Data":"4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39"} Jul 29 16:02:39.938602 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.938485 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7" event={"ID":"36935e3b-cdd3-4ca7-8272-0c1b3b8cd148","Type":"ContainerDied","Data":"3f432699391487975f7478ba83cfe4e6c2dcfba715afb7a61c58bcfbfcda7dd2"} Jul 29 16:02:39.938602 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.938516 2554 scope.go:117] "RemoveContainer" containerID="4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39" Jul 29 16:02:39.948036 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.948017 2554 scope.go:117] "RemoveContainer" containerID="ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b" Jul 29 16:02:39.955848 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.955830 2554 scope.go:117] "RemoveContainer" containerID="4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39" Jul 29 16:02:39.956087 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:02:39.956069 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39\": container with ID starting with 4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39 not found: ID does not exist" containerID="4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39" Jul 29 16:02:39.956133 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.956097 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39"} err="failed to get container status \"4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39\": rpc error: code = NotFound desc = could not find container \"4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39\": container with ID starting with 4110edf922124ca9da9867cfc46c5dac15376b8cb2abbc5c3e667ba0115bca39 not found: ID does not exist" Jul 29 16:02:39.956133 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.956116 2554 scope.go:117] "RemoveContainer" containerID="ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b" Jul 29 16:02:39.956372 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:02:39.956354 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b\": container with ID starting with ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b not found: ID does not exist" containerID="ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b" Jul 29 16:02:39.956422 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.956377 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b"} err="failed to get container status \"ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b\": rpc error: code = NotFound desc = could not find container \"ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b\": container with ID starting with ea6ecee92e98979b1764a6a8e3c3eb825da0e49367f47a0a9af13fdd2984501b not found: ID does not exist" Jul 29 16:02:39.962160 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.962137 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7"] Jul 29 16:02:39.966450 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:39.966431 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e5a566-openshift-default-64d775b98b-bgzl7"] Jul 29 16:02:40.590069 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:40.590039 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" path="/var/lib/kubelet/pods/36935e3b-cdd3-4ca7-8272-0c1b3b8cd148/volumes" Jul 29 16:02:52.587976 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:52.587935 2554 patch_prober.go:28] interesting pod/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": read tcp 10.134.0.2:37930->10.134.0.45:15021: read: connection reset by peer" start-of-body= Jul 29 16:02:52.588410 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:52.588008 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": read tcp 10.134.0.2:37930->10.134.0.45:15021: read: connection reset by peer" Jul 29 16:02:53.003146 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:53.003109 2554 generic.go:356] "Generic (PLEG): container finished" podID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerID="86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79" exitCode=0 Jul 29 16:02:53.003327 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:53.003188 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" event={"ID":"52583d21-6ef7-47b8-8915-cdda58af68f8","Type":"ContainerDied","Data":"86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79"} Jul 29 16:02:53.003617 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:53.003603 2554 scope.go:117] "RemoveContainer" containerID="86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79" Jul 29 16:02:53.004715 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:53.004687 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:02:53.004787 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:53.004772 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:02:53.004826 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:53.004806 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:02:54.010409 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:54.010375 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" event={"ID":"52583d21-6ef7-47b8-8915-cdda58af68f8","Type":"ContainerStarted","Data":"838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e"} Jul 29 16:02:54.092705 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:54.092673 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:54.092959 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:54.092927 2554 patch_prober.go:28] interesting pod/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 29 16:02:54.093100 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:54.092985 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 29 16:02:55.093597 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:55.093105 2554 patch_prober.go:28] interesting pod/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 29 16:02:55.093597 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:55.093171 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 29 16:02:56.092868 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:56.092825 2554 patch_prober.go:28] interesting pod/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 29 16:02:56.093079 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:56.092894 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 29 16:02:57.092458 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:57.092414 2554 patch_prober.go:28] interesting pod/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 29 16:02:57.092984 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:57.092491 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 29 16:02:58.092969 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:58.092923 2554 patch_prober.go:28] interesting pod/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 29 16:02:58.093502 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:58.092996 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 29 16:02:59.096116 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:59.096086 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:59.096533 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:59.096337 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:02:59.097111 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:02:59.097091 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:03:02.952570 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:02.952515 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:03:03.324547 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.324432 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:03:03.635702 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.635627 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr"] Jul 29 16:03:03.636032 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.636019 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerName="istio-proxy" Jul 29 16:03:03.636078 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.636033 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerName="istio-proxy" Jul 29 16:03:03.636078 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.636056 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerName="istio-proxy" Jul 29 16:03:03.636078 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.636062 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerName="istio-proxy" Jul 29 16:03:03.636171 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.636115 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerName="istio-proxy" Jul 29 16:03:03.636171 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.636124 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="36935e3b-cdd3-4ca7-8272-0c1b3b8cd148" containerName="istio-proxy" Jul 29 16:03:03.636171 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.636133 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e56a2c-f247-457f-99f6-e2940fe10226" containerName="istio-proxy" Jul 29 16:03:03.638394 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.638379 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.641294 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.641271 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-7e5daf-openshift-default-dockercfg-kfhvh\"" Jul 29 16:03:03.655359 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.655339 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr"] Jul 29 16:03:03.668173 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.668147 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:03:03.683222 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.683194 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzn7v\" (UniqueName: \"kubernetes.io/projected/75f7c186-3a9b-47f1-80fa-88b1da816f1e-kube-api-access-xzn7v\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.683365 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.683232 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istiod-ca-cert\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.683365 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.683256 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-envoy\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.683491 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.683393 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-credential-socket\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.683491 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.683427 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-token\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.683491 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.683464 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-workload-certs\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.683677 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.683554 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-workload-socket\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.683677 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.683579 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-podinfo\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.683677 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.683604 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-data\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.784217 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784175 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzn7v\" (UniqueName: \"kubernetes.io/projected/75f7c186-3a9b-47f1-80fa-88b1da816f1e-kube-api-access-xzn7v\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.784428 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istiod-ca-cert\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.784428 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784259 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-envoy\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.784428 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784307 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-credential-socket\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.784428 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784330 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-token\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.784428 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784359 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-workload-certs\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.784428 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784421 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-workload-socket\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.784887 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784444 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-podinfo\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.784887 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784470 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-data\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.784887 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784863 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-workload-certs\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.785040 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784881 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-data\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.785040 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784956 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-workload-socket\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.785040 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.784990 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-credential-socket\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.785164 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.785040 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istiod-ca-cert\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.786786 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.786762 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-envoy\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.787092 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.787069 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-podinfo\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.793904 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.793878 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-token\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.794258 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.794234 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzn7v\" (UniqueName: \"kubernetes.io/projected/75f7c186-3a9b-47f1-80fa-88b1da816f1e-kube-api-access-xzn7v\") pod \"e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:03.948795 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:03.948750 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:04.090364 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:04.090341 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr"] Jul 29 16:03:04.093330 ip-10-0-130-249 kubenswrapper[2554]: W0729 16:03:04.093304 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f7c186_3a9b_47f1_80fa_88b1da816f1e.slice/crio-4e921d9aa4cdee239e8eab9e0cdcbc8373ffd05088e3380d8beac36b71c39e5a WatchSource:0}: Error finding container 4e921d9aa4cdee239e8eab9e0cdcbc8373ffd05088e3380d8beac36b71c39e5a: Status 404 returned error can't find the container with id 4e921d9aa4cdee239e8eab9e0cdcbc8373ffd05088e3380d8beac36b71c39e5a Jul 29 16:03:04.095822 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:04.095781 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:03:04.095912 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:04.095858 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:03:04.095912 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:04.095895 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:03:04.141009 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:04.140872 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:03:05.066561 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:05.066507 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" event={"ID":"75f7c186-3a9b-47f1-80fa-88b1da816f1e","Type":"ContainerStarted","Data":"24a484e19e78810b829c810537aa52726740f01405bbf0c304c27e823a3bf80a"} Jul 29 16:03:05.066746 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:05.066584 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" event={"ID":"75f7c186-3a9b-47f1-80fa-88b1da816f1e","Type":"ContainerStarted","Data":"4e921d9aa4cdee239e8eab9e0cdcbc8373ffd05088e3380d8beac36b71c39e5a"} Jul 29 16:03:05.092980 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:05.092928 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" podStartSLOduration=2.092913029 podStartE2EDuration="2.092913029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:03:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:03:05.091160997 +0000 UTC m=+3113.077502582" watchObservedRunningTime="2026-07-29 16:03:05.092913029 +0000 UTC m=+3113.079254614" Jul 29 16:03:05.949144 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:05.949110 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:05.953973 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:05.953951 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:06.071910 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:06.071887 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:06.072766 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:06.072747 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:07.142593 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:07.142559 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:03:07.235895 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:07.235844 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:03:07.334108 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:07.334061 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:03:07.557649 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:07.557617 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:03:07.973496 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:07.973468 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:03:08.103546 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:08.103497 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:03:22.113643 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:22.113606 2554 patch_prober.go:28] interesting pod/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 29 16:03:22.114072 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:22.113661 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" podUID="75f7c186-3a9b-47f1-80fa-88b1da816f1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 29 16:03:23.161776 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:23.161723 2554 generic.go:356] "Generic (PLEG): container finished" podID="75f7c186-3a9b-47f1-80fa-88b1da816f1e" containerID="24a484e19e78810b829c810537aa52726740f01405bbf0c304c27e823a3bf80a" exitCode=0 Jul 29 16:03:23.162115 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:23.161798 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" event={"ID":"75f7c186-3a9b-47f1-80fa-88b1da816f1e","Type":"ContainerDied","Data":"24a484e19e78810b829c810537aa52726740f01405bbf0c304c27e823a3bf80a"} Jul 29 16:03:23.162200 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:23.162184 2554 scope.go:117] "RemoveContainer" containerID="24a484e19e78810b829c810537aa52726740f01405bbf0c304c27e823a3bf80a" Jul 29 16:03:23.163302 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:23.163272 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:03:23.163372 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:23.163343 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:03:23.163416 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:23.163373 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:03:24.168909 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:24.168874 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" event={"ID":"75f7c186-3a9b-47f1-80fa-88b1da816f1e","Type":"ContainerStarted","Data":"da31563f416a3753ae3d42101586144d88f8fd2f4f1b0d3799e1b26fe55f8a9b"} Jul 29 16:03:24.949499 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:24.949467 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:24.949684 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:24.949668 2554 patch_prober.go:28] interesting pod/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 29 16:03:24.949735 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:24.949714 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" podUID="75f7c186-3a9b-47f1-80fa-88b1da816f1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 29 16:03:25.949878 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:25.949845 2554 patch_prober.go:28] interesting pod/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 29 16:03:25.950299 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:25.949897 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" podUID="75f7c186-3a9b-47f1-80fa-88b1da816f1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 29 16:03:26.949612 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:26.949574 2554 patch_prober.go:28] interesting pod/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 29 16:03:26.949785 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:26.949637 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" podUID="75f7c186-3a9b-47f1-80fa-88b1da816f1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 29 16:03:27.950180 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:27.950137 2554 patch_prober.go:28] interesting pod/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 29 16:03:27.950592 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:27.950209 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" podUID="75f7c186-3a9b-47f1-80fa-88b1da816f1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 29 16:03:28.952381 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:28.952350 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:28.952779 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:28.952716 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:28.953380 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:28.953363 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:03:32.197447 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:32.197408 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:03:46.722348 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:03:46.722314 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:04:17.255698 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:04:17.255662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:04:43.436172 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:04:43.436137 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:05:37.764474 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:05:37.764388 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:06:12.859011 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:06:12.858981 2554 scope.go:117] "RemoveContainer" containerID="f60f1d6106f7cd742274f825063aab818134798ce1709e807dedbba7026eff08" Jul 29 16:06:12.867448 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:06:12.867428 2554 scope.go:117] "RemoveContainer" containerID="84006755a4f6389b2b158911cb5f0aa6bacb4a758d456ef9bf4b315a191decaa" Jul 29 16:07:12.888956 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:07:12.888922 2554 scope.go:117] "RemoveContainer" containerID="385e75e4b53be2ce025eb3bdecb7b7b21a5e5b8932e597193f96eb847a35cb27" Jul 29 16:08:15.678725 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:08:15.678638 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:08:21.622743 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:08:21.622706 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:08:38.072450 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:08:38.072410 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:08:38.173626 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:08:38.173574 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:09:14.778593 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:09:14.778557 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:09:18.669684 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:09:18.669654 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:09:40.840264 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:09:40.840161 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:10:04.534494 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:10:04.534433 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:11:52.503254 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:11:52.503217 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:11:53.428309 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:11:53.428254 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:12:08.743214 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:12:08.743168 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:12:40.132840 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:12:40.132749 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:06.352585 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:06.352499 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:07.416801 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:07.416766 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:08.319982 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:08.319949 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:27.217483 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.217433 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:27.521385 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.521301 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j"] Jul 29 16:14:27.523832 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.523816 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.526318 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.526286 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-6fccfc-openshift-default-dockercfg-4znqh\"" Jul 29 16:14:27.539283 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.539258 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j"] Jul 29 16:14:27.605640 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.605587 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-workload-socket\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.605825 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.605707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-workload-certs\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.605825 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.605769 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v6cg\" (UniqueName: \"kubernetes.io/projected/4402f547-caca-4b79-aee3-bdd85acfd5ec-kube-api-access-8v6cg\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.605825 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.605823 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4402f547-caca-4b79-aee3-bdd85acfd5ec-istiod-ca-cert\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.606003 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.605849 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-envoy\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.606003 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.605877 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-credential-socket\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.606003 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.605902 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-data\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.606189 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.606000 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-podinfo\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.606189 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.606063 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-token\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.706742 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.706703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-workload-socket\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.706949 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.706754 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-workload-certs\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.706949 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.706772 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v6cg\" (UniqueName: \"kubernetes.io/projected/4402f547-caca-4b79-aee3-bdd85acfd5ec-kube-api-access-8v6cg\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.706949 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.706809 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4402f547-caca-4b79-aee3-bdd85acfd5ec-istiod-ca-cert\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.706949 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.706830 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-envoy\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.706949 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.706847 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-credential-socket\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.706949 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.706871 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-data\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.706949 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.706906 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-podinfo\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.706949 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.706948 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-token\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.707363 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.707176 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-workload-socket\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.707363 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.707265 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-workload-certs\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.707433 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.707382 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-data\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.707540 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.707502 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4402f547-caca-4b79-aee3-bdd85acfd5ec-istiod-ca-cert\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.707676 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.707505 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-credential-socket\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.709351 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.709330 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-envoy\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.709689 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.709668 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-podinfo\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.717917 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.717896 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-token\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.718101 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.718079 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v6cg\" (UniqueName: \"kubernetes.io/projected/4402f547-caca-4b79-aee3-bdd85acfd5ec-kube-api-access-8v6cg\") pod \"e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.835347 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.835275 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:27.982465 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.982437 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j"] Jul 29 16:14:27.984491 ip-10-0-130-249 kubenswrapper[2554]: W0729 16:14:27.984463 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4402f547_caca_4b79_aee3_bdd85acfd5ec.slice/crio-2d3e4e26aa87cc40921293396bfdcd95ca2b1831ef382c83c87a703c8c6c3b88 WatchSource:0}: Error finding container 2d3e4e26aa87cc40921293396bfdcd95ca2b1831ef382c83c87a703c8c6c3b88: Status 404 returned error can't find the container with id 2d3e4e26aa87cc40921293396bfdcd95ca2b1831ef382c83c87a703c8c6c3b88 Jul 29 16:14:27.986680 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.986649 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:14:27.986765 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.986711 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:14:27.986765 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:27.986741 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:14:28.436464 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:28.436427 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" event={"ID":"4402f547-caca-4b79-aee3-bdd85acfd5ec","Type":"ContainerStarted","Data":"e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1"} Jul 29 16:14:28.436902 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:28.436485 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" event={"ID":"4402f547-caca-4b79-aee3-bdd85acfd5ec","Type":"ContainerStarted","Data":"2d3e4e26aa87cc40921293396bfdcd95ca2b1831ef382c83c87a703c8c6c3b88"} Jul 29 16:14:28.460321 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:28.460277 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" podStartSLOduration=1.460261686 podStartE2EDuration="1.460261686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:14:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:14:28.458445463 +0000 UTC m=+3796.444787047" watchObservedRunningTime="2026-07-29 16:14:28.460261686 +0000 UTC m=+3796.446603338" Jul 29 16:14:28.519755 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:28.519728 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:28.835917 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:28.835836 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:29.840853 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:29.840821 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:30.446621 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:30.446593 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:30.447623 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:30.447606 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:30.472647 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:30.472625 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:30.570981 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:30.570944 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:30.745397 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:30.745313 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:30.846974 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:30.846941 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:31.329716 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:31.329678 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:31.435142 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:31.435112 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:46.487679 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:46.487632 2554 patch_prober.go:28] interesting pod/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 29 16:14:46.488068 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:46.487697 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" podUID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 29 16:14:47.546194 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:47.546163 2554 generic.go:356] "Generic (PLEG): container finished" podID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerID="e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1" exitCode=0 Jul 29 16:14:47.546673 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:47.546217 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" event={"ID":"4402f547-caca-4b79-aee3-bdd85acfd5ec","Type":"ContainerDied","Data":"e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1"} Jul 29 16:14:47.546673 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:47.546657 2554 scope.go:117] "RemoveContainer" containerID="e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1" Jul 29 16:14:47.547742 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:47.547712 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:14:47.547801 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:47.547780 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:14:47.547839 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:47.547814 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:14:48.553283 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:48.553253 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" event={"ID":"4402f547-caca-4b79-aee3-bdd85acfd5ec","Type":"ContainerStarted","Data":"0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310"} Jul 29 16:14:48.835451 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:48.835357 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:48.835724 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:48.835705 2554 patch_prober.go:28] interesting pod/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 29 16:14:48.835785 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:48.835759 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" podUID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 29 16:14:49.836667 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:49.836634 2554 patch_prober.go:28] interesting pod/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 29 16:14:49.837043 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:49.836684 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" podUID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 29 16:14:50.836184 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:50.836145 2554 patch_prober.go:28] interesting pod/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 29 16:14:50.836366 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:50.836216 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" podUID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 29 16:14:51.836437 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:51.836396 2554 patch_prober.go:28] interesting pod/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 29 16:14:51.836923 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:51.836481 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" podUID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 29 16:14:52.839306 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:52.839252 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:52.839773 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:52.839545 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:52.840330 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:52.840315 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:14:55.517498 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:55.517455 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:56.225452 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.225418 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:56.539230 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.539147 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg"] Jul 29 16:14:56.542437 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.542418 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.544842 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.544813 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-16a6d7-openshift-default-dockercfg-4lqkk\"" Jul 29 16:14:56.561065 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.561042 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg"] Jul 29 16:14:56.581332 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.581297 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:56.593688 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.593665 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d85f990c-d5bf-4955-b9f5-90547eaac918-istiod-ca-cert\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.593860 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.593701 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-workload-certs\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.593860 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.593727 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-data\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.593860 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.593844 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2flh7\" (UniqueName: \"kubernetes.io/projected/d85f990c-d5bf-4955-b9f5-90547eaac918-kube-api-access-2flh7\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.594042 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.593892 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-token\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.594042 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.593923 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-podinfo\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.594042 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.593966 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-envoy\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.594042 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.594002 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-workload-socket\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.594042 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.594040 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-credential-socket\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.682111 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.682072 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:56.695085 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695056 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d85f990c-d5bf-4955-b9f5-90547eaac918-istiod-ca-cert\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695251 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695095 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-workload-certs\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695251 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695120 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-data\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695251 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695188 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2flh7\" (UniqueName: \"kubernetes.io/projected/d85f990c-d5bf-4955-b9f5-90547eaac918-kube-api-access-2flh7\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695251 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695227 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-token\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695437 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695367 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-podinfo\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695437 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695424 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-envoy\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695557 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695486 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-workload-socket\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695557 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695537 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-credential-socket\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695665 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695572 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-workload-certs\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695665 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695625 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-data\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695877 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695856 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-credential-socket\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695940 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695862 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d85f990c-d5bf-4955-b9f5-90547eaac918-istiod-ca-cert\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.695940 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.695882 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-workload-socket\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.697715 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.697694 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-envoy\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.697956 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.697935 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-podinfo\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.705419 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.705395 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2flh7\" (UniqueName: \"kubernetes.io/projected/d85f990c-d5bf-4955-b9f5-90547eaac918-kube-api-access-2flh7\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.706680 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.706654 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-token\") pod \"e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.853424 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.853327 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:56.989887 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.989864 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg"] Jul 29 16:14:56.991943 ip-10-0-130-249 kubenswrapper[2554]: W0729 16:14:56.991918 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85f990c_d5bf_4955_b9f5_90547eaac918.slice/crio-f1d0240b7945c1244441b6b9474043007544b2d1a7c740ed8136b38c9b588f1b WatchSource:0}: Error finding container f1d0240b7945c1244441b6b9474043007544b2d1a7c740ed8136b38c9b588f1b: Status 404 returned error can't find the container with id f1d0240b7945c1244441b6b9474043007544b2d1a7c740ed8136b38c9b588f1b Jul 29 16:14:56.994144 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.994115 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:14:56.994208 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.994178 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:14:56.994250 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:56.994220 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:14:57.602777 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:57.602738 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" event={"ID":"d85f990c-d5bf-4955-b9f5-90547eaac918","Type":"ContainerStarted","Data":"08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da"} Jul 29 16:14:57.603177 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:57.602795 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" event={"ID":"d85f990c-d5bf-4955-b9f5-90547eaac918","Type":"ContainerStarted","Data":"f1d0240b7945c1244441b6b9474043007544b2d1a7c740ed8136b38c9b588f1b"} Jul 29 16:14:57.627395 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:57.627347 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" podStartSLOduration=1.627331608 podStartE2EDuration="1.627331608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:14:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:14:57.62526923 +0000 UTC m=+3825.611610813" watchObservedRunningTime="2026-07-29 16:14:57.627331608 +0000 UTC m=+3825.613673191" Jul 29 16:14:57.854186 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:57.854101 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:58.858808 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:58.858780 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:59.578647 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:59.578619 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:59.612692 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:59.612666 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:59.613698 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:59.613679 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:14:59.684923 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:59.684867 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:14:59.831577 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:14:59.831461 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:15:00.211757 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:00.211728 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:15:00.465069 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:00.464961 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:15:00.561786 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:00.561755 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:15:04.880405 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:04.880370 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755650-8j95s"] Jul 29 16:15:04.883307 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:04.883281 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755650-8j95s"] Jul 29 16:15:06.590709 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:06.590677 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="018077d2-91fb-461e-b2fd-35fd91481533" path="/var/lib/kubelet/pods/018077d2-91fb-461e-b2fd-35fd91481533/volumes" Jul 29 16:15:12.960675 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:12.960644 2554 scope.go:117] "RemoveContainer" containerID="78487896f5c99922837982ebd03524b41fd8e88b4ec74d72d0d8a72b60da3751" Jul 29 16:15:15.654672 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:15.654629 2554 patch_prober.go:28] interesting pod/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 29 16:15:15.655144 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:15.654700 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" podUID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 29 16:15:17.703973 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:17.703938 2554 generic.go:356] "Generic (PLEG): container finished" podID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerID="08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da" exitCode=0 Jul 29 16:15:17.704393 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:17.704012 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" event={"ID":"d85f990c-d5bf-4955-b9f5-90547eaac918","Type":"ContainerDied","Data":"08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da"} Jul 29 16:15:17.704393 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:17.704370 2554 scope.go:117] "RemoveContainer" containerID="08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da" Jul 29 16:15:17.705340 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:17.705310 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:15:17.705451 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:17.705377 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:15:17.705451 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:17.705408 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:15:18.715922 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:18.715887 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" event={"ID":"d85f990c-d5bf-4955-b9f5-90547eaac918","Type":"ContainerStarted","Data":"8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12"} Jul 29 16:15:18.853887 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:18.853852 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:15:18.854071 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:18.854039 2554 patch_prober.go:28] interesting pod/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 29 16:15:18.854124 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:18.854093 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" podUID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 29 16:15:19.854804 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:19.854750 2554 patch_prober.go:28] interesting pod/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 29 16:15:19.855207 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:19.854817 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" podUID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 29 16:15:20.854758 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:20.854715 2554 patch_prober.go:28] interesting pod/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 29 16:15:20.854961 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:20.854790 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" podUID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 29 16:15:21.854244 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:21.854212 2554 patch_prober.go:28] interesting pod/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 29 16:15:21.854432 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:21.854282 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" podUID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 29 16:15:22.857736 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:22.857707 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:15:22.858148 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:22.857969 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:15:22.858745 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:22.858728 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:15:24.618899 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:24.618859 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:15:57.547308 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:15:57.547270 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:16:05.215505 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:05.215467 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:16:40.094882 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.094850 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp"] Jul 29 16:16:40.097333 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.097316 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.099857 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.099835 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-86568b-openshift-default-dockercfg-b8gww\"" Jul 29 16:16:40.110679 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.110653 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp"] Jul 29 16:16:40.223835 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.223770 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/466c1437-61d3-428d-ab79-fae5bc4bd077-istiod-ca-cert\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.224046 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.223854 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-workload-certs\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.224046 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.223882 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-envoy\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.224046 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.223960 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-data\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.224046 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.224000 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-workload-socket\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.224046 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.224026 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh25t\" (UniqueName: \"kubernetes.io/projected/466c1437-61d3-428d-ab79-fae5bc4bd077-kube-api-access-rh25t\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.224330 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.224055 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-token\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.224330 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.224111 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-credential-socket\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.224330 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.224148 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-podinfo\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.325282 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.325243 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-data\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.325488 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.325292 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-workload-socket\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.325488 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.325310 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh25t\" (UniqueName: \"kubernetes.io/projected/466c1437-61d3-428d-ab79-fae5bc4bd077-kube-api-access-rh25t\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.325488 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.325330 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-token\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.325488 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.325363 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-credential-socket\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.325488 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.325384 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-podinfo\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.325488 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.325411 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/466c1437-61d3-428d-ab79-fae5bc4bd077-istiod-ca-cert\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.325488 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.325466 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-workload-certs\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.325907 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.325492 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-envoy\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.325907 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.325778 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-workload-socket\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.325907 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.325843 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-credential-socket\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.326109 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.326087 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-data\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.326329 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.326306 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/466c1437-61d3-428d-ab79-fae5bc4bd077-istiod-ca-cert\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.326429 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.326306 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-workload-certs\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.327752 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.327730 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-envoy\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.328224 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.328205 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-podinfo\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.335369 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.335341 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-token\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.335787 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.335763 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh25t\" (UniqueName: \"kubernetes.io/projected/466c1437-61d3-428d-ab79-fae5bc4bd077-kube-api-access-rh25t\") pod \"e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.408946 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.408854 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:40.520135 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.520100 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:16:40.619723 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.619693 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:16:40.755866 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.755840 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp"] Jul 29 16:16:40.758012 ip-10-0-130-249 kubenswrapper[2554]: W0729 16:16:40.757976 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466c1437_61d3_428d_ab79_fae5bc4bd077.slice/crio-101706647ffaa09663be774e38a208e25d96e798b4bc3759adf6e19a4befea21 WatchSource:0}: Error finding container 101706647ffaa09663be774e38a208e25d96e798b4bc3759adf6e19a4befea21: Status 404 returned error can't find the container with id 101706647ffaa09663be774e38a208e25d96e798b4bc3759adf6e19a4befea21 Jul 29 16:16:40.760157 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.760123 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:16:40.760244 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.760200 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:16:40.760286 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:40.760252 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:16:41.124011 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:41.123917 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" event={"ID":"466c1437-61d3-428d-ab79-fae5bc4bd077","Type":"ContainerStarted","Data":"a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556"} Jul 29 16:16:41.124011 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:41.124007 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" event={"ID":"466c1437-61d3-428d-ab79-fae5bc4bd077","Type":"ContainerStarted","Data":"101706647ffaa09663be774e38a208e25d96e798b4bc3759adf6e19a4befea21"} Jul 29 16:16:41.146931 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:41.146884 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" podStartSLOduration=1.146869254 podStartE2EDuration="1.146869254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:16:41.144916001 +0000 UTC m=+3929.131257585" watchObservedRunningTime="2026-07-29 16:16:41.146869254 +0000 UTC m=+3929.133210838" Jul 29 16:16:41.244958 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:41.244924 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:16:41.409360 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:41.409275 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:41.414138 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:41.414110 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:42.129943 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:42.129913 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:42.130901 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:42.130884 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:43.144740 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:43.144703 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:16:43.883015 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:43.882981 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:16:43.983368 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:43.983329 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:16:44.087951 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:44.087913 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:16:44.184416 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:44.184382 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:16:56.207004 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:56.206965 2554 generic.go:356] "Generic (PLEG): container finished" podID="466c1437-61d3-428d-ab79-fae5bc4bd077" containerID="a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556" exitCode=0 Jul 29 16:16:56.207448 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:56.207039 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" event={"ID":"466c1437-61d3-428d-ab79-fae5bc4bd077","Type":"ContainerDied","Data":"a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556"} Jul 29 16:16:56.207496 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:56.207462 2554 scope.go:117] "RemoveContainer" containerID="a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556" Jul 29 16:16:56.208605 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:56.208573 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:16:56.208703 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:56.208645 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:16:56.208703 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:56.208676 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 16:16:57.129954 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:57.129920 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:57.214295 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:57.214263 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" event={"ID":"466c1437-61d3-428d-ab79-fae5bc4bd077","Type":"ContainerStarted","Data":"96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523"} Jul 29 16:16:57.409986 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:57.409900 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:16:57.410985 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:57.410959 2554 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 29 16:16:57.411108 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:57.411011 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" podUID="466c1437-61d3-428d-ab79-fae5bc4bd077" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 29 16:16:58.409557 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:58.409495 2554 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 29 16:16:58.410051 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:58.409594 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" podUID="466c1437-61d3-428d-ab79-fae5bc4bd077" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 29 16:16:59.409257 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:59.409220 2554 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 29 16:16:59.409547 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:16:59.409501 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" podUID="466c1437-61d3-428d-ab79-fae5bc4bd077" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 29 16:17:00.410046 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:00.410004 2554 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 29 16:17:00.410647 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:00.410617 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" podUID="466c1437-61d3-428d-ab79-fae5bc4bd077" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 29 16:17:01.409291 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:01.409243 2554 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 29 16:17:01.409535 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:01.409348 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" podUID="466c1437-61d3-428d-ab79-fae5bc4bd077" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 29 16:17:02.413453 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:02.413422 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:17:02.413851 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:02.413813 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:17:02.414617 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:02.414598 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:17:08.169577 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:08.169479 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:14.085835 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:14.085798 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:14.168691 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:14.168659 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:14.268617 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:14.268579 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:14.346668 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:14.346569 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:14.679966 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:14.679875 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:20.857628 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:20.857589 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:20.958190 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:20.958152 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:21.112097 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:21.112010 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp"] Jul 29 16:17:21.112249 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:21.112222 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" podUID="466c1437-61d3-428d-ab79-fae5bc4bd077" containerName="istio-proxy" containerID="cri-o://96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523" gracePeriod=30 Jul 29 16:17:21.139535 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:21.139497 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:21.361292 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:21.361255 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:26.361471 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.361440 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:17:26.364935 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.364907 2554 generic.go:356] "Generic (PLEG): container finished" podID="466c1437-61d3-428d-ab79-fae5bc4bd077" containerID="96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523" exitCode=0 Jul 29 16:17:26.365052 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.364944 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" event={"ID":"466c1437-61d3-428d-ab79-fae5bc4bd077","Type":"ContainerDied","Data":"96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523"} Jul 29 16:17:26.365052 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.364946 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" Jul 29 16:17:26.365052 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.364984 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp" event={"ID":"466c1437-61d3-428d-ab79-fae5bc4bd077","Type":"ContainerDied","Data":"101706647ffaa09663be774e38a208e25d96e798b4bc3759adf6e19a4befea21"} Jul 29 16:17:26.365052 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.365010 2554 scope.go:117] "RemoveContainer" containerID="96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523" Jul 29 16:17:26.373368 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.373350 2554 scope.go:117] "RemoveContainer" containerID="a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556" Jul 29 16:17:26.382151 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.382136 2554 scope.go:117] "RemoveContainer" containerID="96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523" Jul 29 16:17:26.382390 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:17:26.382373 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523\": container with ID starting with 96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523 not found: ID does not exist" containerID="96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523" Jul 29 16:17:26.382438 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.382400 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523"} err="failed to get container status \"96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523\": rpc error: code = NotFound desc = could not find container \"96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523\": container with ID starting with 96d990ac5a4eb5e394a9aa72696a7cb828f3d0e7d601781f2cd30c6b1e7c4523 not found: ID does not exist" Jul 29 16:17:26.382438 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.382421 2554 scope.go:117] "RemoveContainer" containerID="a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556" Jul 29 16:17:26.382694 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:17:26.382673 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556\": container with ID starting with a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556 not found: ID does not exist" containerID="a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556" Jul 29 16:17:26.382763 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.382704 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556"} err="failed to get container status \"a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556\": rpc error: code = NotFound desc = could not find container \"a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556\": container with ID starting with a837385dad69a3cfba220ea24769bf02736f538cb444248cc33c0316c384c556 not found: ID does not exist" Jul 29 16:17:26.480491 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.480455 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-workload-socket\") pod \"466c1437-61d3-428d-ab79-fae5bc4bd077\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " Jul 29 16:17:26.480491 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.480492 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-token\") pod \"466c1437-61d3-428d-ab79-fae5bc4bd077\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " Jul 29 16:17:26.480753 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.480545 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-workload-certs\") pod \"466c1437-61d3-428d-ab79-fae5bc4bd077\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " Jul 29 16:17:26.480753 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.480612 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/466c1437-61d3-428d-ab79-fae5bc4bd077-istiod-ca-cert\") pod \"466c1437-61d3-428d-ab79-fae5bc4bd077\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " Jul 29 16:17:26.480753 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.480630 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-data\") pod \"466c1437-61d3-428d-ab79-fae5bc4bd077\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " Jul 29 16:17:26.480753 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.480651 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh25t\" (UniqueName: \"kubernetes.io/projected/466c1437-61d3-428d-ab79-fae5bc4bd077-kube-api-access-rh25t\") pod \"466c1437-61d3-428d-ab79-fae5bc4bd077\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " Jul 29 16:17:26.480753 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.480678 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-podinfo\") pod \"466c1437-61d3-428d-ab79-fae5bc4bd077\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " Jul 29 16:17:26.480982 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.480764 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-credential-socket\") pod \"466c1437-61d3-428d-ab79-fae5bc4bd077\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " Jul 29 16:17:26.480982 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.480833 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-envoy\") pod \"466c1437-61d3-428d-ab79-fae5bc4bd077\" (UID: \"466c1437-61d3-428d-ab79-fae5bc4bd077\") " Jul 29 16:17:26.481190 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.480824 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "466c1437-61d3-428d-ab79-fae5bc4bd077" (UID: "466c1437-61d3-428d-ab79-fae5bc4bd077"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:17:26.481298 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.480924 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "466c1437-61d3-428d-ab79-fae5bc4bd077" (UID: "466c1437-61d3-428d-ab79-fae5bc4bd077"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:17:26.481298 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.481078 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/466c1437-61d3-428d-ab79-fae5bc4bd077-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "466c1437-61d3-428d-ab79-fae5bc4bd077" (UID: "466c1437-61d3-428d-ab79-fae5bc4bd077"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:17:26.481298 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.481158 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "466c1437-61d3-428d-ab79-fae5bc4bd077" (UID: "466c1437-61d3-428d-ab79-fae5bc4bd077"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:17:26.481817 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.481786 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-data" (OuterVolumeSpecName: "istio-data") pod "466c1437-61d3-428d-ab79-fae5bc4bd077" (UID: "466c1437-61d3-428d-ab79-fae5bc4bd077"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:17:26.483033 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.483009 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "466c1437-61d3-428d-ab79-fae5bc4bd077" (UID: "466c1437-61d3-428d-ab79-fae5bc4bd077"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:17:26.483174 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.483138 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/466c1437-61d3-428d-ab79-fae5bc4bd077-kube-api-access-rh25t" (OuterVolumeSpecName: "kube-api-access-rh25t") pod "466c1437-61d3-428d-ab79-fae5bc4bd077" (UID: "466c1437-61d3-428d-ab79-fae5bc4bd077"). InnerVolumeSpecName "kube-api-access-rh25t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:17:26.483233 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.483192 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "466c1437-61d3-428d-ab79-fae5bc4bd077" (UID: "466c1437-61d3-428d-ab79-fae5bc4bd077"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 16:17:26.483233 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.483208 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-token" (OuterVolumeSpecName: "istio-token") pod "466c1437-61d3-428d-ab79-fae5bc4bd077" (UID: "466c1437-61d3-428d-ab79-fae5bc4bd077"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:17:26.582148 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.582114 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:17:26.582148 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.582144 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:17:26.582148 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.582153 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:17:26.582148 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.582161 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:17:26.582429 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.582169 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/466c1437-61d3-428d-ab79-fae5bc4bd077-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:17:26.582429 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.582176 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:17:26.582429 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.582184 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh25t\" (UniqueName: \"kubernetes.io/projected/466c1437-61d3-428d-ab79-fae5bc4bd077-kube-api-access-rh25t\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:17:26.582429 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.582193 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/466c1437-61d3-428d-ab79-fae5bc4bd077-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:17:26.582429 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.582202 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/466c1437-61d3-428d-ab79-fae5bc4bd077-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:17:26.683645 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.683619 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp"] Jul 29 16:17:26.688953 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:26.688929 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-86568b-openshift-default-698f68b54b-6bzsp"] Jul 29 16:17:28.590850 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:28.590818 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="466c1437-61d3-428d-ab79-fae5bc4bd077" path="/var/lib/kubelet/pods/466c1437-61d3-428d-ab79-fae5bc4bd077/volumes" Jul 29 16:17:29.030433 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:29.030401 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:29.096889 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:29.096855 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:40.413544 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:40.413495 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:40.513472 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:40.513434 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:40.614266 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:40.614237 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:40.714473 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:40.714433 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:41.027506 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:41.027414 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:17:46.106213 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:17:46.106171 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:06.508001 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:06.507960 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:22.607498 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:22.607457 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:23.622431 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:23.622389 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:29.467721 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:29.467690 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:29.556539 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:29.556486 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:29.742552 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:29.742451 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j"] Jul 29 16:18:29.742770 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:29.742725 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" podUID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerName="istio-proxy" containerID="cri-o://0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310" gracePeriod=30 Jul 29 16:18:29.767906 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:29.767867 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:30.045700 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:30.045603 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:34.997966 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:34.997931 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:18:35.042095 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.041954 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:35.122188 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.122126 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:35.160371 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.160342 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-credential-socket\") pod \"4402f547-caca-4b79-aee3-bdd85acfd5ec\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " Jul 29 16:18:35.160580 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.160392 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-workload-socket\") pod \"4402f547-caca-4b79-aee3-bdd85acfd5ec\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " Jul 29 16:18:35.160580 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.160411 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-workload-certs\") pod \"4402f547-caca-4b79-aee3-bdd85acfd5ec\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " Jul 29 16:18:35.160580 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.160436 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-envoy\") pod \"4402f547-caca-4b79-aee3-bdd85acfd5ec\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " Jul 29 16:18:35.160580 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.160454 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-token\") pod \"4402f547-caca-4b79-aee3-bdd85acfd5ec\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " Jul 29 16:18:35.160580 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.160498 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-data\") pod \"4402f547-caca-4b79-aee3-bdd85acfd5ec\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " Jul 29 16:18:35.160580 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.160570 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-podinfo\") pod \"4402f547-caca-4b79-aee3-bdd85acfd5ec\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " Jul 29 16:18:35.160903 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.160599 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v6cg\" (UniqueName: \"kubernetes.io/projected/4402f547-caca-4b79-aee3-bdd85acfd5ec-kube-api-access-8v6cg\") pod \"4402f547-caca-4b79-aee3-bdd85acfd5ec\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " Jul 29 16:18:35.160903 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.160677 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4402f547-caca-4b79-aee3-bdd85acfd5ec-istiod-ca-cert\") pod \"4402f547-caca-4b79-aee3-bdd85acfd5ec\" (UID: \"4402f547-caca-4b79-aee3-bdd85acfd5ec\") " Jul 29 16:18:35.160903 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.160755 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4402f547-caca-4b79-aee3-bdd85acfd5ec" (UID: "4402f547-caca-4b79-aee3-bdd85acfd5ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:18:35.160903 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.160851 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4402f547-caca-4b79-aee3-bdd85acfd5ec" (UID: "4402f547-caca-4b79-aee3-bdd85acfd5ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:18:35.161195 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.161148 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:35.161195 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.161172 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:35.161384 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.161211 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4402f547-caca-4b79-aee3-bdd85acfd5ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4402f547-caca-4b79-aee3-bdd85acfd5ec" (UID: "4402f547-caca-4b79-aee3-bdd85acfd5ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:18:35.161477 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.161447 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "4402f547-caca-4b79-aee3-bdd85acfd5ec" (UID: "4402f547-caca-4b79-aee3-bdd85acfd5ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:18:35.161567 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.161512 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4402f547-caca-4b79-aee3-bdd85acfd5ec" (UID: "4402f547-caca-4b79-aee3-bdd85acfd5ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:18:35.162942 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.162901 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4402f547-caca-4b79-aee3-bdd85acfd5ec" (UID: "4402f547-caca-4b79-aee3-bdd85acfd5ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:18:35.162942 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.162909 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4402f547-caca-4b79-aee3-bdd85acfd5ec" (UID: "4402f547-caca-4b79-aee3-bdd85acfd5ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 16:18:35.163087 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.162937 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "4402f547-caca-4b79-aee3-bdd85acfd5ec" (UID: "4402f547-caca-4b79-aee3-bdd85acfd5ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:18:35.163087 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.162968 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4402f547-caca-4b79-aee3-bdd85acfd5ec-kube-api-access-8v6cg" (OuterVolumeSpecName: "kube-api-access-8v6cg") pod "4402f547-caca-4b79-aee3-bdd85acfd5ec" (UID: "4402f547-caca-4b79-aee3-bdd85acfd5ec"). InnerVolumeSpecName "kube-api-access-8v6cg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:18:35.190615 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.190575 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:35.261865 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.261828 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:35.261865 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.261863 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:35.261865 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.261873 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v6cg\" (UniqueName: \"kubernetes.io/projected/4402f547-caca-4b79-aee3-bdd85acfd5ec-kube-api-access-8v6cg\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:35.262317 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.261883 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4402f547-caca-4b79-aee3-bdd85acfd5ec-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:35.262317 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.261894 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:35.262317 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.261907 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:35.262317 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.261919 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4402f547-caca-4b79-aee3-bdd85acfd5ec-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:35.270494 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.269966 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:35.654745 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.654709 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:35.719273 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.719236 2554 generic.go:356] "Generic (PLEG): container finished" podID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerID="0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310" exitCode=0 Jul 29 16:18:35.719455 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.719327 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" event={"ID":"4402f547-caca-4b79-aee3-bdd85acfd5ec","Type":"ContainerDied","Data":"0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310"} Jul 29 16:18:35.719455 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.719348 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" Jul 29 16:18:35.719455 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.719386 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j" event={"ID":"4402f547-caca-4b79-aee3-bdd85acfd5ec","Type":"ContainerDied","Data":"2d3e4e26aa87cc40921293396bfdcd95ca2b1831ef382c83c87a703c8c6c3b88"} Jul 29 16:18:35.719455 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.719416 2554 scope.go:117] "RemoveContainer" containerID="0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310" Jul 29 16:18:35.728724 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.728706 2554 scope.go:117] "RemoveContainer" containerID="e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1" Jul 29 16:18:35.736943 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.736922 2554 scope.go:117] "RemoveContainer" containerID="0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310" Jul 29 16:18:35.737182 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:18:35.737162 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310\": container with ID starting with 0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310 not found: ID does not exist" containerID="0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310" Jul 29 16:18:35.737228 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.737190 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310"} err="failed to get container status \"0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310\": rpc error: code = NotFound desc = could not find container \"0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310\": container with ID starting with 0436dfc7792d246482928f3dd91ff1875db4cd1358d8ca6cc76d33d590ebd310 not found: ID does not exist" Jul 29 16:18:35.737228 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.737207 2554 scope.go:117] "RemoveContainer" containerID="e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1" Jul 29 16:18:35.737433 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:18:35.737415 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1\": container with ID starting with e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1 not found: ID does not exist" containerID="e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1" Jul 29 16:18:35.737486 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.737441 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1"} err="failed to get container status \"e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1\": rpc error: code = NotFound desc = could not find container \"e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1\": container with ID starting with e7c21c98e64e1d0fd156d5f4da2018140f3a25c2067b5a725758dee2662e8df1 not found: ID does not exist" Jul 29 16:18:35.742216 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.742193 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j"] Jul 29 16:18:35.747199 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:35.747179 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-6fccfc-openshift-default-5b764f7748-2pd6j"] Jul 29 16:18:36.590304 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:36.590263 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4402f547-caca-4b79-aee3-bdd85acfd5ec" path="/var/lib/kubelet/pods/4402f547-caca-4b79-aee3-bdd85acfd5ec/volumes" Jul 29 16:18:42.136817 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:42.136784 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:42.227634 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:42.227587 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:42.385312 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:42.385279 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg"] Jul 29 16:18:42.385551 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:42.385511 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" podUID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerName="istio-proxy" containerID="cri-o://8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12" gracePeriod=30 Jul 29 16:18:42.412679 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:42.412599 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:42.643635 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:42.643599 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:47.651042 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.650989 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:18:47.685867 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.685843 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-data\") pod \"d85f990c-d5bf-4955-b9f5-90547eaac918\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " Jul 29 16:18:47.685867 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.685871 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-envoy\") pod \"d85f990c-d5bf-4955-b9f5-90547eaac918\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " Jul 29 16:18:47.686079 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.685908 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-podinfo\") pod \"d85f990c-d5bf-4955-b9f5-90547eaac918\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " Jul 29 16:18:47.686079 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.685933 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-workload-socket\") pod \"d85f990c-d5bf-4955-b9f5-90547eaac918\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " Jul 29 16:18:47.686079 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.685968 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-token\") pod \"d85f990c-d5bf-4955-b9f5-90547eaac918\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " Jul 29 16:18:47.686079 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.685984 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-credential-socket\") pod \"d85f990c-d5bf-4955-b9f5-90547eaac918\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " Jul 29 16:18:47.686079 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.686010 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2flh7\" (UniqueName: \"kubernetes.io/projected/d85f990c-d5bf-4955-b9f5-90547eaac918-kube-api-access-2flh7\") pod \"d85f990c-d5bf-4955-b9f5-90547eaac918\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " Jul 29 16:18:47.686079 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.686063 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d85f990c-d5bf-4955-b9f5-90547eaac918-istiod-ca-cert\") pod \"d85f990c-d5bf-4955-b9f5-90547eaac918\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " Jul 29 16:18:47.686406 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.686091 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-workload-certs\") pod \"d85f990c-d5bf-4955-b9f5-90547eaac918\" (UID: \"d85f990c-d5bf-4955-b9f5-90547eaac918\") " Jul 29 16:18:47.686406 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.686345 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d85f990c-d5bf-4955-b9f5-90547eaac918" (UID: "d85f990c-d5bf-4955-b9f5-90547eaac918"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:18:47.686406 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.686354 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d85f990c-d5bf-4955-b9f5-90547eaac918" (UID: "d85f990c-d5bf-4955-b9f5-90547eaac918"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:18:47.686603 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.686580 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d85f990c-d5bf-4955-b9f5-90547eaac918" (UID: "d85f990c-d5bf-4955-b9f5-90547eaac918"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:18:47.686824 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.686799 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-data" (OuterVolumeSpecName: "istio-data") pod "d85f990c-d5bf-4955-b9f5-90547eaac918" (UID: "d85f990c-d5bf-4955-b9f5-90547eaac918"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:18:47.686904 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.686829 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:47.686904 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.686850 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:47.686904 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.686863 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:47.686904 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.686862 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d85f990c-d5bf-4955-b9f5-90547eaac918-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d85f990c-d5bf-4955-b9f5-90547eaac918" (UID: "d85f990c-d5bf-4955-b9f5-90547eaac918"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:18:47.688221 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.688187 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d85f990c-d5bf-4955-b9f5-90547eaac918" (UID: "d85f990c-d5bf-4955-b9f5-90547eaac918"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:18:47.688485 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.688461 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d85f990c-d5bf-4955-b9f5-90547eaac918" (UID: "d85f990c-d5bf-4955-b9f5-90547eaac918"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 16:18:47.688651 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.688634 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d85f990c-d5bf-4955-b9f5-90547eaac918-kube-api-access-2flh7" (OuterVolumeSpecName: "kube-api-access-2flh7") pod "d85f990c-d5bf-4955-b9f5-90547eaac918" (UID: "d85f990c-d5bf-4955-b9f5-90547eaac918"). InnerVolumeSpecName "kube-api-access-2flh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:18:47.688990 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.688968 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-token" (OuterVolumeSpecName: "istio-token") pod "d85f990c-d5bf-4955-b9f5-90547eaac918" (UID: "d85f990c-d5bf-4955-b9f5-90547eaac918"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:18:47.784640 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.784600 2554 generic.go:356] "Generic (PLEG): container finished" podID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerID="8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12" exitCode=0 Jul 29 16:18:47.784799 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.784657 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" Jul 29 16:18:47.784799 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.784690 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" event={"ID":"d85f990c-d5bf-4955-b9f5-90547eaac918","Type":"ContainerDied","Data":"8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12"} Jul 29 16:18:47.784799 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.784748 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg" event={"ID":"d85f990c-d5bf-4955-b9f5-90547eaac918","Type":"ContainerDied","Data":"f1d0240b7945c1244441b6b9474043007544b2d1a7c740ed8136b38c9b588f1b"} Jul 29 16:18:47.784799 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.784772 2554 scope.go:117] "RemoveContainer" containerID="8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12" Jul 29 16:18:47.787595 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.787569 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:47.787595 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.787590 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:47.787595 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.787598 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2flh7\" (UniqueName: \"kubernetes.io/projected/d85f990c-d5bf-4955-b9f5-90547eaac918-kube-api-access-2flh7\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:47.787855 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.787608 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d85f990c-d5bf-4955-b9f5-90547eaac918-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:47.787855 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.787616 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:47.787855 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.787623 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d85f990c-d5bf-4955-b9f5-90547eaac918-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:18:47.806751 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.806726 2554 scope.go:117] "RemoveContainer" containerID="08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da" Jul 29 16:18:47.827291 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.827273 2554 scope.go:117] "RemoveContainer" containerID="8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12" Jul 29 16:18:47.827553 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:18:47.827506 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12\": container with ID starting with 8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12 not found: ID does not exist" containerID="8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12" Jul 29 16:18:47.827653 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.827560 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12"} err="failed to get container status \"8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12\": rpc error: code = NotFound desc = could not find container \"8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12\": container with ID starting with 8b4135199eb6770e4c10b02139b224b1cdc252ce27e585d8e6d6ebe52df9eb12 not found: ID does not exist" Jul 29 16:18:47.827653 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.827577 2554 scope.go:117] "RemoveContainer" containerID="08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da" Jul 29 16:18:47.827839 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:18:47.827820 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da\": container with ID starting with 08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da not found: ID does not exist" containerID="08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da" Jul 29 16:18:47.827878 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.827846 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da"} err="failed to get container status \"08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da\": rpc error: code = NotFound desc = could not find container \"08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da\": container with ID starting with 08a7e45eb9d751b1ea4f7e8576d56509456e9f3c47ad665b064021c1b12130da not found: ID does not exist" Jul 29 16:18:47.833559 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.833504 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg"] Jul 29 16:18:47.837438 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:47.837417 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-16a6d7-openshift-default-55f54c5f98-b7dqg"] Jul 29 16:18:48.591294 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:48.591261 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d85f990c-d5bf-4955-b9f5-90547eaac918" path="/var/lib/kubelet/pods/d85f990c-d5bf-4955-b9f5-90547eaac918/volumes" Jul 29 16:18:53.488278 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:53.488241 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:53.571379 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:53.571347 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:53.641962 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:53.641927 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:53.733642 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:53.733609 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:18:54.162776 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:18:54.162738 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:00.690975 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:00.690931 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:00.792684 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:00.792644 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:00.892864 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:00.892832 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk"] Jul 29 16:19:00.893047 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:00.893024 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerName="istio-proxy" containerID="cri-o://838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e" gracePeriod=30 Jul 29 16:19:01.055630 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:01.055550 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:01.169827 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:01.169798 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:06.135319 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.135294 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:19:06.267210 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.267175 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-podinfo\") pod \"52583d21-6ef7-47b8-8915-cdda58af68f8\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " Jul 29 16:19:06.267414 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.267219 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcmd9\" (UniqueName: \"kubernetes.io/projected/52583d21-6ef7-47b8-8915-cdda58af68f8-kube-api-access-gcmd9\") pod \"52583d21-6ef7-47b8-8915-cdda58af68f8\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " Jul 29 16:19:06.267414 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.267238 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-data\") pod \"52583d21-6ef7-47b8-8915-cdda58af68f8\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " Jul 29 16:19:06.267414 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.267267 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-workload-certs\") pod \"52583d21-6ef7-47b8-8915-cdda58af68f8\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " Jul 29 16:19:06.267414 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.267285 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52583d21-6ef7-47b8-8915-cdda58af68f8-istiod-ca-cert\") pod \"52583d21-6ef7-47b8-8915-cdda58af68f8\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " Jul 29 16:19:06.267414 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.267310 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-envoy\") pod \"52583d21-6ef7-47b8-8915-cdda58af68f8\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " Jul 29 16:19:06.267414 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.267329 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-workload-socket\") pod \"52583d21-6ef7-47b8-8915-cdda58af68f8\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " Jul 29 16:19:06.267414 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.267347 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-credential-socket\") pod \"52583d21-6ef7-47b8-8915-cdda58af68f8\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " Jul 29 16:19:06.267414 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.267364 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-token\") pod \"52583d21-6ef7-47b8-8915-cdda58af68f8\" (UID: \"52583d21-6ef7-47b8-8915-cdda58af68f8\") " Jul 29 16:19:06.267859 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.267688 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "52583d21-6ef7-47b8-8915-cdda58af68f8" (UID: "52583d21-6ef7-47b8-8915-cdda58af68f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:19:06.267859 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.267736 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "52583d21-6ef7-47b8-8915-cdda58af68f8" (UID: "52583d21-6ef7-47b8-8915-cdda58af68f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:19:06.267974 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.267934 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "52583d21-6ef7-47b8-8915-cdda58af68f8" (UID: "52583d21-6ef7-47b8-8915-cdda58af68f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:19:06.268035 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.268006 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52583d21-6ef7-47b8-8915-cdda58af68f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "52583d21-6ef7-47b8-8915-cdda58af68f8" (UID: "52583d21-6ef7-47b8-8915-cdda58af68f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:19:06.268512 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.268478 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "52583d21-6ef7-47b8-8915-cdda58af68f8" (UID: "52583d21-6ef7-47b8-8915-cdda58af68f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:19:06.269624 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.269594 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "52583d21-6ef7-47b8-8915-cdda58af68f8" (UID: "52583d21-6ef7-47b8-8915-cdda58af68f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 16:19:06.269723 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.269646 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52583d21-6ef7-47b8-8915-cdda58af68f8-kube-api-access-gcmd9" (OuterVolumeSpecName: "kube-api-access-gcmd9") pod "52583d21-6ef7-47b8-8915-cdda58af68f8" (UID: "52583d21-6ef7-47b8-8915-cdda58af68f8"). InnerVolumeSpecName "kube-api-access-gcmd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:19:06.269771 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.269726 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "52583d21-6ef7-47b8-8915-cdda58af68f8" (UID: "52583d21-6ef7-47b8-8915-cdda58af68f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:19:06.269771 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.269733 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "52583d21-6ef7-47b8-8915-cdda58af68f8" (UID: "52583d21-6ef7-47b8-8915-cdda58af68f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:19:06.368442 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.368402 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:06.368442 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.368438 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcmd9\" (UniqueName: \"kubernetes.io/projected/52583d21-6ef7-47b8-8915-cdda58af68f8-kube-api-access-gcmd9\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:06.368442 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.368450 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:06.368726 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.368459 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:06.368726 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.368467 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52583d21-6ef7-47b8-8915-cdda58af68f8-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:06.368726 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.368475 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:06.368726 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.368482 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:06.368726 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.368490 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52583d21-6ef7-47b8-8915-cdda58af68f8-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:06.368726 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.368498 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52583d21-6ef7-47b8-8915-cdda58af68f8-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:06.881788 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.881699 2554 generic.go:356] "Generic (PLEG): container finished" podID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerID="838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e" exitCode=0 Jul 29 16:19:06.881788 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.881750 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" Jul 29 16:19:06.882000 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.881786 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" event={"ID":"52583d21-6ef7-47b8-8915-cdda58af68f8","Type":"ContainerDied","Data":"838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e"} Jul 29 16:19:06.882000 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.881848 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk" event={"ID":"52583d21-6ef7-47b8-8915-cdda58af68f8","Type":"ContainerDied","Data":"45ce4fd956f10f3169b3e1dd12a1074e3c3596ec8a535af700620203ed0eed9f"} Jul 29 16:19:06.882000 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.881872 2554 scope.go:117] "RemoveContainer" containerID="838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e" Jul 29 16:19:06.890664 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.890647 2554 scope.go:117] "RemoveContainer" containerID="86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79" Jul 29 16:19:06.898652 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.898631 2554 scope.go:117] "RemoveContainer" containerID="838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e" Jul 29 16:19:06.898914 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:19:06.898896 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e\": container with ID starting with 838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e not found: ID does not exist" containerID="838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e" Jul 29 16:19:06.898963 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.898921 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e"} err="failed to get container status \"838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e\": rpc error: code = NotFound desc = could not find container \"838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e\": container with ID starting with 838e4708a48798ce4e89f870b8c0c5f6e6a872d1944a643dc52b75e11cfb448e not found: ID does not exist" Jul 29 16:19:06.898963 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.898936 2554 scope.go:117] "RemoveContainer" containerID="86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79" Jul 29 16:19:06.899202 ip-10-0-130-249 kubenswrapper[2554]: E0729 16:19:06.899174 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79\": container with ID starting with 86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79 not found: ID does not exist" containerID="86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79" Jul 29 16:19:06.899257 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.899202 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79"} err="failed to get container status \"86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79\": rpc error: code = NotFound desc = could not find container \"86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79\": container with ID starting with 86117ac301adbcaaa3bc557b7a666a857d723cdd29c27ed8ea99b85640a0db79 not found: ID does not exist" Jul 29 16:19:06.903755 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.903732 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk"] Jul 29 16:19:06.907890 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:06.907857 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-02add2-openshift-default-77bf8bf768-h8jzk"] Jul 29 16:19:08.590265 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:08.590234 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" path="/var/lib/kubelet/pods/52583d21-6ef7-47b8-8915-cdda58af68f8/volumes" Jul 29 16:19:11.807743 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:11.807710 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:11.921544 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:11.921498 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:12.420415 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:12.420369 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:12.520766 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:12.520728 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:18.570779 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:18.570737 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:18.694639 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:18.694593 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:18.834919 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:18.834832 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr"] Jul 29 16:19:18.835136 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:18.835108 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" podUID="75f7c186-3a9b-47f1-80fa-88b1da816f1e" containerName="istio-proxy" containerID="cri-o://da31563f416a3753ae3d42101586144d88f8fd2f4f1b0d3799e1b26fe55f8a9b" gracePeriod=30 Jul 29 16:19:18.861093 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:18.861059 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:19.107402 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:19.107312 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:23.966281 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:23.966252 2554 generic.go:356] "Generic (PLEG): container finished" podID="75f7c186-3a9b-47f1-80fa-88b1da816f1e" containerID="da31563f416a3753ae3d42101586144d88f8fd2f4f1b0d3799e1b26fe55f8a9b" exitCode=0 Jul 29 16:19:23.966647 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:23.966327 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" event={"ID":"75f7c186-3a9b-47f1-80fa-88b1da816f1e","Type":"ContainerDied","Data":"da31563f416a3753ae3d42101586144d88f8fd2f4f1b0d3799e1b26fe55f8a9b"} Jul 29 16:19:23.966647 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:23.966403 2554 scope.go:117] "RemoveContainer" containerID="24a484e19e78810b829c810537aa52726740f01405bbf0c304c27e823a3bf80a" Jul 29 16:19:24.091322 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.091301 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:19:24.136303 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.136231 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-token\") pod \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " Jul 29 16:19:24.136303 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.136274 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istiod-ca-cert\") pod \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " Jul 29 16:19:24.136508 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.136309 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-data\") pod \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " Jul 29 16:19:24.136508 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.136356 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-envoy\") pod \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " Jul 29 16:19:24.136508 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.136401 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzn7v\" (UniqueName: \"kubernetes.io/projected/75f7c186-3a9b-47f1-80fa-88b1da816f1e-kube-api-access-xzn7v\") pod \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " Jul 29 16:19:24.136508 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.136429 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-credential-socket\") pod \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " Jul 29 16:19:24.136508 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.136453 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-podinfo\") pod \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " Jul 29 16:19:24.136785 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.136566 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-workload-certs\") pod \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " Jul 29 16:19:24.136785 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.136604 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-workload-socket\") pod \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\" (UID: \"75f7c186-3a9b-47f1-80fa-88b1da816f1e\") " Jul 29 16:19:24.136880 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.136804 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "75f7c186-3a9b-47f1-80fa-88b1da816f1e" (UID: "75f7c186-3a9b-47f1-80fa-88b1da816f1e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:19:24.136956 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.136938 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istiod-ca-cert\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:24.137040 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.137018 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "75f7c186-3a9b-47f1-80fa-88b1da816f1e" (UID: "75f7c186-3a9b-47f1-80fa-88b1da816f1e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:19:24.137101 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.137038 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "75f7c186-3a9b-47f1-80fa-88b1da816f1e" (UID: "75f7c186-3a9b-47f1-80fa-88b1da816f1e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:19:24.137166 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.137145 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "75f7c186-3a9b-47f1-80fa-88b1da816f1e" (UID: "75f7c186-3a9b-47f1-80fa-88b1da816f1e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:19:24.137462 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.137430 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-data" (OuterVolumeSpecName: "istio-data") pod "75f7c186-3a9b-47f1-80fa-88b1da816f1e" (UID: "75f7c186-3a9b-47f1-80fa-88b1da816f1e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:19:24.138662 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.138638 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f7c186-3a9b-47f1-80fa-88b1da816f1e-kube-api-access-xzn7v" (OuterVolumeSpecName: "kube-api-access-xzn7v") pod "75f7c186-3a9b-47f1-80fa-88b1da816f1e" (UID: "75f7c186-3a9b-47f1-80fa-88b1da816f1e"). InnerVolumeSpecName "kube-api-access-xzn7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:19:24.139082 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.139063 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "75f7c186-3a9b-47f1-80fa-88b1da816f1e" (UID: "75f7c186-3a9b-47f1-80fa-88b1da816f1e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 16:19:24.139082 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.139076 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-token" (OuterVolumeSpecName: "istio-token") pod "75f7c186-3a9b-47f1-80fa-88b1da816f1e" (UID: "75f7c186-3a9b-47f1-80fa-88b1da816f1e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:19:24.139245 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.139231 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "75f7c186-3a9b-47f1-80fa-88b1da816f1e" (UID: "75f7c186-3a9b-47f1-80fa-88b1da816f1e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:19:24.238208 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.238168 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-envoy\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:24.238208 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.238201 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzn7v\" (UniqueName: \"kubernetes.io/projected/75f7c186-3a9b-47f1-80fa-88b1da816f1e-kube-api-access-xzn7v\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:24.238208 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.238213 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-credential-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:24.238208 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.238221 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-podinfo\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:24.238471 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.238230 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-workload-certs\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:24.238471 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.238238 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-workload-socket\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:24.238471 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.238246 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-token\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:24.238471 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.238253 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75f7c186-3a9b-47f1-80fa-88b1da816f1e-istio-data\") on node \"ip-10-0-130-249.ec2.internal\" DevicePath \"\"" Jul 29 16:19:24.972161 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.972128 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" event={"ID":"75f7c186-3a9b-47f1-80fa-88b1da816f1e","Type":"ContainerDied","Data":"4e921d9aa4cdee239e8eab9e0cdcbc8373ffd05088e3380d8beac36b71c39e5a"} Jul 29 16:19:24.972620 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.972165 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr" Jul 29 16:19:24.972620 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.972188 2554 scope.go:117] "RemoveContainer" containerID="da31563f416a3753ae3d42101586144d88f8fd2f4f1b0d3799e1b26fe55f8a9b" Jul 29 16:19:24.992645 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.992615 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr"] Jul 29 16:19:24.997312 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:24.997286 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-7e5daf-openshift-default-8bf4f564d-vkhrr"] Jul 29 16:19:25.872200 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:25.872171 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b6fb79c5-49l9l_d83d4c97-9a02-45f8-9f56-8dc60cdae7da/copy-manifests/0.log" Jul 29 16:19:25.882707 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:25.882681 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b6fb79c5-49l9l_d83d4c97-9a02-45f8-9f56-8dc60cdae7da/manager/0.log" Jul 29 16:19:26.590018 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:26.589988 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75f7c186-3a9b-47f1-80fa-88b1da816f1e" path="/var/lib/kubelet/pods/75f7c186-3a9b-47f1-80fa-88b1da816f1e/volumes" Jul 29 16:19:26.767341 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:26.767313 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755680-69nh2_6bef0bd6-c535-4508-a575-46cedfb719bd/cleanup/0.log" Jul 29 16:19:29.622975 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:29.622926 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl_c4f0c199-ceef-49b0-b97e-01c5bde4b232/istio-proxy/0.log" Jul 29 16:19:29.753963 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:29.753934 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-47tx9_94c7f7b9-82f0-49d0-ac75-c95c357e3cf4/discovery/0.log" Jul 29 16:19:30.116122 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:30.116091 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5dpfv_768f20d8-98e0-472b-b26e-ce5fc2921eec/istio-proxy/1.log" Jul 29 16:19:30.484957 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:30.484930 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-584dfc7869-xd84w_040aaca8-16f6-4126-a822-5043ca11b9a4/router/0.log" Jul 29 16:19:30.973374 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:30.973345 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-6mc2t_39d33fee-6120-466f-b979-503e70870406/main/0.log" Jul 29 16:19:31.334183 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:31.334104 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rm2lr_2c002828-7b3b-43b9-a02e-2ab8945b2443/main/0.log" Jul 29 16:19:37.158674 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:37.158639 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:39.063200 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:39.063149 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" limit=1024 Jul 29 16:19:40.360241 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:40.360210 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-78zcw_429076a7-cb20-464f-9ab9-c29ab3c80773/global-pull-secret-syncer/0.log" Jul 29 16:19:40.514068 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:40.514028 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6jtbt_586ac960-ad80-4322-87ed-9daf5c1fb30e/konnectivity-agent/0.log" Jul 29 16:19:40.633052 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:40.632967 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-249.ec2.internal_965b3684eb58bf903678fba036fb554a/haproxy/0.log" Jul 29 16:19:47.644718 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:47.644683 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df15251-8272-483e-8f4d-ef7174d641c8/alertmanager/0.log" Jul 29 16:19:47.677010 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:47.676983 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df15251-8272-483e-8f4d-ef7174d641c8/config-reloader/0.log" Jul 29 16:19:47.701413 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:47.701386 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df15251-8272-483e-8f4d-ef7174d641c8/kube-rbac-proxy-web/0.log" Jul 29 16:19:47.725222 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:47.725201 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df15251-8272-483e-8f4d-ef7174d641c8/kube-rbac-proxy/0.log" Jul 29 16:19:47.749861 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:47.749838 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df15251-8272-483e-8f4d-ef7174d641c8/kube-rbac-proxy-metric/0.log" Jul 29 16:19:47.774931 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:47.774916 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df15251-8272-483e-8f4d-ef7174d641c8/prom-label-proxy/0.log" Jul 29 16:19:47.798803 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:47.798761 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df15251-8272-483e-8f4d-ef7174d641c8/init-config-reloader/0.log" Jul 29 16:19:48.268159 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:48.268080 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9796p_3cce0b86-3eec-470b-9dac-8363dd60b883/node-exporter/0.log" Jul 29 16:19:48.291402 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:48.291371 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9796p_3cce0b86-3eec-470b-9dac-8363dd60b883/kube-rbac-proxy/0.log" Jul 29 16:19:48.315655 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:48.315636 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9796p_3cce0b86-3eec-470b-9dac-8363dd60b883/init-textfile/0.log" Jul 29 16:19:48.827710 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:48.827679 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-7qtdm_3f46e7a2-d732-4b81-9aad-66385c4c6709/prometheus-operator/0.log" Jul 29 16:19:48.853599 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:48.853568 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-7qtdm_3f46e7a2-d732-4b81-9aad-66385c4c6709/kube-rbac-proxy/0.log" Jul 29 16:19:48.921800 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:48.921694 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5657b68c96-khwmn_9a5a0a60-6e05-46b0-b720-ea7d7305b63b/telemeter-client/0.log" Jul 29 16:19:48.948860 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:48.948833 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5657b68c96-khwmn_9a5a0a60-6e05-46b0-b720-ea7d7305b63b/reload/0.log" Jul 29 16:19:48.972439 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:48.972414 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5657b68c96-khwmn_9a5a0a60-6e05-46b0-b720-ea7d7305b63b/kube-rbac-proxy/0.log" Jul 29 16:19:49.009454 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:49.009428 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b8876f45-5jcmk_0c564602-14d7-4dd4-a11d-c3459a73bd1b/thanos-query/0.log" Jul 29 16:19:49.033795 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:49.033772 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b8876f45-5jcmk_0c564602-14d7-4dd4-a11d-c3459a73bd1b/kube-rbac-proxy-web/0.log" Jul 29 16:19:49.063916 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:49.063889 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b8876f45-5jcmk_0c564602-14d7-4dd4-a11d-c3459a73bd1b/kube-rbac-proxy/0.log" Jul 29 16:19:49.087608 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:49.087585 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b8876f45-5jcmk_0c564602-14d7-4dd4-a11d-c3459a73bd1b/prom-label-proxy/0.log" Jul 29 16:19:49.111109 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:49.111087 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b8876f45-5jcmk_0c564602-14d7-4dd4-a11d-c3459a73bd1b/kube-rbac-proxy-rules/0.log" Jul 29 16:19:49.133606 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:49.133572 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b8876f45-5jcmk_0c564602-14d7-4dd4-a11d-c3459a73bd1b/kube-rbac-proxy-metrics/0.log" Jul 29 16:19:50.868983 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.868952 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd"] Jul 29 16:19:50.869361 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869297 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f7c186-3a9b-47f1-80fa-88b1da816f1e" containerName="istio-proxy" Jul 29 16:19:50.869361 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869308 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f7c186-3a9b-47f1-80fa-88b1da816f1e" containerName="istio-proxy" Jul 29 16:19:50.869361 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869319 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerName="istio-proxy" Jul 29 16:19:50.869361 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869325 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerName="istio-proxy" Jul 29 16:19:50.869361 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869333 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerName="istio-proxy" Jul 29 16:19:50.869361 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869339 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerName="istio-proxy" Jul 29 16:19:50.869361 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869347 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerName="istio-proxy" Jul 29 16:19:50.869361 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869352 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerName="istio-proxy" Jul 29 16:19:50.869361 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869358 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="466c1437-61d3-428d-ab79-fae5bc4bd077" containerName="istio-proxy" Jul 29 16:19:50.869361 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869363 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="466c1437-61d3-428d-ab79-fae5bc4bd077" containerName="istio-proxy" Jul 29 16:19:50.869693 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869373 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerName="istio-proxy" Jul 29 16:19:50.869693 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869378 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerName="istio-proxy" Jul 29 16:19:50.869693 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869394 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerName="istio-proxy" Jul 29 16:19:50.869693 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869399 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerName="istio-proxy" Jul 29 16:19:50.869693 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869407 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerName="istio-proxy" Jul 29 16:19:50.869693 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869413 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerName="istio-proxy" Jul 29 16:19:50.869693 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869465 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="52583d21-6ef7-47b8-8915-cdda58af68f8" containerName="istio-proxy" Jul 29 16:19:50.869693 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869474 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="466c1437-61d3-428d-ab79-fae5bc4bd077" containerName="istio-proxy" Jul 29 16:19:50.869693 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869481 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4402f547-caca-4b79-aee3-bdd85acfd5ec" containerName="istio-proxy" Jul 29 16:19:50.869693 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869489 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="75f7c186-3a9b-47f1-80fa-88b1da816f1e" containerName="istio-proxy" Jul 29 16:19:50.869693 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869494 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="466c1437-61d3-428d-ab79-fae5bc4bd077" containerName="istio-proxy" Jul 29 16:19:50.869693 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.869500 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85f990c-d5bf-4955-b9f5-90547eaac918" containerName="istio-proxy" Jul 29 16:19:50.872680 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.872664 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:50.875206 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.875180 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6xxwd\"/\"kube-root-ca.crt\"" Jul 29 16:19:50.875854 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.875836 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6xxwd\"/\"openshift-service-ca.crt\"" Jul 29 16:19:50.875967 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.875859 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6xxwd\"/\"default-dockercfg-hmbm7\"" Jul 29 16:19:50.881688 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.881667 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd"] Jul 29 16:19:50.981791 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.981767 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebb3897a-5cdf-415d-8c60-3178c0511e01-sys\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:50.981906 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.981805 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebb3897a-5cdf-415d-8c60-3178c0511e01-proc\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:50.981906 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.981831 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebb3897a-5cdf-415d-8c60-3178c0511e01-lib-modules\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:50.982046 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.981944 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebb3897a-5cdf-415d-8c60-3178c0511e01-podres\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:50.982046 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:50.981994 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfk6n\" (UniqueName: \"kubernetes.io/projected/ebb3897a-5cdf-415d-8c60-3178c0511e01-kube-api-access-nfk6n\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:51.082628 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:51.082599 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebb3897a-5cdf-415d-8c60-3178c0511e01-proc\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:51.082628 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:51.082630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebb3897a-5cdf-415d-8c60-3178c0511e01-lib-modules\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:51.082802 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:51.082666 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebb3897a-5cdf-415d-8c60-3178c0511e01-podres\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:51.082802 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:51.082732 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebb3897a-5cdf-415d-8c60-3178c0511e01-proc\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:51.082802 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:51.082768 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebb3897a-5cdf-415d-8c60-3178c0511e01-podres\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:51.082802 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:51.082783 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfk6n\" (UniqueName: \"kubernetes.io/projected/ebb3897a-5cdf-415d-8c60-3178c0511e01-kube-api-access-nfk6n\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:51.082934 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:51.082859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebb3897a-5cdf-415d-8c60-3178c0511e01-sys\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:51.082934 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:51.082785 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebb3897a-5cdf-415d-8c60-3178c0511e01-lib-modules\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:51.083007 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:51.082939 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebb3897a-5cdf-415d-8c60-3178c0511e01-sys\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:51.092495 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:51.092476 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfk6n\" (UniqueName: \"kubernetes.io/projected/ebb3897a-5cdf-415d-8c60-3178c0511e01-kube-api-access-nfk6n\") pod \"perf-node-gather-daemonset-n5tnd\" (UID: \"ebb3897a-5cdf-415d-8c60-3178c0511e01\") " pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:51.183710 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:51.183688 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:51.316635 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:51.316608 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd"] Jul 29 16:19:51.319146 ip-10-0-130-249 kubenswrapper[2554]: W0729 16:19:51.319122 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podebb3897a_5cdf_415d_8c60_3178c0511e01.slice/crio-ea97c7e5e3d65fa013077c82bb16b36c36a152ffefd7b0bcacec5c5186765b58 WatchSource:0}: Error finding container ea97c7e5e3d65fa013077c82bb16b36c36a152ffefd7b0bcacec5c5186765b58: Status 404 returned error can't find the container with id ea97c7e5e3d65fa013077c82bb16b36c36a152ffefd7b0bcacec5c5186765b58 Jul 29 16:19:52.098298 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:52.098262 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" event={"ID":"ebb3897a-5cdf-415d-8c60-3178c0511e01","Type":"ContainerStarted","Data":"4e805e57b636c2cadc0ef36c2e309efe528907f59ff6a046b6553698c553ca1b"} Jul 29 16:19:52.098747 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:52.098315 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" event={"ID":"ebb3897a-5cdf-415d-8c60-3178c0511e01","Type":"ContainerStarted","Data":"ea97c7e5e3d65fa013077c82bb16b36c36a152ffefd7b0bcacec5c5186765b58"} Jul 29 16:19:52.098747 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:52.098347 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:19:52.118444 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:52.118399 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" podStartSLOduration=2.118384958 podStartE2EDuration="2.118384958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:19:52.116617608 +0000 UTC m=+4120.102959204" watchObservedRunningTime="2026-07-29 16:19:52.118384958 +0000 UTC m=+4120.104726542" Jul 29 16:19:53.480675 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:53.480644 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fxk4d_bbde44aa-abf9-4bc5-a825-ad18c6e11fe2/dns/0.log" Jul 29 16:19:53.504745 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:53.504695 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fxk4d_bbde44aa-abf9-4bc5-a825-ad18c6e11fe2/kube-rbac-proxy/0.log" Jul 29 16:19:53.646889 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:53.646858 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-278pz_12648377-79cc-4ee8-afe6-8ad892fc5512/dns-node-resolver/0.log" Jul 29 16:19:54.285981 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:54.285947 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c9bdb57bc-5mcss_7792ab71-6414-49b3-9b12-5556ce4b8a36/registry/0.log" Jul 29 16:19:54.367269 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:54.367245 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dfzkw_8bba0468-80b0-4f39-b48d-750abab54434/node-ca/0.log" Jul 29 16:19:55.402878 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:55.402842 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl_c4f0c199-ceef-49b0-b97e-01c5bde4b232/istio-proxy/0.log" Jul 29 16:19:55.670501 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:55.670423 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-47tx9_94c7f7b9-82f0-49d0-ac75-c95c357e3cf4/discovery/0.log" Jul 29 16:19:55.753700 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:55.753657 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5dpfv_768f20d8-98e0-472b-b26e-ce5fc2921eec/istio-proxy/0.log" Jul 29 16:19:55.817249 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:55.817209 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5dpfv_768f20d8-98e0-472b-b26e-ce5fc2921eec/istio-proxy/1.log" Jul 29 16:19:55.909443 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:55.909412 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-584dfc7869-xd84w_040aaca8-16f6-4126-a822-5043ca11b9a4/router/0.log" Jul 29 16:19:56.769219 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:56.769188 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rnq2g_8006ac72-bec6-4b8c-91c4-0c815fce3ef5/serve-healthcheck-canary/0.log" Jul 29 16:19:57.481799 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:57.481768 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gqsrn_9bc7f842-e85d-40f3-a01b-12383bad63c9/kube-rbac-proxy/0.log" Jul 29 16:19:57.504880 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:57.504854 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gqsrn_9bc7f842-e85d-40f3-a01b-12383bad63c9/exporter/0.log" Jul 29 16:19:57.528884 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:57.528860 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gqsrn_9bc7f842-e85d-40f3-a01b-12383bad63c9/extractor/0.log" Jul 29 16:19:58.113498 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:19:58.113472 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6xxwd/perf-node-gather-daemonset-n5tnd" Jul 29 16:20:00.419611 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:00.419581 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b6fb79c5-49l9l_d83d4c97-9a02-45f8-9f56-8dc60cdae7da/manager/0.log" Jul 29 16:20:00.444046 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:00.444027 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b6fb79c5-49l9l_d83d4c97-9a02-45f8-9f56-8dc60cdae7da/copy-manifests/0.log" Jul 29 16:20:01.366981 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:01.366949 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl_c4f0c199-ceef-49b0-b97e-01c5bde4b232/istio-proxy/0.log" Jul 29 16:20:01.638053 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:01.637939 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-47tx9_94c7f7b9-82f0-49d0-ac75-c95c357e3cf4/discovery/0.log" Jul 29 16:20:01.688858 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:01.688819 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5dpfv_768f20d8-98e0-472b-b26e-ce5fc2921eec/istio-proxy/0.log" Jul 29 16:20:01.745606 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:01.745578 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5dpfv_768f20d8-98e0-472b-b26e-ce5fc2921eec/istio-proxy/1.log" Jul 29 16:20:01.803052 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:01.803019 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-584dfc7869-xd84w_040aaca8-16f6-4126-a822-5043ca11b9a4/router/0.log" Jul 29 16:20:01.912310 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:01.912227 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9bd7bffd8-mvcwt_2dac5b43-2ac9-432b-bdf3-f48b8a2f86a3/manager/0.log" Jul 29 16:20:01.966934 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:01.966902 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pdp4z_59300779-12c8-4b98-96bb-8f8575b8a8ab/openshift-lws-operator/0.log" Jul 29 16:20:03.285457 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:03.285432 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-zjsjl_c4f0c199-ceef-49b0-b97e-01c5bde4b232/istio-proxy/0.log" Jul 29 16:20:03.559489 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:03.559370 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-47tx9_94c7f7b9-82f0-49d0-ac75-c95c357e3cf4/discovery/0.log" Jul 29 16:20:03.615156 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:03.615129 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5dpfv_768f20d8-98e0-472b-b26e-ce5fc2921eec/istio-proxy/0.log" Jul 29 16:20:03.672676 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:03.672639 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-5dpfv_768f20d8-98e0-472b-b26e-ce5fc2921eec/istio-proxy/1.log" Jul 29 16:20:03.752354 ip-10-0-130-249 kubenswrapper[2554]: I0729 16:20:03.752327 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-584dfc7869-xd84w_040aaca8-16f6-4126-a822-5043ca11b9a4/router/0.log"