Jul 10 20:21:22.257380 ip-10-0-130-138 systemd[1]: Starting Kubernetes Kubelet... Jul 10 20:21:22.692886 ip-10-0-130-138 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 20:21:22.692886 ip-10-0-130-138 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 20:21:22.692886 ip-10-0-130-138 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 20:21:22.692886 ip-10-0-130-138 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 20:21:22.692886 ip-10-0-130-138 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 20:21:22.694722 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.694629 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 20:21:22.700562 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700541 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:21:22.700562 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700562 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700567 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700570 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700575 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700579 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700583 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700586 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700589 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700591 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700594 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700598 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700600 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700603 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700605 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700608 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700610 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700613 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700616 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700618 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:21:22.700636 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700621 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700624 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700626 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700629 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700632 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700634 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700637 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700640 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700643 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700647 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700650 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700653 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700656 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700658 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700661 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700663 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700666 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700668 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700671 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700673 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:21:22.701229 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700676 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700678 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700733 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700800 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700808 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700816 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700821 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700825 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700830 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700835 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700840 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700845 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700850 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700855 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:21:22.701856 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.700863 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:21:22.702217 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702132 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:21:22.702217 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702150 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:21:22.702217 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702155 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:21:22.702217 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702159 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:21:22.702217 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702162 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:21:22.702217 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702171 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702281 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702287 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702291 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702294 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702297 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702301 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702304 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702307 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702310 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702312 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702316 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702319 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702321 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702324 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702326 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702328 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702331 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702334 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702336 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:21:22.702398 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702339 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702341 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702344 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702347 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702349 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702352 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702358 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702361 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702366 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702369 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702371 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702374 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702377 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702379 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702383 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702385 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702388 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702391 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:21:22.702873 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.702394 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:21:22.704101 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704088 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:21:22.704101 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704101 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704104 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704109 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704112 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704115 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704118 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704120 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704124 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704126 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704129 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704132 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704135 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704137 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704141 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704144 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704148 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704153 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704156 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704158 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:21:22.704163 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704161 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704164 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704167 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704169 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704173 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704176 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704179 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704182 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704184 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704187 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704191 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704195 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704198 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704200 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704204 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704207 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704209 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704212 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704214 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:21:22.704631 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704217 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704220 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704222 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704225 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704227 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704229 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704232 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704234 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704237 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704239 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704242 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704244 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704247 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704249 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704252 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704255 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704274 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704279 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704282 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704285 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:21:22.705108 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704287 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704290 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704295 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704298 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704301 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704304 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704307 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704309 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704312 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704316 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704319 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704322 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704324 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704327 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704330 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704333 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704335 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704338 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704340 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:21:22.705588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704343 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704345 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704348 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704350 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704353 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704355 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704358 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704360 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704363 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704366 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704369 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704371 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704374 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704376 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704380 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704383 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704385 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704388 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704391 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704393 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:21:22.706045 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704396 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704808 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704812 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704816 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704819 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704821 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704824 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704826 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704829 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704832 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704834 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704837 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704839 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704842 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704844 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704847 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704849 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704852 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704854 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:21:22.706522 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704856 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704862 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704867 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704870 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704873 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704876 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704878 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704882 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704884 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704887 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704889 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704892 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704895 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704897 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704900 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704902 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704904 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704907 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704909 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:21:22.706977 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704911 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704914 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704916 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704919 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704921 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704924 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704926 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704929 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704932 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704934 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704936 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704939 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704941 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704943 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704949 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704951 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704954 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704956 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704959 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704961 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:21:22.707446 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704964 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704967 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704970 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704972 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704975 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704977 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704981 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704984 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704987 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704989 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704992 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704994 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704997 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.704999 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705002 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705005 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705008 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705010 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705012 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705015 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:21:22.707966 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705017 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705020 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705023 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705027 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705030 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705032 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705037 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705040 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705043 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705045 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705047 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705072 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705076 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705079 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705082 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705085 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705088 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705090 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705093 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705096 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:21:22.708465 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705098 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705101 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705186 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705194 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705200 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705204 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705209 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705212 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705216 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705220 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705223 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705226 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705230 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705233 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705236 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705239 2566 flags.go:64] FLAG: --cgroup-root="" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705242 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705246 2566 flags.go:64] FLAG: --client-ca-file="" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705250 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705253 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705258 2566 flags.go:64] FLAG: --cluster-domain="" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705261 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705264 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705267 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 20:21:22.708936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705270 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705278 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705281 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705285 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705288 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705291 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705294 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705296 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705299 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705302 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705306 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705309 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705311 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705314 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705317 2566 flags.go:64] FLAG: --enable-server="true" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705320 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705324 2566 flags.go:64] FLAG: --event-burst="100" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705327 2566 flags.go:64] FLAG: --event-qps="50" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705329 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705332 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705335 2566 flags.go:64] FLAG: --eviction-hard="" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705339 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705341 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705344 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705347 2566 flags.go:64] FLAG: --eviction-soft="" Jul 10 20:21:22.709532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705350 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705353 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705356 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705359 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705362 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705365 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705367 2566 flags.go:64] FLAG: --feature-gates="" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705371 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705374 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705377 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705380 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705384 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705387 2566 flags.go:64] FLAG: --help="false" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705390 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-130-138.ec2.internal" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705393 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705396 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705399 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705402 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705405 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705408 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705411 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705414 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705416 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 20:21:22.710213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705419 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705422 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705425 2566 flags.go:64] FLAG: --kube-reserved="" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705428 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705431 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705433 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705436 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705439 2566 flags.go:64] FLAG: --lock-file="" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705442 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705445 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705448 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705453 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705456 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705459 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705461 2566 flags.go:64] FLAG: --logging-format="text" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705464 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705467 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705470 2566 flags.go:64] FLAG: --manifest-url="" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705473 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705477 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705480 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705485 2566 flags.go:64] FLAG: --max-pods="110" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705487 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705491 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705493 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 20:21:22.710782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705496 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705499 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705502 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705505 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705512 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705515 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705518 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705521 2566 flags.go:64] FLAG: --pod-cidr="" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705524 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705531 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705534 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705537 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705540 2566 flags.go:64] FLAG: --port="10250" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705543 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705546 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01fbea11bafe2036e" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705549 2566 flags.go:64] FLAG: --qos-reserved="" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705552 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705555 2566 flags.go:64] FLAG: --register-node="true" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705557 2566 flags.go:64] FLAG: --register-with-taints="" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705561 2566 flags.go:64] FLAG: --registry-burst="10" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705564 2566 flags.go:64] FLAG: --registry-qps="5" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705566 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705569 2566 flags.go:64] FLAG: --reserved-memory="" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705573 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705576 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 20:21:22.711424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705579 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705581 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705584 2566 flags.go:64] FLAG: --runonce="false" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705587 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705591 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705594 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705597 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705600 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705603 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705606 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705609 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705611 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705614 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705617 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705620 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705623 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705626 2566 flags.go:64] FLAG: --system-cgroups="" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705628 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705634 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705637 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705639 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705644 2566 flags.go:64] FLAG: --tls-min-version="" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705646 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705649 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705654 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 20:21:22.712070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705658 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705661 2566 flags.go:64] FLAG: --v="2" Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705665 2566 flags.go:64] FLAG: --version="false" Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705669 2566 flags.go:64] FLAG: --vmodule="" Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705672 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.705675 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705798 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705801 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705804 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705807 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705809 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705814 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705818 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705820 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705823 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705826 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705829 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705831 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705834 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705836 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:21:22.713138 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705839 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705841 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705843 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705846 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705848 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705851 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705853 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705855 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705858 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705860 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705863 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705867 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705871 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705873 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705876 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705878 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705881 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705884 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705886 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705889 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:21:22.713974 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705891 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705894 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705896 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705899 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705901 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705904 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705907 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705909 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705912 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705914 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705916 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705919 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705921 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705924 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705926 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705928 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705931 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705933 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705936 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705938 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:21:22.714845 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705941 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705943 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705946 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705950 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705954 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705956 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705959 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705961 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705963 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705966 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705969 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705971 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705974 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705976 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705979 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705981 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705985 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705988 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705991 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:21:22.715720 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705994 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705996 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.705998 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706001 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706004 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706006 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706008 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706011 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706013 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706017 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706019 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706021 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706024 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706026 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706029 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706031 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706035 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706039 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706041 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:21:22.716338 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706046 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706050 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706072 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706077 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706081 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706085 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.706089 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.706747 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.714432 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.714455 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.714476 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.714485 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714570 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714579 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714583 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:21:22.717243 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714588 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714593 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714598 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714602 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714607 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714611 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714615 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714618 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714623 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714627 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714631 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714635 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714639 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714644 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714648 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714653 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714657 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714661 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714665 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714669 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:21:22.717906 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714673 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714677 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714681 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714685 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714689 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714695 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714701 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714705 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714710 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714714 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714718 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714722 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714726 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714731 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714735 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714739 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714743 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714747 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714751 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714755 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:21:22.718453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714759 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714763 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714767 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714772 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714776 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714780 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714784 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714788 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714792 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714797 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714801 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714805 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714809 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714814 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714818 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714822 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714826 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714830 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714835 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714840 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:21:22.719086 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714844 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714848 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714852 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714855 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714859 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714865 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714871 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714875 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714880 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714884 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714888 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714893 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714897 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714901 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714905 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714909 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714913 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714917 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714922 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:21:22.719628 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714928 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714935 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714940 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714946 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714950 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714955 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714959 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714963 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714968 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714972 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714976 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714980 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714985 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714990 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714994 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.714998 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:21:22.720162 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715002 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.715011 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715235 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715246 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715251 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715256 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715261 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715266 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715270 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715274 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715279 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715283 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715287 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715291 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:21:22.720550 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715295 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715299 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715303 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715307 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715312 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715316 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715322 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715328 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715333 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715339 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715345 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715349 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715354 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715359 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715364 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715369 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715374 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715378 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715382 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:21:22.720945 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715386 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715390 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715394 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715399 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715403 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715407 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715411 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715415 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715418 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715422 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715426 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715430 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715434 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715437 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715441 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715446 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715450 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715456 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715460 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715464 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:21:22.721558 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715468 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715473 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715476 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715481 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715486 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715491 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715495 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715499 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715503 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715507 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715512 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715516 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715521 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715526 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715530 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715534 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715538 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715543 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715547 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715551 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:21:22.722039 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715555 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715559 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715563 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715568 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715572 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715576 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715580 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715584 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715588 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715593 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715597 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715601 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715605 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715609 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715613 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715617 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715621 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715625 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715629 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715633 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:21:22.722572 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715637 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715641 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715645 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715650 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715655 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715659 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715663 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:22.715667 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.715675 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.715861 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.718562 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.719849 2566 server.go:1019] "Starting client certificate rotation" Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.719952 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 20:21:22.723091 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.720020 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 20:21:22.723677 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.723628 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 20:21:22.725570 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.725538 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 20:21:22.737211 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.737193 2566 log.go:25] "Validated CRI v1 runtime API" Jul 10 20:21:22.739375 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.739359 2566 log.go:25] "Validated CRI v1 image API" Jul 10 20:21:22.740878 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.740862 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 20:21:22.745078 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.745035 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 97a30b4d-b39e-4490-9335-a062edd43b05:/dev/nvme0n1p4 e7d8c592-cae3-45d6-b741-70060a9fc624:/dev/nvme0n1p3] Jul 10 20:21:22.745169 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.745079 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 20:21:22.750255 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.750238 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 20:21:22.750359 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.750218 2566 manager.go:216] Machine: {Timestamp:2026-07-10 20:21:22.748728405 +0000 UTC m=+0.367161399 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099174 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2971b94f160dcebbc77da46207bbdd SystemUUID:ec2971b9-4f16-0dce-bbc7-7da46207bbdd BootID:eb131484-8ade-4807-a9a8-ae605161c02c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:f0:72:6a:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:f0:72:6a:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:3d:8d:e0:85:a8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 20:21:22.750416 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.750362 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 20:21:22.750469 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.750457 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 20:21:22.751532 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.751505 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 20:21:22.751679 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.751535 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-138.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 20:21:22.752901 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.752888 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 20:21:22.752933 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.752904 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 20:21:22.752933 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.752912 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 20:21:22.753526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.753515 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 20:21:22.754338 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.754328 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 20:21:22.758373 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.758359 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 10 20:21:22.758485 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.758476 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 20:21:22.758528 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.758509 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 10 20:21:22.758528 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.758521 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 20:21:22.758590 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.758532 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 20:21:22.758590 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.758544 2566 kubelet.go:398] "Adding apiserver pod source" Jul 10 20:21:22.758590 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.758553 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 20:21:22.758952 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.758940 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 20:21:22.758991 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.758961 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 20:21:22.761855 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.761831 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 20:21:22.763324 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.763310 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 20:21:22.763379 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.763340 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 20:21:22.763937 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.763926 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 20:21:22.763972 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.763942 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 20:21:22.763972 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.763948 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 20:21:22.763972 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.763954 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 20:21:22.763972 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.763962 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 20:21:22.763972 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.763968 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 20:21:22.764112 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.764080 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 20:21:22.764112 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.764086 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 20:21:22.764112 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.764093 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 20:21:22.764112 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.764098 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 20:21:22.764112 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.764106 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 20:21:22.764112 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.764114 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 20:21:22.764732 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.764722 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 20:21:22.764732 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.764731 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 20:21:22.768161 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.768144 2566 server.go:1268] "Started kubelet" Jul 10 20:21:22.768250 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.768216 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 20:21:22.768302 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.768271 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 20:21:22.768333 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.768222 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 20:21:22.772456 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.772433 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 20:21:22.772879 ip-10-0-130-138 systemd[1]: Started Kubernetes Kubelet. Jul 10 20:21:22.775047 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.775024 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wmgzh" Jul 10 20:21:22.775951 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.775926 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-138.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 20:21:22.776236 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.776202 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 20:21:22.777800 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.777784 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 10 20:21:22.778227 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.778212 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wmgzh" Jul 10 20:21:22.779048 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.779029 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 20:21:22.779139 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.779032 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 20:21:22.780046 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.779139 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-138.ec2.internal.18c1073c3ff88619 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-138.ec2.internal,UID:ip-10-0-130-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-138.ec2.internal,},FirstTimestamp:2026-07-10 20:21:22.768111129 +0000 UTC m=+0.386544122,LastTimestamp:2026-07-10 20:21:22.768111129 +0000 UTC m=+0.386544122,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-138.ec2.internal,}" Jul 10 20:21:22.781346 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.781331 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 20:21:22.781408 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.781351 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 20:21:22.781455 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.781419 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-138.ec2.internal\" not found" Jul 10 20:21:22.781972 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.781952 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 20:21:22.782048 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.782038 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 20:21:22.782048 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.782068 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 20:21:22.782207 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.782188 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 10 20:21:22.782207 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.782202 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 10 20:21:22.782877 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.782572 2566 factory.go:55] Registering systemd factory Jul 10 20:21:22.782877 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.782589 2566 factory.go:223] Registration of the systemd container factory successfully Jul 10 20:21:22.782877 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.782820 2566 factory.go:153] Registering CRI-O factory Jul 10 20:21:22.782877 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.782837 2566 factory.go:223] Registration of the crio container factory successfully Jul 10 20:21:22.783091 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.782888 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 20:21:22.783091 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.782916 2566 factory.go:103] Registering Raw factory Jul 10 20:21:22.783091 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.782932 2566 manager.go:1196] Started watching for new ooms in manager Jul 10 20:21:22.783328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.783314 2566 manager.go:349] Starting recovery of all containers Jul 10 20:21:22.783556 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.783534 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 20:21:22.783679 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.783658 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 20:21:22.792129 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.791920 2566 manager.go:354] Recovery completed Jul 10 20:21:22.796876 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.796858 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:22.799427 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.799404 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:22.799581 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.799561 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:22.799697 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.799587 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:22.800810 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.800794 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 20:21:22.800810 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.800804 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:22.800942 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.800808 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 20:21:22.800942 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.800865 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 10 20:21:22.801547 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.801530 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:22.801613 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.801565 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:22.801613 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.801579 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:22.802158 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.802142 2566 policy_none.go:49] "None policy: Start" Jul 10 20:21:22.802158 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.802160 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 20:21:22.802300 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.802173 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 20:21:22.803259 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.803245 2566 policy_none.go:47] "Start" Jul 10 20:21:22.836704 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.836684 2566 manager.go:337] "Starting Device Plugin manager" Jul 10 20:21:22.836869 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.836724 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 20:21:22.836869 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.836735 2566 server.go:87] "Starting device plugin registration server" Jul 10 20:21:22.837011 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.836998 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 20:21:22.837097 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.837012 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 20:21:22.837153 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.837131 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 20:21:22.837218 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.837206 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 20:21:22.837263 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.837219 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 20:21:22.837805 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.837786 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 20:21:22.837917 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.837835 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-138.ec2.internal\" not found" Jul 10 20:21:22.937492 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.937454 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:22.938627 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.938454 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:22.938627 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.938489 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:22.938627 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.938500 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:22.938627 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.938526 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-138.ec2.internal" Jul 10 20:21:22.944250 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.944199 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-138.ec2.internal" Jul 10 20:21:22.944250 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.944225 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-138.ec2.internal\": node \"ip-10-0-130-138.ec2.internal\" not found" Jul 10 20:21:22.957531 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.957500 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-138.ec2.internal\" not found" Jul 10 20:21:22.959706 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.959678 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 20:21:22.961017 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.961002 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 20:21:22.961108 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.961044 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 20:21:22.961108 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.961089 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 20:21:22.961196 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:22.961131 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 20:21:22.963488 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:22.963464 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:23.058375 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.058340 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-138.ec2.internal\" not found" Jul 10 20:21:23.061492 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.061468 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-138.ec2.internal"] Jul 10 20:21:23.061580 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.061561 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:23.063272 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.063255 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:23.063365 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.063285 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:23.063365 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.063296 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:23.064603 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.064591 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:23.064713 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.064698 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.064763 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.064728 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:23.065347 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.065333 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:23.065413 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.065352 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:23.065413 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.065359 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:23.065413 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.065369 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:23.065413 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.065371 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:23.065413 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.065381 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:23.066518 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.066503 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.066570 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.066533 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:23.067346 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.067331 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:23.067426 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.067356 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:23.067426 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.067365 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:23.083500 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.083471 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e12d611af29cd9500aadab9d5e999d27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal\" (UID: \"e12d611af29cd9500aadab9d5e999d27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.083613 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.083508 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be4a4a55f775b92d647c8d6c2a1d68b2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-138.ec2.internal\" (UID: \"be4a4a55f775b92d647c8d6c2a1d68b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.083613 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.083532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e12d611af29cd9500aadab9d5e999d27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal\" (UID: \"e12d611af29cd9500aadab9d5e999d27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.089907 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.089890 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-138.ec2.internal\" not found" node="ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.094596 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.094577 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-138.ec2.internal\" not found" node="ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.159266 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.159233 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-138.ec2.internal\" not found" Jul 10 20:21:23.184501 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.184473 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e12d611af29cd9500aadab9d5e999d27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal\" (UID: \"e12d611af29cd9500aadab9d5e999d27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.184632 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.184514 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e12d611af29cd9500aadab9d5e999d27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal\" (UID: \"e12d611af29cd9500aadab9d5e999d27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.184632 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.184539 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be4a4a55f775b92d647c8d6c2a1d68b2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-138.ec2.internal\" (UID: \"be4a4a55f775b92d647c8d6c2a1d68b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.184632 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.184587 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e12d611af29cd9500aadab9d5e999d27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal\" (UID: \"e12d611af29cd9500aadab9d5e999d27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.184753 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.184592 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e12d611af29cd9500aadab9d5e999d27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal\" (UID: \"e12d611af29cd9500aadab9d5e999d27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.184753 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.184596 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be4a4a55f775b92d647c8d6c2a1d68b2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-138.ec2.internal\" (UID: \"be4a4a55f775b92d647c8d6c2a1d68b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.261430 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.261345 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-138.ec2.internal\" not found" Jul 10 20:21:23.366914 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.366870 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-138.ec2.internal\" not found" Jul 10 20:21:23.393272 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.393241 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.397715 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.397442 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.468693 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.468641 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-138.ec2.internal\" not found" Jul 10 20:21:23.574185 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.574110 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-138.ec2.internal\" not found" Jul 10 20:21:23.605262 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.605234 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:23.682281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.682250 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.693219 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.693195 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 20:21:23.695801 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.695786 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" Jul 10 20:21:23.706237 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.706220 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 20:21:23.719359 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.719333 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 20:21:23.719511 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.719489 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 20:21:23.719568 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.719493 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 20:21:23.760705 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.760670 2566 apiserver.go:52] "Watching apiserver" Jul 10 20:21:23.781513 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.781482 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 20:21:23.781676 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.781482 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 20:21:23.782209 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.782143 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 20:16:23 +0000 UTC" deadline="2028-04-16 15:22:43.630700272 +0000 UTC" Jul 10 20:21:23.782363 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.782210 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15499h1m19.84849556s" Jul 10 20:21:23.782494 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.782472 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal","openshift-multus/multus-additional-cni-plugins-b45xk","kube-system/global-pull-secret-syncer-lkpwk","openshift-multus/multus-blzc9","openshift-multus/network-metrics-daemon-2m52m","openshift-network-diagnostics/network-check-target-bxdr7","openshift-network-operator/iptables-alerter-dt78x","openshift-ovn-kubernetes/ovnkube-node-4g59x","kube-system/konnectivity-agent-cwrfk","kube-system/kube-apiserver-proxy-ip-10-0-130-138.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns","openshift-cluster-node-tuning-operator/tuned-dhjg9","openshift-dns/node-resolver-gk76z","openshift-image-registry/node-ca-bb2fz"] Jul 10 20:21:23.785262 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.785227 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dt78x" Jul 10 20:21:23.786623 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.786602 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gk76z" Jul 10 20:21:23.787813 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.787795 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:23.787907 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.787878 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:23.788990 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.788976 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.790165 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.790151 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:23.790215 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.790202 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:23.791584 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.791568 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:23.791649 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.791631 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:23.792872 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.792858 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cwrfk" Jul 10 20:21:23.794253 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.794236 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bb2fz" Jul 10 20:21:23.795841 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.795825 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.796182 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.796163 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 20:21:23.796236 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.796170 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 20:21:23.796434 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.796421 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d62gr\"" Jul 10 20:21:23.797409 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.797396 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.797880 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.797855 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 20:21:23.797880 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.797876 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 20:21:23.798050 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.797919 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 20:21:23.798050 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.798038 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2dvpf\"" Jul 10 20:21:23.798203 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.798118 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mc449\"" Jul 10 20:21:23.798852 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.798837 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.800186 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.800168 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.800755 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.800738 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 20:21:23.800805 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.800783 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 20:21:23.800864 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.800846 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 20:21:23.801042 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.801029 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 20:21:23.805058 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.805039 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 20:21:23.805185 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.805036 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 20:21:23.805543 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.805525 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 20:21:23.805621 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.805525 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 20:21:23.806128 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.806110 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-psrr5\"" Jul 10 20:21:23.806277 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.806111 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 20:21:23.806395 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.806373 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 20:21:23.806463 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.806379 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 20:21:23.806463 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.806441 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 20:21:23.806463 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.806450 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mskjc\"" Jul 10 20:21:23.807439 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.807414 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 20:21:23.807834 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.807808 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 20:21:23.807834 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.807820 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:21:23.808006 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.807877 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-grs2f\"" Jul 10 20:21:23.808006 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.807907 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 20:21:23.808006 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.807969 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 20:21:23.808693 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.808679 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 20:21:23.808769 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.808758 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 20:21:23.808822 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.808682 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 20:21:23.808909 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.808838 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:21:23.808909 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.808849 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v6snw\"" Jul 10 20:21:23.808909 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.808839 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jr6h6\"" Jul 10 20:21:23.809074 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.808907 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hzbp7\"" Jul 10 20:21:23.812702 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.812683 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 20:21:23.830819 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.830744 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 20:21:23.862149 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.862106 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9lrws" Jul 10 20:21:23.870080 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.870040 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9lrws" Jul 10 20:21:23.883026 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.882999 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 20:21:23.889674 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.889648 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-sysctl-d\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.889754 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.889689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-systemd\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.889754 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.889717 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-run-k8s-cni-cncf-io\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.889754 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.889742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-multus-conf-dir\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.889912 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.889764 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-tuned\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.889912 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.889818 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bb76bc0-7262-46cf-b492-7ccd2e542fe2-tmp-dir\") pod \"node-resolver-gk76z\" (UID: \"1bb76bc0-7262-46cf-b492-7ccd2e542fe2\") " pod="openshift-dns/node-resolver-gk76z" Jul 10 20:21:23.889912 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.889857 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx9hc\" (UniqueName: \"kubernetes.io/projected/1bb76bc0-7262-46cf-b492-7ccd2e542fe2-kube-api-access-mx9hc\") pod \"node-resolver-gk76z\" (UID: \"1bb76bc0-7262-46cf-b492-7ccd2e542fe2\") " pod="openshift-dns/node-resolver-gk76z" Jul 10 20:21:23.889912 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.889888 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-var-lib-kubelet\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.890123 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.889915 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f0e45ba7-808c-4c30-a59f-254878e2da4c-env-overrides\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.890123 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.889939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0e45ba7-808c-4c30-a59f-254878e2da4c-ovn-node-metrics-cert\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.890123 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.889963 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-sys\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.890123 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.889990 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfbcf8ac-64c3-43f1-9830-29ee5390621f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.890123 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890014 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-systemd-units\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.890123 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890053 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-registration-dir\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.890123 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890109 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.890403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890132 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e88eed6b-d362-4848-a548-699f174407ee-host\") pod \"node-ca-bb2fz\" (UID: \"e88eed6b-d362-4848-a548-699f174407ee\") " pod="openshift-image-registry/node-ca-bb2fz" Jul 10 20:21:23.890403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890157 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-sysconfig\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.890403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-run-systemd\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.890403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890193 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.890403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890211 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-system-cni-dir\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.890403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890230 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-cnibin\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.890403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e88eed6b-d362-4848-a548-699f174407ee-serviceca\") pod \"node-ca-bb2fz\" (UID: \"e88eed6b-d362-4848-a548-699f174407ee\") " pod="openshift-image-registry/node-ca-bb2fz" Jul 10 20:21:23.890403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890287 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfbcf8ac-64c3-43f1-9830-29ee5390621f-cni-binary-copy\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.890403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-var-lib-openvswitch\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.890403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890351 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-run-ovn\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.890403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890367 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-hostroot\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890403 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-run-multus-certs\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890444 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk4l7\" (UniqueName: \"kubernetes.io/projected/e88eed6b-d362-4848-a548-699f174407ee-kube-api-access-hk4l7\") pod \"node-ca-bb2fz\" (UID: \"e88eed6b-d362-4848-a548-699f174407ee\") " pod="openshift-image-registry/node-ca-bb2fz" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890463 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-run\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890481 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-slash\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890498 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-device-dir\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890513 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-multus-cni-dir\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-run-netns\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f0e45ba7-808c-4c30-a59f-254878e2da4c-ovnkube-config\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890611 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f44a784-5924-4a01-afa5-1ac2e91aba36-kubelet-config\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890641 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-var-lib-cni-multus\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890667 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/55696fe0-0df3-401d-b9d6-8893f1b05e6f-agent-certs\") pod \"konnectivity-agent-cwrfk\" (UID: \"55696fe0-0df3-401d-b9d6-8893f1b05e6f\") " pod="kube-system/konnectivity-agent-cwrfk" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890692 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-kubernetes\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890718 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc6cx\" (UniqueName: \"kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx\") pod \"network-check-target-bxdr7\" (UID: \"d068e535-c013-4fa2-8158-1b6765b77e9b\") " pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890744 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfbcf8ac-64c3-43f1-9830-29ee5390621f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.890867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890768 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-cni-bin\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-multus-socket-dir-parent\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-os-release\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a30c286-7732-4e5d-9fdf-baf93eb89e66-multus-daemon-config\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890873 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-modprobe-d\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-lib-modules\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-var-lib-kubelet\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890944 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfbcf8ac-64c3-43f1-9830-29ee5390621f-os-release\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7e2db227-46b7-43ab-83af-a975b0eb1f0e-iptables-alerter-script\") pod \"iptables-alerter-dt78x\" (UID: \"7e2db227-46b7-43ab-83af-a975b0eb1f0e\") " pod="openshift-network-operator/iptables-alerter-dt78x" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.890995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e2db227-46b7-43ab-83af-a975b0eb1f0e-host-slash\") pod \"iptables-alerter-dt78x\" (UID: \"7e2db227-46b7-43ab-83af-a975b0eb1f0e\") " pod="openshift-network-operator/iptables-alerter-dt78x" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891027 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k6sm\" (UniqueName: \"kubernetes.io/projected/7e2db227-46b7-43ab-83af-a975b0eb1f0e-kube-api-access-4k6sm\") pod \"iptables-alerter-dt78x\" (UID: \"7e2db227-46b7-43ab-83af-a975b0eb1f0e\") " pod="openshift-network-operator/iptables-alerter-dt78x" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfbcf8ac-64c3-43f1-9830-29ee5390621f-system-cni-dir\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891116 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfbcf8ac-64c3-43f1-9830-29ee5390621f-cnibin\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdgzw\" (UniqueName: \"kubernetes.io/projected/dfbcf8ac-64c3-43f1-9830-29ee5390621f-kube-api-access-sdgzw\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891192 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-run-openvswitch\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.891685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891217 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-sysctl-conf\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891270 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-run-ovn-kubernetes\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891306 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-socket-dir\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891334 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891357 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-run-netns\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891383 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq6nn\" (UniqueName: \"kubernetes.io/projected/9a30c286-7732-4e5d-9fdf-baf93eb89e66-kube-api-access-nq6nn\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891430 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-kubelet\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891458 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-log-socket\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891489 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-cni-netd\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891513 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f0e45ba7-808c-4c30-a59f-254878e2da4c-ovnkube-script-lib\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-sys-fs\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891568 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-etc-kubernetes\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891592 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/55696fe0-0df3-401d-b9d6-8893f1b05e6f-konnectivity-ca\") pod \"konnectivity-agent-cwrfk\" (UID: \"55696fe0-0df3-401d-b9d6-8893f1b05e6f\") " pod="kube-system/konnectivity-agent-cwrfk" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891636 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n94r8\" (UniqueName: \"kubernetes.io/projected/9300a4a2-82bc-450e-8fe5-c5382a177fa4-kube-api-access-n94r8\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891667 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-etc-openvswitch\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891688 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-node-log\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.892233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891703 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdt4t\" (UniqueName: \"kubernetes.io/projected/f0e45ba7-808c-4c30-a59f-254878e2da4c-kube-api-access-qdt4t\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.892829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891730 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swhtk\" (UniqueName: \"kubernetes.io/projected/5493c772-af7e-440f-a536-c8321ff052e6-kube-api-access-swhtk\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.892829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891753 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-var-lib-cni-bin\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.892829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891768 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-host\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.892829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891783 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfcpx\" (UniqueName: \"kubernetes.io/projected/d732d771-ba90-43a3-a24b-d5381dbcc33f-kube-api-access-vfcpx\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.892829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891805 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfbcf8ac-64c3-43f1-9830-29ee5390621f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.892829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891837 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f44a784-5924-4a01-afa5-1ac2e91aba36-dbus\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:23.892829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891857 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a30c286-7732-4e5d-9fdf-baf93eb89e66-cni-binary-copy\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.892829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891872 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d732d771-ba90-43a3-a24b-d5381dbcc33f-tmp\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.892829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.891886 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1bb76bc0-7262-46cf-b492-7ccd2e542fe2-hosts-file\") pod \"node-resolver-gk76z\" (UID: \"1bb76bc0-7262-46cf-b492-7ccd2e542fe2\") " pod="openshift-dns/node-resolver-gk76z" Jul 10 20:21:23.958745 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.958708 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:23.992188 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992151 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-lib-modules\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.992188 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992194 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-var-lib-kubelet\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.992450 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992228 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfbcf8ac-64c3-43f1-9830-29ee5390621f-os-release\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.992450 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992254 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7e2db227-46b7-43ab-83af-a975b0eb1f0e-iptables-alerter-script\") pod \"iptables-alerter-dt78x\" (UID: \"7e2db227-46b7-43ab-83af-a975b0eb1f0e\") " pod="openshift-network-operator/iptables-alerter-dt78x" Jul 10 20:21:23.992450 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992274 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e2db227-46b7-43ab-83af-a975b0eb1f0e-host-slash\") pod \"iptables-alerter-dt78x\" (UID: \"7e2db227-46b7-43ab-83af-a975b0eb1f0e\") " pod="openshift-network-operator/iptables-alerter-dt78x" Jul 10 20:21:23.992450 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992298 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k6sm\" (UniqueName: \"kubernetes.io/projected/7e2db227-46b7-43ab-83af-a975b0eb1f0e-kube-api-access-4k6sm\") pod \"iptables-alerter-dt78x\" (UID: \"7e2db227-46b7-43ab-83af-a975b0eb1f0e\") " pod="openshift-network-operator/iptables-alerter-dt78x" Jul 10 20:21:23.992450 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992326 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-lib-modules\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.992450 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992349 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfbcf8ac-64c3-43f1-9830-29ee5390621f-os-release\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.992450 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992372 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:23.992450 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992354 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e2db227-46b7-43ab-83af-a975b0eb1f0e-host-slash\") pod \"iptables-alerter-dt78x\" (UID: \"7e2db227-46b7-43ab-83af-a975b0eb1f0e\") " pod="openshift-network-operator/iptables-alerter-dt78x" Jul 10 20:21:23.992450 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992381 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-var-lib-kubelet\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.992450 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992411 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfbcf8ac-64c3-43f1-9830-29ee5390621f-system-cni-dir\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992465 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfbcf8ac-64c3-43f1-9830-29ee5390621f-system-cni-dir\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992495 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfbcf8ac-64c3-43f1-9830-29ee5390621f-cnibin\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992529 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdgzw\" (UniqueName: \"kubernetes.io/projected/dfbcf8ac-64c3-43f1-9830-29ee5390621f-kube-api-access-sdgzw\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992557 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-run-openvswitch\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992586 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-sysctl-conf\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992595 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfbcf8ac-64c3-43f1-9830-29ee5390621f-cnibin\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992612 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-run-ovn-kubernetes\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992638 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-socket-dir\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992666 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.992684 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992692 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-run-netns\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992718 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq6nn\" (UniqueName: \"kubernetes.io/projected/9a30c286-7732-4e5d-9fdf-baf93eb89e66-kube-api-access-nq6nn\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.992771 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs podName:9300a4a2-82bc-450e-8fe5-c5382a177fa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:24.492728828 +0000 UTC m=+2.111161819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs") pod "network-metrics-daemon-2m52m" (UID: "9300a4a2-82bc-450e-8fe5-c5382a177fa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992797 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-kubelet\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992820 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-sysctl-conf\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.992825 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-log-socket\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992873 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-cni-netd\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992894 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7e2db227-46b7-43ab-83af-a975b0eb1f0e-iptables-alerter-script\") pod \"iptables-alerter-dt78x\" (UID: \"7e2db227-46b7-43ab-83af-a975b0eb1f0e\") " pod="openshift-network-operator/iptables-alerter-dt78x" Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992902 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-log-socket\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992911 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f0e45ba7-808c-4c30-a59f-254878e2da4c-ovnkube-script-lib\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992932 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-sys-fs\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992972 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-cni-netd\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.992975 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-etc-kubernetes\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.993023 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.993036 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-kubelet\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.993074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/55696fe0-0df3-401d-b9d6-8893f1b05e6f-konnectivity-ca\") pod \"konnectivity-agent-cwrfk\" (UID: \"55696fe0-0df3-401d-b9d6-8893f1b05e6f\") " pod="kube-system/konnectivity-agent-cwrfk" Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:23.993074 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret podName:5f44a784-5924-4a01-afa5-1ac2e91aba36 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:24.493056157 +0000 UTC m=+2.111489155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret") pod "global-pull-secret-syncer-lkpwk" (UID: "5f44a784-5924-4a01-afa5-1ac2e91aba36") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.993131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n94r8\" (UniqueName: \"kubernetes.io/projected/9300a4a2-82bc-450e-8fe5-c5382a177fa4-kube-api-access-n94r8\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:23.993573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.993186 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-sys-fs\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.994062 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.993960 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-etc-kubernetes\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.994062 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994031 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f0e45ba7-808c-4c30-a59f-254878e2da4c-ovnkube-script-lib\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.994062 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994024 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-run-ovn-kubernetes\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.994062 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994052 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/55696fe0-0df3-401d-b9d6-8893f1b05e6f-konnectivity-ca\") pod \"konnectivity-agent-cwrfk\" (UID: \"55696fe0-0df3-401d-b9d6-8893f1b05e6f\") " pod="kube-system/konnectivity-agent-cwrfk" Jul 10 20:21:23.994339 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994164 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-socket-dir\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.994339 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994192 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-run-netns\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.994339 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994223 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-etc-openvswitch\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.994339 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994249 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-run-openvswitch\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.994339 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994262 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-node-log\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.994339 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994295 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdt4t\" (UniqueName: \"kubernetes.io/projected/f0e45ba7-808c-4c30-a59f-254878e2da4c-kube-api-access-qdt4t\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.994339 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994331 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swhtk\" (UniqueName: \"kubernetes.io/projected/5493c772-af7e-440f-a536-c8321ff052e6-kube-api-access-swhtk\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.994339 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994339 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-etc-openvswitch\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994364 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-var-lib-cni-bin\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994391 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-host\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994422 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfcpx\" (UniqueName: \"kubernetes.io/projected/d732d771-ba90-43a3-a24b-d5381dbcc33f-kube-api-access-vfcpx\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994458 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfbcf8ac-64c3-43f1-9830-29ee5390621f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994491 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f44a784-5924-4a01-afa5-1ac2e91aba36-dbus\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994516 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a30c286-7732-4e5d-9fdf-baf93eb89e66-cni-binary-copy\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994547 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d732d771-ba90-43a3-a24b-d5381dbcc33f-tmp\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994580 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1bb76bc0-7262-46cf-b492-7ccd2e542fe2-hosts-file\") pod \"node-resolver-gk76z\" (UID: \"1bb76bc0-7262-46cf-b492-7ccd2e542fe2\") " pod="openshift-dns/node-resolver-gk76z" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994616 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-sysctl-d\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994647 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-systemd\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994677 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-run-k8s-cni-cncf-io\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994703 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-multus-conf-dir\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.994764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994743 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-tuned\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bb76bc0-7262-46cf-b492-7ccd2e542fe2-tmp-dir\") pod \"node-resolver-gk76z\" (UID: \"1bb76bc0-7262-46cf-b492-7ccd2e542fe2\") " pod="openshift-dns/node-resolver-gk76z" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994805 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx9hc\" (UniqueName: \"kubernetes.io/projected/1bb76bc0-7262-46cf-b492-7ccd2e542fe2-kube-api-access-mx9hc\") pod \"node-resolver-gk76z\" (UID: \"1bb76bc0-7262-46cf-b492-7ccd2e542fe2\") " pod="openshift-dns/node-resolver-gk76z" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994832 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-var-lib-kubelet\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994862 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f0e45ba7-808c-4c30-a59f-254878e2da4c-env-overrides\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994897 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0e45ba7-808c-4c30-a59f-254878e2da4c-ovn-node-metrics-cert\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994929 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-sys\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994960 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfbcf8ac-64c3-43f1-9830-29ee5390621f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.994985 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-systemd-units\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995019 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-registration-dir\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995049 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995080 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e88eed6b-d362-4848-a548-699f174407ee-host\") pod \"node-ca-bb2fz\" (UID: \"e88eed6b-d362-4848-a548-699f174407ee\") " pod="openshift-image-registry/node-ca-bb2fz" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-sysconfig\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-run-systemd\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995203 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995230 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-system-cni-dir\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995261 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-cnibin\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.995328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995295 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e88eed6b-d362-4848-a548-699f174407ee-serviceca\") pod \"node-ca-bb2fz\" (UID: \"e88eed6b-d362-4848-a548-699f174407ee\") " pod="openshift-image-registry/node-ca-bb2fz" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995328 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfbcf8ac-64c3-43f1-9830-29ee5390621f-cni-binary-copy\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995354 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-var-lib-openvswitch\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995385 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-run-ovn\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-hostroot\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-run-multus-certs\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995477 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk4l7\" (UniqueName: \"kubernetes.io/projected/e88eed6b-d362-4848-a548-699f174407ee-kube-api-access-hk4l7\") pod \"node-ca-bb2fz\" (UID: \"e88eed6b-d362-4848-a548-699f174407ee\") " pod="openshift-image-registry/node-ca-bb2fz" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995503 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-run\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995534 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-slash\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995565 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-device-dir\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-multus-cni-dir\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995627 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-run-netns\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995653 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f0e45ba7-808c-4c30-a59f-254878e2da4c-ovnkube-config\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995686 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995716 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f44a784-5924-4a01-afa5-1ac2e91aba36-kubelet-config\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-var-lib-cni-multus\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995784 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/55696fe0-0df3-401d-b9d6-8893f1b05e6f-agent-certs\") pod \"konnectivity-agent-cwrfk\" (UID: \"55696fe0-0df3-401d-b9d6-8893f1b05e6f\") " pod="kube-system/konnectivity-agent-cwrfk" Jul 10 20:21:23.996029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995817 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-kubernetes\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.996699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995863 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6cx\" (UniqueName: \"kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx\") pod \"network-check-target-bxdr7\" (UID: \"d068e535-c013-4fa2-8158-1b6765b77e9b\") " pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:23.996699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995895 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfbcf8ac-64c3-43f1-9830-29ee5390621f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.996699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995925 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-cni-bin\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.996699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995952 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-multus-socket-dir-parent\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.996699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.995989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-os-release\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.996699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.996022 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a30c286-7732-4e5d-9fdf-baf93eb89e66-multus-daemon-config\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.996699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.996056 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-modprobe-d\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.996699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.996269 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-modprobe-d\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.996699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.996492 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-var-lib-cni-bin\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.996699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.996558 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-host\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.997263 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997240 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfbcf8ac-64c3-43f1-9830-29ee5390621f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.997363 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997334 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f44a784-5924-4a01-afa5-1ac2e91aba36-dbus\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:23.997564 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997545 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-node-log\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.997610 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997579 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-run-ovn\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.997610 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997592 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-systemd\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.997693 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997629 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f44a784-5924-4a01-afa5-1ac2e91aba36-kubelet-config\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:23.997693 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997644 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-multus-conf-dir\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.997778 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997708 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-var-lib-cni-multus\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.997778 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997724 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-sysctl-d\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.997778 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997765 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-run-k8s-cni-cncf-io\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.997894 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997824 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1bb76bc0-7262-46cf-b492-7ccd2e542fe2-hosts-file\") pod \"node-resolver-gk76z\" (UID: \"1bb76bc0-7262-46cf-b492-7ccd2e542fe2\") " pod="openshift-dns/node-resolver-gk76z" Jul 10 20:21:23.997894 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997845 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-cni-bin\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.998006 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997985 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfbcf8ac-64c3-43f1-9830-29ee5390621f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:23.998052 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.998008 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-multus-socket-dir-parent\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.998052 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997977 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 20:21:23.998156 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.998061 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-hostroot\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.998156 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.998118 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-run-multus-certs\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.998347 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.998323 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-os-release\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.998403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.998340 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-run\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.998460 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.998411 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-slash\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.998543 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.998519 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-device-dir\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.998615 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.998595 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-kubernetes\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:23.998819 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.998527 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f0e45ba7-808c-4c30-a59f-254878e2da4c-ovnkube-config\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.998952 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.998872 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-multus-cni-dir\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:23.998952 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.998888 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-run-netns\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.999089 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.998954 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-var-lib-openvswitch\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:23.999089 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.999035 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-registration-dir\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.999089 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.999044 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:23.999304 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.999282 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a30c286-7732-4e5d-9fdf-baf93eb89e66-multus-daemon-config\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:24.000116 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.000077 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfbcf8ac-64c3-43f1-9830-29ee5390621f-cni-binary-copy\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:24.000116 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.000105 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bb76bc0-7262-46cf-b492-7ccd2e542fe2-tmp-dir\") pod \"node-resolver-gk76z\" (UID: \"1bb76bc0-7262-46cf-b492-7ccd2e542fe2\") " pod="openshift-dns/node-resolver-gk76z" Jul 10 20:21:24.000352 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.000122 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-host-var-lib-kubelet\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:24.000352 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.000277 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f0e45ba7-808c-4c30-a59f-254878e2da4c-env-overrides\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:24.000486 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.000398 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-run-systemd\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:24.000548 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.000497 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a30c286-7732-4e5d-9fdf-baf93eb89e66-cni-binary-copy\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:24.000609 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.000564 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e88eed6b-d362-4848-a548-699f174407ee-host\") pod \"node-ca-bb2fz\" (UID: \"e88eed6b-d362-4848-a548-699f174407ee\") " pod="openshift-image-registry/node-ca-bb2fz" Jul 10 20:21:24.001294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.000770 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-sys\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:24.001294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.000510 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5493c772-af7e-440f-a536-c8321ff052e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:24.001294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.000925 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-sysconfig\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:24.001294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.000992 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-systemd-units\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:24.001294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.001068 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-system-cni-dir\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:24.001294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.001159 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0e45ba7-808c-4c30-a59f-254878e2da4c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:24.001902 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.001726 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a30c286-7732-4e5d-9fdf-baf93eb89e66-cnibin\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:24.001902 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:23.997986 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e88eed6b-d362-4848-a548-699f174407ee-serviceca\") pod \"node-ca-bb2fz\" (UID: \"e88eed6b-d362-4848-a548-699f174407ee\") " pod="openshift-image-registry/node-ca-bb2fz" Jul 10 20:21:24.002759 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.002672 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfbcf8ac-64c3-43f1-9830-29ee5390621f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:24.003544 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.003511 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq6nn\" (UniqueName: \"kubernetes.io/projected/9a30c286-7732-4e5d-9fdf-baf93eb89e66-kube-api-access-nq6nn\") pod \"multus-blzc9\" (UID: \"9a30c286-7732-4e5d-9fdf-baf93eb89e66\") " pod="openshift-multus/multus-blzc9" Jul 10 20:21:24.004551 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.004530 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k6sm\" (UniqueName: \"kubernetes.io/projected/7e2db227-46b7-43ab-83af-a975b0eb1f0e-kube-api-access-4k6sm\") pod \"iptables-alerter-dt78x\" (UID: \"7e2db227-46b7-43ab-83af-a975b0eb1f0e\") " pod="openshift-network-operator/iptables-alerter-dt78x" Jul 10 20:21:24.004676 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.004645 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdgzw\" (UniqueName: \"kubernetes.io/projected/dfbcf8ac-64c3-43f1-9830-29ee5390621f-kube-api-access-sdgzw\") pod \"multus-additional-cni-plugins-b45xk\" (UID: \"dfbcf8ac-64c3-43f1-9830-29ee5390621f\") " pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:24.004742 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.004714 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n94r8\" (UniqueName: \"kubernetes.io/projected/9300a4a2-82bc-450e-8fe5-c5382a177fa4-kube-api-access-n94r8\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:24.006128 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.004929 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0e45ba7-808c-4c30-a59f-254878e2da4c-ovn-node-metrics-cert\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:24.006128 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.005378 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/55696fe0-0df3-401d-b9d6-8893f1b05e6f-agent-certs\") pod \"konnectivity-agent-cwrfk\" (UID: \"55696fe0-0df3-401d-b9d6-8893f1b05e6f\") " pod="kube-system/konnectivity-agent-cwrfk" Jul 10 20:21:24.006128 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.005784 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d732d771-ba90-43a3-a24b-d5381dbcc33f-etc-tuned\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:24.006128 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.005835 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:24.006128 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.005858 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:24.006128 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.005870 2566 projected.go:196] Error preparing data for projected volume kube-api-access-fc6cx for pod openshift-network-diagnostics/network-check-target-bxdr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:24.006128 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.005948 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx podName:d068e535-c013-4fa2-8158-1b6765b77e9b nodeName:}" failed. No retries permitted until 2026-07-10 20:21:24.50593223 +0000 UTC m=+2.124365212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6cx" (UniqueName: "kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx") pod "network-check-target-bxdr7" (UID: "d068e535-c013-4fa2-8158-1b6765b77e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:24.007379 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.007323 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfcpx\" (UniqueName: \"kubernetes.io/projected/d732d771-ba90-43a3-a24b-d5381dbcc33f-kube-api-access-vfcpx\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:24.007481 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.007385 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdt4t\" (UniqueName: \"kubernetes.io/projected/f0e45ba7-808c-4c30-a59f-254878e2da4c-kube-api-access-qdt4t\") pod \"ovnkube-node-4g59x\" (UID: \"f0e45ba7-808c-4c30-a59f-254878e2da4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:24.007736 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.007707 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d732d771-ba90-43a3-a24b-d5381dbcc33f-tmp\") pod \"tuned-dhjg9\" (UID: \"d732d771-ba90-43a3-a24b-d5381dbcc33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:24.008572 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.008548 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swhtk\" (UniqueName: \"kubernetes.io/projected/5493c772-af7e-440f-a536-c8321ff052e6-kube-api-access-swhtk\") pod \"aws-ebs-csi-driver-node-tw7ns\" (UID: \"5493c772-af7e-440f-a536-c8321ff052e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:24.008659 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.008625 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk4l7\" (UniqueName: \"kubernetes.io/projected/e88eed6b-d362-4848-a548-699f174407ee-kube-api-access-hk4l7\") pod \"node-ca-bb2fz\" (UID: \"e88eed6b-d362-4848-a548-699f174407ee\") " pod="openshift-image-registry/node-ca-bb2fz" Jul 10 20:21:24.009731 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.009709 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx9hc\" (UniqueName: \"kubernetes.io/projected/1bb76bc0-7262-46cf-b492-7ccd2e542fe2-kube-api-access-mx9hc\") pod \"node-resolver-gk76z\" (UID: \"1bb76bc0-7262-46cf-b492-7ccd2e542fe2\") " pod="openshift-dns/node-resolver-gk76z" Jul 10 20:21:24.021775 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:24.021738 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4a4a55f775b92d647c8d6c2a1d68b2.slice/crio-175e6037bbc3ced2b7ff8f736bc6a7d883a998fbe7d5d98b819aa1b2bbe932e7 WatchSource:0}: Error finding container 175e6037bbc3ced2b7ff8f736bc6a7d883a998fbe7d5d98b819aa1b2bbe932e7: Status 404 returned error can't find the container with id 175e6037bbc3ced2b7ff8f736bc6a7d883a998fbe7d5d98b819aa1b2bbe932e7 Jul 10 20:21:24.029074 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.029057 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 20:21:24.116996 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.116890 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dt78x" Jul 10 20:21:24.125904 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:24.125865 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e2db227_46b7_43ab_83af_a975b0eb1f0e.slice/crio-34deac3a67daf8ce3d8e68a9fc169b3c2072f5d1e332d27946b6f5a3f89402a0 WatchSource:0}: Error finding container 34deac3a67daf8ce3d8e68a9fc169b3c2072f5d1e332d27946b6f5a3f89402a0: Status 404 returned error can't find the container with id 34deac3a67daf8ce3d8e68a9fc169b3c2072f5d1e332d27946b6f5a3f89402a0 Jul 10 20:21:24.134519 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.134483 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gk76z" Jul 10 20:21:24.142654 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:24.142627 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb76bc0_7262_46cf_b492_7ccd2e542fe2.slice/crio-14d03384f82cb9127986af4aa9818487539efe0970fd303df88806ea0559f2e4 WatchSource:0}: Error finding container 14d03384f82cb9127986af4aa9818487539efe0970fd303df88806ea0559f2e4: Status 404 returned error can't find the container with id 14d03384f82cb9127986af4aa9818487539efe0970fd303df88806ea0559f2e4 Jul 10 20:21:24.151891 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.151869 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-blzc9" Jul 10 20:21:24.159492 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:24.159465 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a30c286_7732_4e5d_9fdf_baf93eb89e66.slice/crio-39446d7322da538438d5a522c8504c0c17b850183787e4fc43e65c06bbcd990b WatchSource:0}: Error finding container 39446d7322da538438d5a522c8504c0c17b850183787e4fc43e65c06bbcd990b: Status 404 returned error can't find the container with id 39446d7322da538438d5a522c8504c0c17b850183787e4fc43e65c06bbcd990b Jul 10 20:21:24.174866 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.174836 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cwrfk" Jul 10 20:21:24.183159 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:24.183130 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55696fe0_0df3_401d_b9d6_8893f1b05e6f.slice/crio-d94ba7a648ec6502fdf892bb03bc9b1497e37f9c129a5f51c707c08f3592f642 WatchSource:0}: Error finding container d94ba7a648ec6502fdf892bb03bc9b1497e37f9c129a5f51c707c08f3592f642: Status 404 returned error can't find the container with id d94ba7a648ec6502fdf892bb03bc9b1497e37f9c129a5f51c707c08f3592f642 Jul 10 20:21:24.195003 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.194982 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bb2fz" Jul 10 20:21:24.203154 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:24.203105 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88eed6b_d362_4848_a548_699f174407ee.slice/crio-3414aa9dd0e00f4f1f837fb0c76bfe6714c111a267a8bdddfbb273a05e25c63a WatchSource:0}: Error finding container 3414aa9dd0e00f4f1f837fb0c76bfe6714c111a267a8bdddfbb273a05e25c63a: Status 404 returned error can't find the container with id 3414aa9dd0e00f4f1f837fb0c76bfe6714c111a267a8bdddfbb273a05e25c63a Jul 10 20:21:24.220688 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.220650 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b45xk" Jul 10 20:21:24.228790 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:24.228763 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfbcf8ac_64c3_43f1_9830_29ee5390621f.slice/crio-05bf65484583ed7c4c92c11508636d6d035c9928b472c7830b5c62218004904c WatchSource:0}: Error finding container 05bf65484583ed7c4c92c11508636d6d035c9928b472c7830b5c62218004904c: Status 404 returned error can't find the container with id 05bf65484583ed7c4c92c11508636d6d035c9928b472c7830b5c62218004904c Jul 10 20:21:24.238294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.238271 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:24.247121 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:24.247093 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e45ba7_808c_4c30_a59f_254878e2da4c.slice/crio-d4f2cae8af60cd94407ff3a2669a70917ec410a7c57468f9e0f202606a9431b6 WatchSource:0}: Error finding container d4f2cae8af60cd94407ff3a2669a70917ec410a7c57468f9e0f202606a9431b6: Status 404 returned error can't find the container with id d4f2cae8af60cd94407ff3a2669a70917ec410a7c57468f9e0f202606a9431b6 Jul 10 20:21:24.254660 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.254632 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" Jul 10 20:21:24.260290 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.260269 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" Jul 10 20:21:24.264213 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:24.264188 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5493c772_af7e_440f_a536_c8321ff052e6.slice/crio-217504bdab9faf3b5d5b036be2e28b81cbbcda71db666d720c362b6102416ae1 WatchSource:0}: Error finding container 217504bdab9faf3b5d5b036be2e28b81cbbcda71db666d720c362b6102416ae1: Status 404 returned error can't find the container with id 217504bdab9faf3b5d5b036be2e28b81cbbcda71db666d720c362b6102416ae1 Jul 10 20:21:24.268328 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:24.268305 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd732d771_ba90_43a3_a24b_d5381dbcc33f.slice/crio-b91d1b15aa35dc0776cb11271c1f3ed00054296bb3ebbb5c1459dbd598cdc8b9 WatchSource:0}: Error finding container b91d1b15aa35dc0776cb11271c1f3ed00054296bb3ebbb5c1459dbd598cdc8b9: Status 404 returned error can't find the container with id b91d1b15aa35dc0776cb11271c1f3ed00054296bb3ebbb5c1459dbd598cdc8b9 Jul 10 20:21:24.311589 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.311556 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:24.498636 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.498538 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:24.498636 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.498595 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:24.498880 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.498709 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:24.498880 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.498709 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:24.498880 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.498779 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs podName:9300a4a2-82bc-450e-8fe5-c5382a177fa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:25.498760746 +0000 UTC m=+3.117193747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs") pod "network-metrics-daemon-2m52m" (UID: "9300a4a2-82bc-450e-8fe5-c5382a177fa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:24.498880 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.498819 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret podName:5f44a784-5924-4a01-afa5-1ac2e91aba36 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:25.498791903 +0000 UTC m=+3.117224906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret") pod "global-pull-secret-syncer-lkpwk" (UID: "5f44a784-5924-4a01-afa5-1ac2e91aba36") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:24.599750 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.599712 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6cx\" (UniqueName: \"kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx\") pod \"network-check-target-bxdr7\" (UID: \"d068e535-c013-4fa2-8158-1b6765b77e9b\") " pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:24.599932 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.599897 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:24.599932 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.599915 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:24.599932 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.599925 2566 projected.go:196] Error preparing data for projected volume kube-api-access-fc6cx for pod openshift-network-diagnostics/network-check-target-bxdr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:24.600154 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.599983 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx podName:d068e535-c013-4fa2-8158-1b6765b77e9b nodeName:}" failed. No retries permitted until 2026-07-10 20:21:25.599963097 +0000 UTC m=+3.218396102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6cx" (UniqueName: "kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx") pod "network-check-target-bxdr7" (UID: "d068e535-c013-4fa2-8158-1b6765b77e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:24.841212 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.841108 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:24.872661 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.872483 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 20:16:24 +0000 UTC" deadline="2028-03-18 23:55:30.493933824 +0000 UTC" Jul 10 20:21:24.872661 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.872524 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14811h34m5.621415246s" Jul 10 20:21:24.962509 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.961922 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:24.962509 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:24.962093 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:24.996471 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.996334 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bb2fz" event={"ID":"e88eed6b-d362-4848-a548-699f174407ee","Type":"ContainerStarted","Data":"3414aa9dd0e00f4f1f837fb0c76bfe6714c111a267a8bdddfbb273a05e25c63a"} Jul 10 20:21:24.999000 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:24.998965 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cwrfk" event={"ID":"55696fe0-0df3-401d-b9d6-8893f1b05e6f","Type":"ContainerStarted","Data":"d94ba7a648ec6502fdf892bb03bc9b1497e37f9c129a5f51c707c08f3592f642"} Jul 10 20:21:25.010033 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.009930 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gk76z" event={"ID":"1bb76bc0-7262-46cf-b492-7ccd2e542fe2","Type":"ContainerStarted","Data":"14d03384f82cb9127986af4aa9818487539efe0970fd303df88806ea0559f2e4"} Jul 10 20:21:25.024049 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.024009 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dt78x" event={"ID":"7e2db227-46b7-43ab-83af-a975b0eb1f0e","Type":"ContainerStarted","Data":"34deac3a67daf8ce3d8e68a9fc169b3c2072f5d1e332d27946b6f5a3f89402a0"} Jul 10 20:21:25.030193 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.029931 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-138.ec2.internal" event={"ID":"be4a4a55f775b92d647c8d6c2a1d68b2","Type":"ContainerStarted","Data":"175e6037bbc3ced2b7ff8f736bc6a7d883a998fbe7d5d98b819aa1b2bbe932e7"} Jul 10 20:21:25.043938 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.043804 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" event={"ID":"d732d771-ba90-43a3-a24b-d5381dbcc33f","Type":"ContainerStarted","Data":"b91d1b15aa35dc0776cb11271c1f3ed00054296bb3ebbb5c1459dbd598cdc8b9"} Jul 10 20:21:25.055488 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.055450 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" event={"ID":"5493c772-af7e-440f-a536-c8321ff052e6","Type":"ContainerStarted","Data":"217504bdab9faf3b5d5b036be2e28b81cbbcda71db666d720c362b6102416ae1"} Jul 10 20:21:25.063993 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.063953 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" event={"ID":"f0e45ba7-808c-4c30-a59f-254878e2da4c","Type":"ContainerStarted","Data":"d4f2cae8af60cd94407ff3a2669a70917ec410a7c57468f9e0f202606a9431b6"} Jul 10 20:21:25.078278 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.078236 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b45xk" event={"ID":"dfbcf8ac-64c3-43f1-9830-29ee5390621f","Type":"ContainerStarted","Data":"05bf65484583ed7c4c92c11508636d6d035c9928b472c7830b5c62218004904c"} Jul 10 20:21:25.090299 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.090198 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-blzc9" event={"ID":"9a30c286-7732-4e5d-9fdf-baf93eb89e66","Type":"ContainerStarted","Data":"39446d7322da538438d5a522c8504c0c17b850183787e4fc43e65c06bbcd990b"} Jul 10 20:21:25.093553 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.093471 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" event={"ID":"e12d611af29cd9500aadab9d5e999d27","Type":"ContainerStarted","Data":"29ec632ae7c0c6483d4bf52397e2d2ed685f97ed7846d0a03c3cb8d0a34822ac"} Jul 10 20:21:25.471303 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.468350 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:25.509402 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.509357 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:25.509600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.509422 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:25.509678 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:25.509609 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:25.509678 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:25.509676 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret podName:5f44a784-5924-4a01-afa5-1ac2e91aba36 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:27.509656319 +0000 UTC m=+5.128089304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret") pod "global-pull-secret-syncer-lkpwk" (UID: "5f44a784-5924-4a01-afa5-1ac2e91aba36") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:25.510114 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:25.510092 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:25.510288 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:25.510165 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs podName:9300a4a2-82bc-450e-8fe5-c5382a177fa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:27.510148046 +0000 UTC m=+5.128581045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs") pod "network-metrics-daemon-2m52m" (UID: "9300a4a2-82bc-450e-8fe5-c5382a177fa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:25.610534 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.610493 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6cx\" (UniqueName: \"kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx\") pod \"network-check-target-bxdr7\" (UID: \"d068e535-c013-4fa2-8158-1b6765b77e9b\") " pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:25.610753 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:25.610728 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:25.610834 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:25.610755 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:25.610834 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:25.610770 2566 projected.go:196] Error preparing data for projected volume kube-api-access-fc6cx for pod openshift-network-diagnostics/network-check-target-bxdr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:25.610955 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:25.610836 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx podName:d068e535-c013-4fa2-8158-1b6765b77e9b nodeName:}" failed. No retries permitted until 2026-07-10 20:21:27.61081511 +0000 UTC m=+5.229248108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6cx" (UniqueName: "kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx") pod "network-check-target-bxdr7" (UID: "d068e535-c013-4fa2-8158-1b6765b77e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:25.873561 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.873443 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 20:16:24 +0000 UTC" deadline="2027-12-05 09:25:05.974821609 +0000 UTC" Jul 10 20:21:25.873561 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.873509 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12301h3m40.101317533s" Jul 10 20:21:25.961400 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.961363 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:25.961596 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:25.961509 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:25.961943 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:25.961923 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:25.962057 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:25.962036 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:26.969234 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:26.969200 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:26.969694 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:26.969341 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:27.529657 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:27.529610 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:27.529867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:27.529698 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:27.529867 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:27.529849 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:27.530165 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:27.529977 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:27.530165 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:27.530038 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret podName:5f44a784-5924-4a01-afa5-1ac2e91aba36 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:31.529898695 +0000 UTC m=+9.148331699 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret") pod "global-pull-secret-syncer-lkpwk" (UID: "5f44a784-5924-4a01-afa5-1ac2e91aba36") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:27.530165 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:27.530067 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs podName:9300a4a2-82bc-450e-8fe5-c5382a177fa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:31.530049478 +0000 UTC m=+9.148482473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs") pod "network-metrics-daemon-2m52m" (UID: "9300a4a2-82bc-450e-8fe5-c5382a177fa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:27.630754 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:27.630706 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6cx\" (UniqueName: \"kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx\") pod \"network-check-target-bxdr7\" (UID: \"d068e535-c013-4fa2-8158-1b6765b77e9b\") " pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:27.630974 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:27.630955 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:27.631063 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:27.630981 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:27.631063 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:27.630995 2566 projected.go:196] Error preparing data for projected volume kube-api-access-fc6cx for pod openshift-network-diagnostics/network-check-target-bxdr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:27.631063 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:27.631061 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx podName:d068e535-c013-4fa2-8158-1b6765b77e9b nodeName:}" failed. No retries permitted until 2026-07-10 20:21:31.63104084 +0000 UTC m=+9.249473872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6cx" (UniqueName: "kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx") pod "network-check-target-bxdr7" (UID: "d068e535-c013-4fa2-8158-1b6765b77e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:27.962347 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:27.962253 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:27.962505 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:27.962373 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:27.962750 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:27.962729 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:27.962848 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:27.962828 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:28.963487 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:28.963443 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:28.963953 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:28.963594 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:29.963066 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:29.962338 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:29.963066 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:29.962478 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:29.963066 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:29.962898 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:29.963066 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:29.963013 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:30.962521 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:30.962189 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:30.962932 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:30.962544 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:31.563235 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:31.563189 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:31.563441 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:31.563254 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:31.563441 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:31.563380 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:31.563441 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:31.563394 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:31.563590 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:31.563470 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret podName:5f44a784-5924-4a01-afa5-1ac2e91aba36 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:39.563447455 +0000 UTC m=+17.181880457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret") pod "global-pull-secret-syncer-lkpwk" (UID: "5f44a784-5924-4a01-afa5-1ac2e91aba36") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:31.563590 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:31.563493 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs podName:9300a4a2-82bc-450e-8fe5-c5382a177fa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:39.563480203 +0000 UTC m=+17.181913191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs") pod "network-metrics-daemon-2m52m" (UID: "9300a4a2-82bc-450e-8fe5-c5382a177fa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:31.664494 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:31.664452 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6cx\" (UniqueName: \"kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx\") pod \"network-check-target-bxdr7\" (UID: \"d068e535-c013-4fa2-8158-1b6765b77e9b\") " pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:31.664693 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:31.664656 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:31.664693 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:31.664682 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:31.664822 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:31.664697 2566 projected.go:196] Error preparing data for projected volume kube-api-access-fc6cx for pod openshift-network-diagnostics/network-check-target-bxdr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:31.664822 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:31.664762 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx podName:d068e535-c013-4fa2-8158-1b6765b77e9b nodeName:}" failed. No retries permitted until 2026-07-10 20:21:39.664741575 +0000 UTC m=+17.283174560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6cx" (UniqueName: "kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx") pod "network-check-target-bxdr7" (UID: "d068e535-c013-4fa2-8158-1b6765b77e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:31.961912 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:31.961829 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:31.962092 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:31.961841 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:31.962092 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:31.961953 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:31.962248 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:31.962094 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:32.964705 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:32.963526 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:32.964705 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:32.963671 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:33.962040 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:33.961996 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:33.962230 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:33.962156 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:33.962558 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:33.962542 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:33.962659 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:33.962640 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:34.961520 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:34.961335 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:34.961520 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:34.961475 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:35.961420 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:35.961388 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:35.961621 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:35.961396 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:35.961621 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:35.961511 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:35.961970 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:35.961631 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:36.961857 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:36.961819 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:36.962291 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:36.961971 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:37.962310 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:37.962270 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:37.962751 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:37.962290 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:37.962751 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:37.962410 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:37.962751 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:37.962450 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:38.961818 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:38.961787 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:38.961993 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:38.961906 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:39.624575 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:39.624543 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:39.624575 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:39.624583 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:39.625081 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:39.624695 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:39.625081 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:39.624695 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:39.625081 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:39.624760 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret podName:5f44a784-5924-4a01-afa5-1ac2e91aba36 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:55.624744099 +0000 UTC m=+33.243177080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret") pod "global-pull-secret-syncer-lkpwk" (UID: "5f44a784-5924-4a01-afa5-1ac2e91aba36") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:39.625081 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:39.624775 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs podName:9300a4a2-82bc-450e-8fe5-c5382a177fa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:55.624768929 +0000 UTC m=+33.243201910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs") pod "network-metrics-daemon-2m52m" (UID: "9300a4a2-82bc-450e-8fe5-c5382a177fa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:39.725447 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:39.725405 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6cx\" (UniqueName: \"kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx\") pod \"network-check-target-bxdr7\" (UID: \"d068e535-c013-4fa2-8158-1b6765b77e9b\") " pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:39.725645 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:39.725590 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:39.725645 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:39.725618 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:39.725645 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:39.725632 2566 projected.go:196] Error preparing data for projected volume kube-api-access-fc6cx for pod openshift-network-diagnostics/network-check-target-bxdr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:39.725797 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:39.725694 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx podName:d068e535-c013-4fa2-8158-1b6765b77e9b nodeName:}" failed. No retries permitted until 2026-07-10 20:21:55.725675773 +0000 UTC m=+33.344108771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6cx" (UniqueName: "kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx") pod "network-check-target-bxdr7" (UID: "d068e535-c013-4fa2-8158-1b6765b77e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:39.961734 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:39.961648 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:39.961734 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:39.961699 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:39.962013 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:39.961787 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:39.962013 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:39.961932 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:40.962183 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:40.962146 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:40.962705 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:40.962286 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:41.962320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:41.961843 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:41.962320 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:41.961970 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:41.962320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:41.962171 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:41.962320 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:41.962280 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:42.962810 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:42.962771 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:42.963283 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:42.962893 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:43.961617 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:43.961578 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:43.961884 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:43.961704 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:43.961884 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:43.961760 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:43.961884 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:43.961872 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:44.963307 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:44.963272 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:44.963747 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:44.963383 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:45.961911 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:45.961701 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:45.962072 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:45.962018 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:45.962166 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:45.962148 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:45.962278 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:45.962256 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:46.157853 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.157596 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-138.ec2.internal" event={"ID":"be4a4a55f775b92d647c8d6c2a1d68b2","Type":"ContainerStarted","Data":"99a82f26dd5d628128d3a519340bd1ae2e73b485ed54c1e3ab953dd6621f7fd8"} Jul 10 20:21:46.159238 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.159214 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" event={"ID":"d732d771-ba90-43a3-a24b-d5381dbcc33f","Type":"ContainerStarted","Data":"29a6c790605dadf67804b61a0d20236bb26f27f41321162a4a63f3fdfd96aeed"} Jul 10 20:21:46.160680 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.160659 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" event={"ID":"5493c772-af7e-440f-a536-c8321ff052e6","Type":"ContainerStarted","Data":"659279c109d8ce2607df771b5b61b1c23180a0b5cbc5e82b40aae627e0df1ce8"} Jul 10 20:21:46.162534 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.162514 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:21:46.162871 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.162842 2566 generic.go:356] "Generic (PLEG): container finished" podID="f0e45ba7-808c-4c30-a59f-254878e2da4c" containerID="0b6facbed0639a1d36455c0506b03a8fab4cac3e443aa1033c6f19cd9472097c" exitCode=1 Jul 10 20:21:46.162967 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.162914 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" event={"ID":"f0e45ba7-808c-4c30-a59f-254878e2da4c","Type":"ContainerStarted","Data":"bce175c2c1fe80e6d2329c9499acde8bd2f28c9695c8fd807602cfc7c5763b9f"} Jul 10 20:21:46.163030 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.162969 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" event={"ID":"f0e45ba7-808c-4c30-a59f-254878e2da4c","Type":"ContainerStarted","Data":"37b2c749e8fe51aec28cccad3de40eee8843123e6dd0f9f83e5cc830c0832b86"} Jul 10 20:21:46.163030 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.163025 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" event={"ID":"f0e45ba7-808c-4c30-a59f-254878e2da4c","Type":"ContainerDied","Data":"0b6facbed0639a1d36455c0506b03a8fab4cac3e443aa1033c6f19cd9472097c"} Jul 10 20:21:46.163157 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.163091 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" event={"ID":"f0e45ba7-808c-4c30-a59f-254878e2da4c","Type":"ContainerStarted","Data":"c56dccce855b2a762c0c920b296604994c5279c1d264ba519544d90648020d41"} Jul 10 20:21:46.166698 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.166671 2566 generic.go:356] "Generic (PLEG): container finished" podID="dfbcf8ac-64c3-43f1-9830-29ee5390621f" containerID="2dfad53b0b6d07575effc8ae78f601b6e4d501b3a9c7e27bec01429470edc12c" exitCode=0 Jul 10 20:21:46.166810 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.166752 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b45xk" event={"ID":"dfbcf8ac-64c3-43f1-9830-29ee5390621f","Type":"ContainerDied","Data":"2dfad53b0b6d07575effc8ae78f601b6e4d501b3a9c7e27bec01429470edc12c"} Jul 10 20:21:46.170842 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.170819 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-blzc9" event={"ID":"9a30c286-7732-4e5d-9fdf-baf93eb89e66","Type":"ContainerStarted","Data":"2319b82087cadea13c0b56c8432aa6bdabf43e0e483d258f620283f187150db9"} Jul 10 20:21:46.172393 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.172360 2566 generic.go:356] "Generic (PLEG): container finished" podID="e12d611af29cd9500aadab9d5e999d27" containerID="6076157d79026851d63db13d2c04a9211019dc86b246617031cfa2f30d1c5015" exitCode=0 Jul 10 20:21:46.172490 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.172426 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" event={"ID":"e12d611af29cd9500aadab9d5e999d27","Type":"ContainerDied","Data":"6076157d79026851d63db13d2c04a9211019dc86b246617031cfa2f30d1c5015"} Jul 10 20:21:46.173842 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.173822 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bb2fz" event={"ID":"e88eed6b-d362-4848-a548-699f174407ee","Type":"ContainerStarted","Data":"78e1d76a7dfc5f9d22da757d507f677ccd7c683bd8a5043bcbd7c9fabc1ecb6b"} Jul 10 20:21:46.175355 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.175335 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cwrfk" event={"ID":"55696fe0-0df3-401d-b9d6-8893f1b05e6f","Type":"ContainerStarted","Data":"8773e47e9133e965e3325df14863653d1735e4143439765f3c91483e04eb391c"} Jul 10 20:21:46.176538 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.176516 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gk76z" event={"ID":"1bb76bc0-7262-46cf-b492-7ccd2e542fe2","Type":"ContainerStarted","Data":"dbddd2a9dc5b8613f5819bd914db64d5fe5f289b11cd2c65b266bdc2b782e231"} Jul 10 20:21:46.184847 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.184795 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-138.ec2.internal" podStartSLOduration=22.184782434 podStartE2EDuration="22.184782434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:46.170159598 +0000 UTC m=+23.788592601" watchObservedRunningTime="2026-07-10 20:21:46.184782434 +0000 UTC m=+23.803215461" Jul 10 20:21:46.184940 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.184922 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dhjg9" podStartSLOduration=1.849941414 podStartE2EDuration="23.184918003s" totalImagesPullingTime="21.334976589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:46.184705509 +0000 UTC m=+23.803138511" watchObservedRunningTime="2026-07-10 20:21:46.184918003 +0000 UTC m=+23.803351006" Jul 10 20:21:46.216238 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.216182 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gk76z" podStartSLOduration=1.7904774909999999 podStartE2EDuration="23.216162053s" totalImagesPullingTime="21.425684562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:46.21515393 +0000 UTC m=+23.833586933" watchObservedRunningTime="2026-07-10 20:21:46.216162053 +0000 UTC m=+23.834595057" Jul 10 20:21:46.247241 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.247194 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-blzc9" podStartSLOduration=1.7618236 podStartE2EDuration="23.247177325s" totalImagesPullingTime="21.485353725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:46.246989752 +0000 UTC m=+23.865422757" watchObservedRunningTime="2026-07-10 20:21:46.247177325 +0000 UTC m=+23.865610328" Jul 10 20:21:46.260438 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.260398 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cwrfk" podStartSLOduration=1.8882114639999998 podStartE2EDuration="23.260381632s" totalImagesPullingTime="21.372170168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:46.259893848 +0000 UTC m=+23.878326850" watchObservedRunningTime="2026-07-10 20:21:46.260381632 +0000 UTC m=+23.878814634" Jul 10 20:21:46.274893 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.274851 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bb2fz" podStartSLOduration=1.917939397 podStartE2EDuration="23.274835766s" totalImagesPullingTime="21.356896369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:46.274426434 +0000 UTC m=+23.892859434" watchObservedRunningTime="2026-07-10 20:21:46.274835766 +0000 UTC m=+23.893268769" Jul 10 20:21:46.961521 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:46.961295 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:46.961521 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:46.961416 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:47.182223 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.182193 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:21:47.182840 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.182801 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" event={"ID":"f0e45ba7-808c-4c30-a59f-254878e2da4c","Type":"ContainerStarted","Data":"b94e833f1e8970a7915eb613f901015037aceb0dc623c66184627a5bf62f754a"} Jul 10 20:21:47.182945 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.182933 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" event={"ID":"f0e45ba7-808c-4c30-a59f-254878e2da4c","Type":"ContainerStarted","Data":"cc945bd63225c79f39a2f671a405fa36c4ce6cb6aaaad7436ad6120b9b52b44a"} Jul 10 20:21:47.184974 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.184949 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" event={"ID":"e12d611af29cd9500aadab9d5e999d27","Type":"ContainerStarted","Data":"4193603081c6b71ab8740734f75c0fcf9d491498a0f1ef72f0be2baba5d4a1fe"} Jul 10 20:21:47.187351 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.186627 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dt78x" event={"ID":"7e2db227-46b7-43ab-83af-a975b0eb1f0e","Type":"ContainerStarted","Data":"228aade24ec99b2217ecd4e4f7c4d244617b8f5c6b0fd3b69925204cf326c950"} Jul 10 20:21:47.199955 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.199902 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-138.ec2.internal" podStartSLOduration=23.199885749 podStartE2EDuration="23.199885749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:47.199536949 +0000 UTC m=+24.817969953" watchObservedRunningTime="2026-07-10 20:21:47.199885749 +0000 UTC m=+24.818318751" Jul 10 20:21:47.301349 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.301299 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 20:21:47.502037 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.501956 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cwrfk" Jul 10 20:21:47.502723 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.502696 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cwrfk" Jul 10 20:21:47.516626 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.516571 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dt78x" podStartSLOduration=3.081571111 podStartE2EDuration="24.516555387s" totalImagesPullingTime="21.434984276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:47.213220637 +0000 UTC m=+24.831653641" watchObservedRunningTime="2026-07-10 20:21:47.516555387 +0000 UTC m=+25.134988435" Jul 10 20:21:47.850920 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.850745 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T20:21:47.301317605Z","UUID":"b0543853-6714-4bd5-9a81-1ed9cbd92aa2","Handler":null,"Name":"","Endpoint":""} Jul 10 20:21:47.852551 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.852527 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 20:21:47.852689 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.852574 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 20:21:47.962362 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.962325 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:47.962529 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:47.962377 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:47.962529 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:47.962485 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:47.962653 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:47.962617 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:48.191151 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:48.191071 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" event={"ID":"5493c772-af7e-440f-a536-c8321ff052e6","Type":"ContainerStarted","Data":"1943d5047c84dda4f9ec09bd5eedbce29719dba2f52af21cb460d10f17008a85"} Jul 10 20:21:48.191674 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:48.191648 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cwrfk" Jul 10 20:21:48.191998 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:48.191978 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cwrfk" Jul 10 20:21:48.962069 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:48.961858 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:48.962343 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:48.962173 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:49.196319 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:49.196280 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" event={"ID":"5493c772-af7e-440f-a536-c8321ff052e6","Type":"ContainerStarted","Data":"f26daf0ce1a15b45de7ca93a8aec402e379b78a8cdb184e5391145e9bdb0ba81"} Jul 10 20:21:49.199625 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:49.199597 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:21:49.200076 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:49.200037 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" event={"ID":"f0e45ba7-808c-4c30-a59f-254878e2da4c","Type":"ContainerStarted","Data":"70fdf170f76f2055da7c9c71ea0b9faa1be045134100902d4c91ba976d955953"} Jul 10 20:21:49.214153 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:49.214045 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tw7ns" podStartSLOduration=2.636424742 podStartE2EDuration="26.214029391s" totalImagesPullingTime="23.577604649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:49.213402725 +0000 UTC m=+26.831835729" watchObservedRunningTime="2026-07-10 20:21:49.214029391 +0000 UTC m=+26.832462393" Jul 10 20:21:49.961506 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:49.961464 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:49.961726 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:49.961574 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:49.961726 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:49.961638 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:49.961845 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:49.961760 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:50.961582 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:50.961286 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:50.962538 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:50.961589 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:51.206893 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:51.206865 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:21:51.207280 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:51.207256 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" event={"ID":"f0e45ba7-808c-4c30-a59f-254878e2da4c","Type":"ContainerStarted","Data":"2fed58f8c6cd4981177ef77c08470465f1f79388ae7585077916ca28375eaab9"} Jul 10 20:21:51.207619 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:51.207582 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:51.207937 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:51.207769 2566 scope.go:117] "RemoveContainer" containerID="0b6facbed0639a1d36455c0506b03a8fab4cac3e443aa1033c6f19cd9472097c" Jul 10 20:21:51.209223 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:51.209197 2566 generic.go:356] "Generic (PLEG): container finished" podID="dfbcf8ac-64c3-43f1-9830-29ee5390621f" containerID="066eb2ef52548490be196d85c907e48e01e387fcdbdc98ea04bd57f8dec5489f" exitCode=0 Jul 10 20:21:51.209324 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:51.209251 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b45xk" event={"ID":"dfbcf8ac-64c3-43f1-9830-29ee5390621f","Type":"ContainerDied","Data":"066eb2ef52548490be196d85c907e48e01e387fcdbdc98ea04bd57f8dec5489f"} Jul 10 20:21:51.226691 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:51.226667 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:51.962037 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:51.961999 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:51.962539 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:51.962150 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:51.962539 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:51.962235 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:51.962539 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:51.962315 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:52.216360 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:52.216276 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:21:52.216706 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:52.216680 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" event={"ID":"f0e45ba7-808c-4c30-a59f-254878e2da4c","Type":"ContainerStarted","Data":"90bb95007750ad01661df8ff002e3b861aa912a78cafb1d7c50817756e95d815"} Jul 10 20:21:52.216913 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:52.216885 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:52.217028 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:52.216952 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:52.233819 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:52.233793 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:21:52.245173 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:52.245123 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" podStartSLOduration=7.83342608 podStartE2EDuration="29.245106788s" totalImagesPullingTime="21.411680708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:52.243668529 +0000 UTC m=+29.862101532" watchObservedRunningTime="2026-07-10 20:21:52.245106788 +0000 UTC m=+29.863539788" Jul 10 20:21:52.903328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:52.903222 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2m52m"] Jul 10 20:21:52.903581 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:52.903395 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:52.903581 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:52.903517 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:52.906333 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:52.906307 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkpwk"] Jul 10 20:21:52.906476 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:52.906438 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:52.906567 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:52.906546 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:52.906807 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:52.906788 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bxdr7"] Jul 10 20:21:52.906887 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:52.906875 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:52.906991 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:52.906972 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:53.220909 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:53.220654 2566 generic.go:356] "Generic (PLEG): container finished" podID="dfbcf8ac-64c3-43f1-9830-29ee5390621f" containerID="3a154bb3876bacf45006a843711f7a4569b007da81c8075b76186db61c619853" exitCode=0 Jul 10 20:21:53.220909 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:53.220741 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b45xk" event={"ID":"dfbcf8ac-64c3-43f1-9830-29ee5390621f","Type":"ContainerDied","Data":"3a154bb3876bacf45006a843711f7a4569b007da81c8075b76186db61c619853"} Jul 10 20:21:54.799716 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:54.799680 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:21:54.938082 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:54.938023 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:21:54.962228 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:54.962153 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:54.962228 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:54.962205 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:54.962387 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:54.962289 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:54.962387 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:54.962308 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:54.962387 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:54.962366 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:54.962495 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:54.962409 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:55.039470 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:55.039432 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:21:55.194969 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:55.194933 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:21:55.228000 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:55.227918 2566 generic.go:356] "Generic (PLEG): container finished" podID="dfbcf8ac-64c3-43f1-9830-29ee5390621f" containerID="347e39dc46871a06f366621ebca6468b7a6ea44f2b19793a7635948fbb25d682" exitCode=0 Jul 10 20:21:55.228000 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:55.227970 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b45xk" event={"ID":"dfbcf8ac-64c3-43f1-9830-29ee5390621f","Type":"ContainerDied","Data":"347e39dc46871a06f366621ebca6468b7a6ea44f2b19793a7635948fbb25d682"} Jul 10 20:21:55.253581 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:55.253549 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:21:55.638312 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:55.638231 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:55.638312 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:55.638273 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:55.638507 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:55.638387 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:55.638507 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:55.638446 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs podName:9300a4a2-82bc-450e-8fe5-c5382a177fa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:22:27.638432031 +0000 UTC m=+65.256865012 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs") pod "network-metrics-daemon-2m52m" (UID: "9300a4a2-82bc-450e-8fe5-c5382a177fa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:55.638507 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:55.638387 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:55.638507 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:55.638501 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret podName:5f44a784-5924-4a01-afa5-1ac2e91aba36 nodeName:}" failed. No retries permitted until 2026-07-10 20:22:27.638489966 +0000 UTC m=+65.256922950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret") pod "global-pull-secret-syncer-lkpwk" (UID: "5f44a784-5924-4a01-afa5-1ac2e91aba36") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:55.739543 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:55.739508 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6cx\" (UniqueName: \"kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx\") pod \"network-check-target-bxdr7\" (UID: \"d068e535-c013-4fa2-8158-1b6765b77e9b\") " pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:55.739720 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:55.739696 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:55.739720 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:55.739717 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:55.739803 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:55.739730 2566 projected.go:196] Error preparing data for projected volume kube-api-access-fc6cx for pod openshift-network-diagnostics/network-check-target-bxdr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:55.739803 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:55.739783 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx podName:d068e535-c013-4fa2-8158-1b6765b77e9b nodeName:}" failed. No retries permitted until 2026-07-10 20:22:27.739769369 +0000 UTC m=+65.358202350 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6cx" (UniqueName: "kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx") pod "network-check-target-bxdr7" (UID: "d068e535-c013-4fa2-8158-1b6765b77e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:56.961605 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:56.961564 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:56.961605 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:56.961592 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:56.962356 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:56.961701 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:56.962356 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:56.961715 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:56.962356 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:56.961795 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:56.962356 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:56.961872 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:57.151733 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:57.151698 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:21:57.201033 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:57.200980 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:21:58.689135 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:58.689089 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:21:58.735628 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:58.735590 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:21:58.962444 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:58.962352 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:21:58.962613 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:58.962466 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxdr7" podUID="d068e535-c013-4fa2-8158-1b6765b77e9b" Jul 10 20:21:58.962613 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:58.962490 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:21:58.962613 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:58.962361 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:21:58.962754 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:58.962590 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkpwk" podUID="5f44a784-5924-4a01-afa5-1ac2e91aba36" Jul 10 20:21:58.962754 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:58.962713 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:21:58.998047 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:58.998010 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:21:59.046972 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.046918 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:21:59.205140 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.205114 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-138.ec2.internal" event="NodeReady" Jul 10 20:21:59.205314 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.205256 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 20:21:59.281427 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.281346 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j9npz"] Jul 10 20:21:59.283436 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.283414 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6t2bs"] Jul 10 20:21:59.283578 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.283556 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.285311 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.285294 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6t2bs" Jul 10 20:21:59.286334 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.286317 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgw85\"" Jul 10 20:21:59.286435 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.286412 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 20:21:59.286568 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.286544 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 20:21:59.287842 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.287811 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 20:21:59.288288 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.288264 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 20:21:59.288372 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.288328 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 20:21:59.288598 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.288581 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xpb5f\"" Jul 10 20:21:59.292824 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.292801 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6t2bs"] Jul 10 20:21:59.295912 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.295888 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j9npz"] Jul 10 20:21:59.364944 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.364907 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g5hh\" (UniqueName: \"kubernetes.io/projected/19c473d4-be6e-444b-8de4-19962da37958-kube-api-access-5g5hh\") pod \"ingress-canary-6t2bs\" (UID: \"19c473d4-be6e-444b-8de4-19962da37958\") " pod="openshift-ingress-canary/ingress-canary-6t2bs" Jul 10 20:21:59.365149 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.364958 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c473d4-be6e-444b-8de4-19962da37958-cert\") pod \"ingress-canary-6t2bs\" (UID: \"19c473d4-be6e-444b-8de4-19962da37958\") " pod="openshift-ingress-canary/ingress-canary-6t2bs" Jul 10 20:21:59.365149 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.365067 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mksnh\" (UniqueName: \"kubernetes.io/projected/c0418812-8ccc-41ad-9183-9c39907f63ae-kube-api-access-mksnh\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.365149 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.365125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0418812-8ccc-41ad-9183-9c39907f63ae-config-volume\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.365311 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.365150 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0418812-8ccc-41ad-9183-9c39907f63ae-tmp-dir\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.365311 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.365194 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.466484 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.466448 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c473d4-be6e-444b-8de4-19962da37958-cert\") pod \"ingress-canary-6t2bs\" (UID: \"19c473d4-be6e-444b-8de4-19962da37958\") " pod="openshift-ingress-canary/ingress-canary-6t2bs" Jul 10 20:21:59.466580 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.466522 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mksnh\" (UniqueName: \"kubernetes.io/projected/c0418812-8ccc-41ad-9183-9c39907f63ae-kube-api-access-mksnh\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.466580 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.466575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0418812-8ccc-41ad-9183-9c39907f63ae-config-volume\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.466694 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.466599 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0418812-8ccc-41ad-9183-9c39907f63ae-tmp-dir\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.466694 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.466651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.466791 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:59.466753 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:21:59.466842 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:59.466813 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls podName:c0418812-8ccc-41ad-9183-9c39907f63ae nodeName:}" failed. No retries permitted until 2026-07-10 20:21:59.966792357 +0000 UTC m=+37.585225344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls") pod "dns-default-j9npz" (UID: "c0418812-8ccc-41ad-9183-9c39907f63ae") : secret "dns-default-metrics-tls" not found Jul 10 20:21:59.466978 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.466956 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0418812-8ccc-41ad-9183-9c39907f63ae-tmp-dir\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.467067 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.466944 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g5hh\" (UniqueName: \"kubernetes.io/projected/19c473d4-be6e-444b-8de4-19962da37958-kube-api-access-5g5hh\") pod \"ingress-canary-6t2bs\" (UID: \"19c473d4-be6e-444b-8de4-19962da37958\") " pod="openshift-ingress-canary/ingress-canary-6t2bs" Jul 10 20:21:59.467530 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.467509 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0418812-8ccc-41ad-9183-9c39907f63ae-config-volume\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.471819 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.471681 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c473d4-be6e-444b-8de4-19962da37958-cert\") pod \"ingress-canary-6t2bs\" (UID: \"19c473d4-be6e-444b-8de4-19962da37958\") " pod="openshift-ingress-canary/ingress-canary-6t2bs" Jul 10 20:21:59.476522 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.476488 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mksnh\" (UniqueName: \"kubernetes.io/projected/c0418812-8ccc-41ad-9183-9c39907f63ae-kube-api-access-mksnh\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.476778 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.476753 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g5hh\" (UniqueName: \"kubernetes.io/projected/19c473d4-be6e-444b-8de4-19962da37958-kube-api-access-5g5hh\") pod \"ingress-canary-6t2bs\" (UID: \"19c473d4-be6e-444b-8de4-19962da37958\") " pod="openshift-ingress-canary/ingress-canary-6t2bs" Jul 10 20:21:59.604576 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.604531 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6t2bs" Jul 10 20:21:59.744445 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.744409 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6t2bs"] Jul 10 20:21:59.749436 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:21:59.749394 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c473d4_be6e_444b_8de4_19962da37958.slice/crio-a13947c1533d36463572af600065b8a5e0428a9e102262feef2495ab1d16b10c WatchSource:0}: Error finding container a13947c1533d36463572af600065b8a5e0428a9e102262feef2495ab1d16b10c: Status 404 returned error can't find the container with id a13947c1533d36463572af600065b8a5e0428a9e102262feef2495ab1d16b10c Jul 10 20:21:59.972534 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:21:59.972441 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:21:59.972735 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:59.972558 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:21:59.972735 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:21:59.972610 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls podName:c0418812-8ccc-41ad-9183-9c39907f63ae nodeName:}" failed. No retries permitted until 2026-07-10 20:22:00.972596455 +0000 UTC m=+38.591029439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls") pod "dns-default-j9npz" (UID: "c0418812-8ccc-41ad-9183-9c39907f63ae") : secret "dns-default-metrics-tls" not found Jul 10 20:22:00.241918 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.241837 2566 generic.go:356] "Generic (PLEG): container finished" podID="dfbcf8ac-64c3-43f1-9830-29ee5390621f" containerID="7b4e705a18431423bc770cfb401286c7111f9d2deecc5dd934582f6269f1b819" exitCode=0 Jul 10 20:22:00.242117 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.241919 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b45xk" event={"ID":"dfbcf8ac-64c3-43f1-9830-29ee5390621f","Type":"ContainerDied","Data":"7b4e705a18431423bc770cfb401286c7111f9d2deecc5dd934582f6269f1b819"} Jul 10 20:22:00.243485 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.243464 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6t2bs" event={"ID":"19c473d4-be6e-444b-8de4-19962da37958","Type":"ContainerStarted","Data":"a13947c1533d36463572af600065b8a5e0428a9e102262feef2495ab1d16b10c"} Jul 10 20:22:00.962615 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.962408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:22:00.963101 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.962408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:22:00.963101 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.962454 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:22:00.965575 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.965552 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 20:22:00.965707 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.965611 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 20:22:00.965798 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.965778 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 20:22:00.966629 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.966610 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 20:22:00.966745 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.966718 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mr56z\"" Jul 10 20:22:00.966841 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.966824 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pk8lx\"" Jul 10 20:22:00.981578 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:00.981548 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:22:00.981695 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:22:00.981677 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:22:00.981755 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:22:00.981744 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls podName:c0418812-8ccc-41ad-9183-9c39907f63ae nodeName:}" failed. No retries permitted until 2026-07-10 20:22:02.98172398 +0000 UTC m=+40.600156974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls") pod "dns-default-j9npz" (UID: "c0418812-8ccc-41ad-9183-9c39907f63ae") : secret "dns-default-metrics-tls" not found Jul 10 20:22:01.249534 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:01.249453 2566 generic.go:356] "Generic (PLEG): container finished" podID="dfbcf8ac-64c3-43f1-9830-29ee5390621f" containerID="10764e6ab2f9f8de2c991cb49b45e77ca0b10f4294f81aa2d82003477c3471ff" exitCode=0 Jul 10 20:22:01.249534 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:01.249512 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b45xk" event={"ID":"dfbcf8ac-64c3-43f1-9830-29ee5390621f","Type":"ContainerDied","Data":"10764e6ab2f9f8de2c991cb49b45e77ca0b10f4294f81aa2d82003477c3471ff"} Jul 10 20:22:02.255454 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:02.255423 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b45xk" event={"ID":"dfbcf8ac-64c3-43f1-9830-29ee5390621f","Type":"ContainerStarted","Data":"5c01c3ba740ffbb57528e305c2d49dc8862af59fb581d0d9671cff42985ec166"} Jul 10 20:22:02.278271 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:02.278225 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b45xk" podStartSLOduration=7.425562148 podStartE2EDuration="39.278208271s" totalImagesPullingTime="31.852646123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:22:02.276376518 +0000 UTC m=+39.894809521" watchObservedRunningTime="2026-07-10 20:22:02.278208271 +0000 UTC m=+39.896641292" Jul 10 20:22:02.400346 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:02.400318 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:22:02.459380 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:02.459300 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:22:02.995081 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:02.995016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:22:02.995252 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:22:02.995186 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:22:02.995293 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:22:02.995256 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls podName:c0418812-8ccc-41ad-9183-9c39907f63ae nodeName:}" failed. No retries permitted until 2026-07-10 20:22:06.99524008 +0000 UTC m=+44.613673061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls") pod "dns-default-j9npz" (UID: "c0418812-8ccc-41ad-9183-9c39907f63ae") : secret "dns-default-metrics-tls" not found Jul 10 20:22:03.259862 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:03.259750 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6t2bs" event={"ID":"19c473d4-be6e-444b-8de4-19962da37958","Type":"ContainerStarted","Data":"eb30aeadc9b313365d508e57babe7d739e30d5450309ef92d779789fb1136b2d"} Jul 10 20:22:03.275966 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:03.275913 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6t2bs" podStartSLOduration=1.843790182 podStartE2EDuration="4.275896459s" totalImagesPullingTime="2.432106277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:22:03.274879954 +0000 UTC m=+40.893312956" watchObservedRunningTime="2026-07-10 20:22:03.275896459 +0000 UTC m=+40.894329461" Jul 10 20:22:04.363573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:04.363543 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:22:04.414353 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:04.414321 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:22:07.022880 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:07.022839 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:22:07.023276 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:22:07.022958 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:22:07.023276 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:22:07.023012 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls podName:c0418812-8ccc-41ad-9183-9c39907f63ae nodeName:}" failed. No retries permitted until 2026-07-10 20:22:15.022997285 +0000 UTC m=+52.641430266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls") pod "dns-default-j9npz" (UID: "c0418812-8ccc-41ad-9183-9c39907f63ae") : secret "dns-default-metrics-tls" not found Jul 10 20:22:15.081189 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:15.081146 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:22:15.081866 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:22:15.081290 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:22:15.081866 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:22:15.081376 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls podName:c0418812-8ccc-41ad-9183-9c39907f63ae nodeName:}" failed. No retries permitted until 2026-07-10 20:22:31.081354706 +0000 UTC m=+68.699787689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls") pod "dns-default-j9npz" (UID: "c0418812-8ccc-41ad-9183-9c39907f63ae") : secret "dns-default-metrics-tls" not found Jul 10 20:22:17.067359 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:17.067322 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:22:17.126496 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:17.126464 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:22:19.973772 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:19.973734 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:22:20.048724 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:20.048693 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:22:24.243573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:24.243543 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4g59x" Jul 10 20:22:24.360804 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:24.360764 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:22:24.431260 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:24.431232 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:22:24.488587 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:24.488553 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:22:27.672160 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.672115 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:22:27.672160 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.672168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:22:27.675068 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.675026 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 20:22:27.675200 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.675172 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 20:22:27.682716 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:22:27.682693 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 20:22:27.682818 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:22:27.682760 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs podName:9300a4a2-82bc-450e-8fe5-c5382a177fa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:23:31.682743132 +0000 UTC m=+129.301176127 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs") pod "network-metrics-daemon-2m52m" (UID: "9300a4a2-82bc-450e-8fe5-c5382a177fa4") : secret "metrics-daemon-secret" not found Jul 10 20:22:27.686507 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.686473 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f44a784-5924-4a01-afa5-1ac2e91aba36-original-pull-secret\") pod \"global-pull-secret-syncer-lkpwk\" (UID: \"5f44a784-5924-4a01-afa5-1ac2e91aba36\") " pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:22:27.688399 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.688380 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkpwk" Jul 10 20:22:27.773475 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.773444 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6cx\" (UniqueName: \"kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx\") pod \"network-check-target-bxdr7\" (UID: \"d068e535-c013-4fa2-8158-1b6765b77e9b\") " pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:22:27.776414 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.776395 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 20:22:27.786851 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.786826 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 20:22:27.797411 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.797384 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc6cx\" (UniqueName: \"kubernetes.io/projected/d068e535-c013-4fa2-8158-1b6765b77e9b-kube-api-access-fc6cx\") pod \"network-check-target-bxdr7\" (UID: \"d068e535-c013-4fa2-8158-1b6765b77e9b\") " pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:22:27.815768 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.815735 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkpwk"] Jul 10 20:22:27.819027 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:22:27.818997 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f44a784_5924_4a01_afa5_1ac2e91aba36.slice/crio-284f0301af1ef4cab206272f6f0164f248660fab5549b351a7d607b3904092a2 WatchSource:0}: Error finding container 284f0301af1ef4cab206272f6f0164f248660fab5549b351a7d607b3904092a2: Status 404 returned error can't find the container with id 284f0301af1ef4cab206272f6f0164f248660fab5549b351a7d607b3904092a2 Jul 10 20:22:27.984726 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.984700 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pk8lx\"" Jul 10 20:22:27.992850 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:27.992798 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:22:28.130194 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:28.130165 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bxdr7"] Jul 10 20:22:28.133466 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:22:28.133436 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd068e535_c013_4fa2_8158_1b6765b77e9b.slice/crio-f5b124556919d604a62f5e78b48f5d57cd39be5820860dcef3b90151afc9f8a6 WatchSource:0}: Error finding container f5b124556919d604a62f5e78b48f5d57cd39be5820860dcef3b90151afc9f8a6: Status 404 returned error can't find the container with id f5b124556919d604a62f5e78b48f5d57cd39be5820860dcef3b90151afc9f8a6 Jul 10 20:22:28.317914 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:28.317833 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bxdr7" event={"ID":"d068e535-c013-4fa2-8158-1b6765b77e9b","Type":"ContainerStarted","Data":"f5b124556919d604a62f5e78b48f5d57cd39be5820860dcef3b90151afc9f8a6"} Jul 10 20:22:28.319142 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:28.319110 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkpwk" event={"ID":"5f44a784-5924-4a01-afa5-1ac2e91aba36","Type":"ContainerStarted","Data":"284f0301af1ef4cab206272f6f0164f248660fab5549b351a7d607b3904092a2"} Jul 10 20:22:31.098704 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:31.098650 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:22:31.099180 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:22:31.098821 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:22:31.099180 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:22:31.098921 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls podName:c0418812-8ccc-41ad-9183-9c39907f63ae nodeName:}" failed. No retries permitted until 2026-07-10 20:23:03.098900525 +0000 UTC m=+100.717333513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls") pod "dns-default-j9npz" (UID: "c0418812-8ccc-41ad-9183-9c39907f63ae") : secret "dns-default-metrics-tls" not found Jul 10 20:22:31.171003 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:31.170964 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:22:33.332982 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:33.332890 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkpwk" event={"ID":"5f44a784-5924-4a01-afa5-1ac2e91aba36","Type":"ContainerStarted","Data":"02bd23541f0f9e4a0f21800ca4140033e763fb30e8d6e88613fb2b6e307f3065"} Jul 10 20:22:33.334365 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:33.334339 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bxdr7" event={"ID":"d068e535-c013-4fa2-8158-1b6765b77e9b","Type":"ContainerStarted","Data":"80bfb408fde4da686356a80e50ff9c8ca9b1c645a4eea88a6502e7e36b9c44e4"} Jul 10 20:22:33.334492 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:33.334474 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:22:33.348356 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:33.348305 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lkpwk" podStartSLOduration=65.337740786 podStartE2EDuration="1m10.348287826s" totalImagesPullingTime="5.01054704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:22:33.347129992 +0000 UTC m=+70.965562994" watchObservedRunningTime="2026-07-10 20:22:33.348287826 +0000 UTC m=+70.966720828" Jul 10 20:22:33.361641 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:22:33.361586 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bxdr7" podStartSLOduration=65.676798339 podStartE2EDuration="1m10.361570699s" totalImagesPullingTime="4.68477236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:22:33.361312197 +0000 UTC m=+70.979745201" watchObservedRunningTime="2026-07-10 20:22:33.361570699 +0000 UTC m=+70.980003680" Jul 10 20:23:03.127894 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:23:03.127857 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:23:03.128345 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:23:03.127994 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:23:03.128345 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:23:03.128087 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls podName:c0418812-8ccc-41ad-9183-9c39907f63ae nodeName:}" failed. No retries permitted until 2026-07-10 20:24:07.128072542 +0000 UTC m=+164.746505536 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls") pod "dns-default-j9npz" (UID: "c0418812-8ccc-41ad-9183-9c39907f63ae") : secret "dns-default-metrics-tls" not found Jul 10 20:23:04.340075 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:23:04.340036 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bxdr7" Jul 10 20:23:07.897699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:23:07.897661 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:23:31.725512 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:23:31.725465 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:23:31.725907 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:23:31.725622 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 20:23:31.725907 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:23:31.725701 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs podName:9300a4a2-82bc-450e-8fe5-c5382a177fa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:33.725684712 +0000 UTC m=+251.344117692 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs") pod "network-metrics-daemon-2m52m" (UID: "9300a4a2-82bc-450e-8fe5-c5382a177fa4") : secret "metrics-daemon-secret" not found Jul 10 20:24:02.297283 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:24:02.297233 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-j9npz" podUID="c0418812-8ccc-41ad-9183-9c39907f63ae" Jul 10 20:24:02.550260 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:24:02.550187 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j9npz" Jul 10 20:24:03.975926 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:24:03.975873 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2m52m" podUID="9300a4a2-82bc-450e-8fe5-c5382a177fa4" Jul 10 20:24:07.174367 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:24:07.174320 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:24:07.174744 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:24:07.174446 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:24:07.174744 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:24:07.174501 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls podName:c0418812-8ccc-41ad-9183-9c39907f63ae nodeName:}" failed. No retries permitted until 2026-07-10 20:26:09.174484778 +0000 UTC m=+286.792917759 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls") pod "dns-default-j9npz" (UID: "c0418812-8ccc-41ad-9183-9c39907f63ae") : secret "dns-default-metrics-tls" not found Jul 10 20:24:15.962150 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:24:15.962041 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:24:32.554350 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:24:32.554316 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:03.566695 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.566654 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-9r9sr"] Jul 10 20:25:03.568559 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.568541 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.571267 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.571239 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 20:25:03.571381 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.571277 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 10 20:25:03.571381 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.571250 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t2skp\"" Jul 10 20:25:03.571381 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.571239 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 10 20:25:03.572642 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.572609 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 20:25:03.575558 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.575331 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-6zqnz"] Jul 10 20:25:03.577281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.577263 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6cf6c66c44-5lkdq"] Jul 10 20:25:03.577400 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.577382 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.578379 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.578360 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 10 20:25:03.579207 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.579192 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.582476 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.582450 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 10 20:25:03.582662 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.582450 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5b2pw\"" Jul 10 20:25:03.583122 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.582820 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:25:03.583224 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.583121 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 10 20:25:03.585542 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.584895 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-9r9sr"] Jul 10 20:25:03.585542 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.585425 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 10 20:25:03.586314 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.586297 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 10 20:25:03.586650 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.586627 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-knstm\"" Jul 10 20:25:03.588110 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.587158 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 10 20:25:03.588110 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.587274 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 20:25:03.588110 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.587498 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 10 20:25:03.588110 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.587576 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 10 20:25:03.588110 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.588095 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 20:25:03.592232 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.592208 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 10 20:25:03.601833 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.601808 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-6zqnz"] Jul 10 20:25:03.604192 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.604171 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6cf6c66c44-5lkdq"] Jul 10 20:25:03.662987 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.662952 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-l52v2"] Jul 10 20:25:03.665084 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.665067 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:03.667867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.667840 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 10 20:25:03.668160 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.668136 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 10 20:25:03.668662 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.668639 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wc2tx\"" Jul 10 20:25:03.678300 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.678273 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-l52v2"] Jul 10 20:25:03.750566 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.750520 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddvqp\" (UniqueName: \"kubernetes.io/projected/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-kube-api-access-ddvqp\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.750758 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.750572 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ec3ded59-60c6-4116-9c40-a4adaa038b90-snapshots\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.750758 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.750630 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-stats-auth\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.750758 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.750665 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-default-certificate\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.750758 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.750721 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.750758 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.750752 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ad657aa-76f6-400b-b80a-239f6b0aa519-trusted-ca\") pod \"console-operator-7866497494-6zqnz\" (UID: \"4ad657aa-76f6-400b-b80a-239f6b0aa519\") " pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.750966 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.750792 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec3ded59-60c6-4116-9c40-a4adaa038b90-tmp\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.750966 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.750812 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ad657aa-76f6-400b-b80a-239f6b0aa519-config\") pod \"console-operator-7866497494-6zqnz\" (UID: \"4ad657aa-76f6-400b-b80a-239f6b0aa519\") " pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.750966 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.750938 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3ded59-60c6-4116-9c40-a4adaa038b90-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.751141 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.750969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb75w\" (UniqueName: \"kubernetes.io/projected/ec3ded59-60c6-4116-9c40-a4adaa038b90-kube-api-access-vb75w\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.751141 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.751021 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.751141 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.751050 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ad657aa-76f6-400b-b80a-239f6b0aa519-serving-cert\") pod \"console-operator-7866497494-6zqnz\" (UID: \"4ad657aa-76f6-400b-b80a-239f6b0aa519\") " pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.751141 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.751095 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpdhw\" (UniqueName: \"kubernetes.io/projected/4ad657aa-76f6-400b-b80a-239f6b0aa519-kube-api-access-lpdhw\") pod \"console-operator-7866497494-6zqnz\" (UID: \"4ad657aa-76f6-400b-b80a-239f6b0aa519\") " pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.751141 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.751124 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3ded59-60c6-4116-9c40-a4adaa038b90-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.751320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.751154 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec3ded59-60c6-4116-9c40-a4adaa038b90-serving-cert\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.762226 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.762190 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-dtzqb"] Jul 10 20:25:03.764594 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.764573 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dtzqb" Jul 10 20:25:03.767230 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.767213 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cjgrq\"" Jul 10 20:25:03.775772 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.775751 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-dtzqb"] Jul 10 20:25:03.814253 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.814215 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:03.852371 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852285 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ad657aa-76f6-400b-b80a-239f6b0aa519-serving-cert\") pod \"console-operator-7866497494-6zqnz\" (UID: \"4ad657aa-76f6-400b-b80a-239f6b0aa519\") " pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.852371 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852332 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpdhw\" (UniqueName: \"kubernetes.io/projected/4ad657aa-76f6-400b-b80a-239f6b0aa519-kube-api-access-lpdhw\") pod \"console-operator-7866497494-6zqnz\" (UID: \"4ad657aa-76f6-400b-b80a-239f6b0aa519\") " pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.852371 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852360 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3ded59-60c6-4116-9c40-a4adaa038b90-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.852612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852385 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec3ded59-60c6-4116-9c40-a4adaa038b90-serving-cert\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.852612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852410 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddvqp\" (UniqueName: \"kubernetes.io/projected/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-kube-api-access-ddvqp\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.852612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852436 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-l52v2\" (UID: \"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:03.852612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852463 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ec3ded59-60c6-4116-9c40-a4adaa038b90-snapshots\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.852612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-stats-auth\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.852612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852512 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-default-certificate\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.852612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852541 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l52v2\" (UID: \"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:03.852612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852573 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.852612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ad657aa-76f6-400b-b80a-239f6b0aa519-trusted-ca\") pod \"console-operator-7866497494-6zqnz\" (UID: \"4ad657aa-76f6-400b-b80a-239f6b0aa519\") " pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.853017 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852640 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec3ded59-60c6-4116-9c40-a4adaa038b90-tmp\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.853017 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852671 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ad657aa-76f6-400b-b80a-239f6b0aa519-config\") pod \"console-operator-7866497494-6zqnz\" (UID: \"4ad657aa-76f6-400b-b80a-239f6b0aa519\") " pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.853017 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852738 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3ded59-60c6-4116-9c40-a4adaa038b90-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.853017 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb75w\" (UniqueName: \"kubernetes.io/projected/ec3ded59-60c6-4116-9c40-a4adaa038b90-kube-api-access-vb75w\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.853017 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.852825 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.853017 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:03.852961 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle podName:76ef5f08-9086-4f3d-a0b7-5115bd070ea8 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:04.35294182 +0000 UTC m=+221.971374820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle") pod "router-default-6cf6c66c44-5lkdq" (UID: "76ef5f08-9086-4f3d-a0b7-5115bd070ea8") : configmap references non-existent config key: service-ca.crt Jul 10 20:25:03.853327 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.853039 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3ded59-60c6-4116-9c40-a4adaa038b90-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.853327 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:03.853170 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 20:25:03.853327 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:03.853225 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs podName:76ef5f08-9086-4f3d-a0b7-5115bd070ea8 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:04.353209003 +0000 UTC m=+221.971641986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs") pod "router-default-6cf6c66c44-5lkdq" (UID: "76ef5f08-9086-4f3d-a0b7-5115bd070ea8") : secret "router-metrics-certs-default" not found Jul 10 20:25:03.853643 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.853623 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ad657aa-76f6-400b-b80a-239f6b0aa519-trusted-ca\") pod \"console-operator-7866497494-6zqnz\" (UID: \"4ad657aa-76f6-400b-b80a-239f6b0aa519\") " pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.853718 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.853691 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ec3ded59-60c6-4116-9c40-a4adaa038b90-snapshots\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.853832 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.853814 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec3ded59-60c6-4116-9c40-a4adaa038b90-tmp\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.853935 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.853915 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ad657aa-76f6-400b-b80a-239f6b0aa519-config\") pod \"console-operator-7866497494-6zqnz\" (UID: \"4ad657aa-76f6-400b-b80a-239f6b0aa519\") " pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.854580 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.854558 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3ded59-60c6-4116-9c40-a4adaa038b90-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.855551 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.855532 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ad657aa-76f6-400b-b80a-239f6b0aa519-serving-cert\") pod \"console-operator-7866497494-6zqnz\" (UID: \"4ad657aa-76f6-400b-b80a-239f6b0aa519\") " pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.855670 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.855653 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-default-certificate\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.855748 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.855727 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-stats-auth\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.856735 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.856714 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec3ded59-60c6-4116-9c40-a4adaa038b90-serving-cert\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.861562 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.861532 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddvqp\" (UniqueName: \"kubernetes.io/projected/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-kube-api-access-ddvqp\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:03.861685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.861624 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb75w\" (UniqueName: \"kubernetes.io/projected/ec3ded59-60c6-4116-9c40-a4adaa038b90-kube-api-access-vb75w\") pod \"insights-operator-68d9dd94cf-9r9sr\" (UID: \"ec3ded59-60c6-4116-9c40-a4adaa038b90\") " pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.861872 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.861851 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpdhw\" (UniqueName: \"kubernetes.io/projected/4ad657aa-76f6-400b-b80a-239f6b0aa519-kube-api-access-lpdhw\") pod \"console-operator-7866497494-6zqnz\" (UID: \"4ad657aa-76f6-400b-b80a-239f6b0aa519\") " pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.873370 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.873343 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:03.878425 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.878403 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" Jul 10 20:25:03.889712 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.889684 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:03.953593 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.953403 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-l52v2\" (UID: \"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:03.953593 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.953461 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l52v2\" (UID: \"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:03.953593 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.953498 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvkfk\" (UniqueName: \"kubernetes.io/projected/2e85a8f5-b276-42e2-a3b9-f017b9d22610-kube-api-access-nvkfk\") pod \"network-check-source-869dcfcdcd-dtzqb\" (UID: \"2e85a8f5-b276-42e2-a3b9-f017b9d22610\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dtzqb" Jul 10 20:25:03.954489 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:03.954041 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 20:25:03.954489 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:03.954209 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert podName:2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:04.454186478 +0000 UTC m=+222.072619477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-l52v2" (UID: "2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d") : secret "networking-console-plugin-cert" not found Jul 10 20:25:03.954489 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:03.954336 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-l52v2\" (UID: \"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:04.012995 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.012962 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-9r9sr"] Jul 10 20:25:04.016271 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:25:04.016243 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3ded59_60c6_4116_9c40_a4adaa038b90.slice/crio-96cb6330e39545aa0f93da07dd97197ced8f6145a84aed0ca97bfa6ee2c410e1 WatchSource:0}: Error finding container 96cb6330e39545aa0f93da07dd97197ced8f6145a84aed0ca97bfa6ee2c410e1: Status 404 returned error can't find the container with id 96cb6330e39545aa0f93da07dd97197ced8f6145a84aed0ca97bfa6ee2c410e1 Jul 10 20:25:04.027784 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.027759 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-6zqnz"] Jul 10 20:25:04.030541 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:25:04.030518 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad657aa_76f6_400b_b80a_239f6b0aa519.slice/crio-644550ca5082ebb4f50a11f00c1e3ce4e4db7a02ecec37a7fe2b1ae56fe2b7e8 WatchSource:0}: Error finding container 644550ca5082ebb4f50a11f00c1e3ce4e4db7a02ecec37a7fe2b1ae56fe2b7e8: Status 404 returned error can't find the container with id 644550ca5082ebb4f50a11f00c1e3ce4e4db7a02ecec37a7fe2b1ae56fe2b7e8 Jul 10 20:25:04.054147 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.054118 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvkfk\" (UniqueName: \"kubernetes.io/projected/2e85a8f5-b276-42e2-a3b9-f017b9d22610-kube-api-access-nvkfk\") pod \"network-check-source-869dcfcdcd-dtzqb\" (UID: \"2e85a8f5-b276-42e2-a3b9-f017b9d22610\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dtzqb" Jul 10 20:25:04.062748 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.062720 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvkfk\" (UniqueName: \"kubernetes.io/projected/2e85a8f5-b276-42e2-a3b9-f017b9d22610-kube-api-access-nvkfk\") pod \"network-check-source-869dcfcdcd-dtzqb\" (UID: \"2e85a8f5-b276-42e2-a3b9-f017b9d22610\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dtzqb" Jul 10 20:25:04.073648 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.073626 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dtzqb" Jul 10 20:25:04.200449 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.200419 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-dtzqb"] Jul 10 20:25:04.204770 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:25:04.204742 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e85a8f5_b276_42e2_a3b9_f017b9d22610.slice/crio-8fdcaa4ac54225865454b2185638dac064724388164bdee241338fb0a897a4af WatchSource:0}: Error finding container 8fdcaa4ac54225865454b2185638dac064724388164bdee241338fb0a897a4af: Status 404 returned error can't find the container with id 8fdcaa4ac54225865454b2185638dac064724388164bdee241338fb0a897a4af Jul 10 20:25:04.355855 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.355810 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:04.356049 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.355868 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:04.356049 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:04.355979 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle podName:76ef5f08-9086-4f3d-a0b7-5115bd070ea8 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:05.355962144 +0000 UTC m=+222.974395127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle") pod "router-default-6cf6c66c44-5lkdq" (UID: "76ef5f08-9086-4f3d-a0b7-5115bd070ea8") : configmap references non-existent config key: service-ca.crt Jul 10 20:25:04.356049 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:04.355983 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 20:25:04.356049 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:04.356018 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs podName:76ef5f08-9086-4f3d-a0b7-5115bd070ea8 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:05.356010832 +0000 UTC m=+222.974443813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs") pod "router-default-6cf6c66c44-5lkdq" (UID: "76ef5f08-9086-4f3d-a0b7-5115bd070ea8") : secret "router-metrics-certs-default" not found Jul 10 20:25:04.456924 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.456884 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l52v2\" (UID: \"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:04.457118 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:04.457026 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 20:25:04.457118 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:04.457114 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert podName:2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:05.457095218 +0000 UTC m=+223.075528199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-l52v2" (UID: "2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d") : secret "networking-console-plugin-cert" not found Jul 10 20:25:04.698177 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.698095 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dtzqb" event={"ID":"2e85a8f5-b276-42e2-a3b9-f017b9d22610","Type":"ContainerStarted","Data":"ddfa3b48556d9c3db6a93d315a10152b7bd249830bbc095415473a9332abad9e"} Jul 10 20:25:04.698177 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.698164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dtzqb" event={"ID":"2e85a8f5-b276-42e2-a3b9-f017b9d22610","Type":"ContainerStarted","Data":"8fdcaa4ac54225865454b2185638dac064724388164bdee241338fb0a897a4af"} Jul 10 20:25:04.699407 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.699371 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6zqnz" event={"ID":"4ad657aa-76f6-400b-b80a-239f6b0aa519","Type":"ContainerStarted","Data":"644550ca5082ebb4f50a11f00c1e3ce4e4db7a02ecec37a7fe2b1ae56fe2b7e8"} Jul 10 20:25:04.700613 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.700558 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" event={"ID":"ec3ded59-60c6-4116-9c40-a4adaa038b90","Type":"ContainerStarted","Data":"96cb6330e39545aa0f93da07dd97197ced8f6145a84aed0ca97bfa6ee2c410e1"} Jul 10 20:25:04.714440 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:04.714333 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dtzqb" podStartSLOduration=1.714309833 podStartE2EDuration="1.714309833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:04.713079654 +0000 UTC m=+222.331512653" watchObservedRunningTime="2026-07-10 20:25:04.714309833 +0000 UTC m=+222.332742836" Jul 10 20:25:05.364364 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:05.364329 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:05.364564 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:05.364403 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:05.364564 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:05.364539 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle podName:76ef5f08-9086-4f3d-a0b7-5115bd070ea8 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:07.364515598 +0000 UTC m=+224.982948587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle") pod "router-default-6cf6c66c44-5lkdq" (UID: "76ef5f08-9086-4f3d-a0b7-5115bd070ea8") : configmap references non-existent config key: service-ca.crt Jul 10 20:25:05.364564 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:05.364559 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 20:25:05.364707 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:05.364609 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs podName:76ef5f08-9086-4f3d-a0b7-5115bd070ea8 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:07.364593142 +0000 UTC m=+224.983026124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs") pod "router-default-6cf6c66c44-5lkdq" (UID: "76ef5f08-9086-4f3d-a0b7-5115bd070ea8") : secret "router-metrics-certs-default" not found Jul 10 20:25:05.466021 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:05.465978 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l52v2\" (UID: \"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:05.466209 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:05.466174 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 20:25:05.466260 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:05.466247 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert podName:2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:07.466227996 +0000 UTC m=+225.084660991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-l52v2" (UID: "2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d") : secret "networking-console-plugin-cert" not found Jul 10 20:25:06.398491 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:06.398453 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:06.452531 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:06.452493 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:06.709114 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:06.709040 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" event={"ID":"ec3ded59-60c6-4116-9c40-a4adaa038b90","Type":"ContainerStarted","Data":"341cae2a1c2d272d8e6a273cc30869397c64a59dcc818d2271712ee11f988131"} Jul 10 20:25:06.710619 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:06.710599 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/0.log" Jul 10 20:25:06.710743 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:06.710649 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ad657aa-76f6-400b-b80a-239f6b0aa519" containerID="0c066b32c2a7cf289649980f30eadc6d4cc7a8520d1cbcf93e92bc37a7766e42" exitCode=255 Jul 10 20:25:06.710743 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:06.710684 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6zqnz" event={"ID":"4ad657aa-76f6-400b-b80a-239f6b0aa519","Type":"ContainerDied","Data":"0c066b32c2a7cf289649980f30eadc6d4cc7a8520d1cbcf93e92bc37a7766e42"} Jul 10 20:25:06.710903 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:06.710889 2566 scope.go:117] "RemoveContainer" containerID="0c066b32c2a7cf289649980f30eadc6d4cc7a8520d1cbcf93e92bc37a7766e42" Jul 10 20:25:06.728668 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:06.728620 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" podStartSLOduration=1.236058164 podStartE2EDuration="3.728602587s" totalImagesPullingTime="2.492544423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:06.727553084 +0000 UTC m=+224.345986088" watchObservedRunningTime="2026-07-10 20:25:06.728602587 +0000 UTC m=+224.347035649" Jul 10 20:25:07.385717 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.385679 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:07.385905 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.385736 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:07.385905 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:07.385866 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 20:25:07.385905 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:07.385898 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle podName:76ef5f08-9086-4f3d-a0b7-5115bd070ea8 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:11.385879535 +0000 UTC m=+229.004312536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle") pod "router-default-6cf6c66c44-5lkdq" (UID: "76ef5f08-9086-4f3d-a0b7-5115bd070ea8") : configmap references non-existent config key: service-ca.crt Jul 10 20:25:07.386097 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:07.385923 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs podName:76ef5f08-9086-4f3d-a0b7-5115bd070ea8 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:11.385912752 +0000 UTC m=+229.004345734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs") pod "router-default-6cf6c66c44-5lkdq" (UID: "76ef5f08-9086-4f3d-a0b7-5115bd070ea8") : secret "router-metrics-certs-default" not found Jul 10 20:25:07.469480 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.469445 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jbtnk"] Jul 10 20:25:07.471654 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.471616 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.474844 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.474820 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mrs5z\"" Jul 10 20:25:07.474990 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.474928 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 20:25:07.475544 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.475522 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 20:25:07.487049 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.487020 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/164c5d56-df32-4e1c-b67a-048432926a91-data-volume\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.487188 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.487110 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l52v2\" (UID: \"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:07.487248 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.487157 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/164c5d56-df32-4e1c-b67a-048432926a91-crio-socket\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.487248 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.487229 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.487349 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.487256 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.487349 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:07.487260 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 20:25:07.487349 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.487278 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcdrm\" (UniqueName: \"kubernetes.io/projected/164c5d56-df32-4e1c-b67a-048432926a91-kube-api-access-wcdrm\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.487349 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:07.487318 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert podName:2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:11.48730245 +0000 UTC m=+229.105735434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-l52v2" (UID: "2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d") : secret "networking-console-plugin-cert" not found Jul 10 20:25:07.498592 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.498563 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jbtnk"] Jul 10 20:25:07.512266 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.512235 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:07.578708 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.578645 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:07.587692 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.587657 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/164c5d56-df32-4e1c-b67a-048432926a91-data-volume\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.587829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.587759 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/164c5d56-df32-4e1c-b67a-048432926a91-crio-socket\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.587829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.587791 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.587829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.587819 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.587977 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.587843 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcdrm\" (UniqueName: \"kubernetes.io/projected/164c5d56-df32-4e1c-b67a-048432926a91-kube-api-access-wcdrm\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.587977 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.587882 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/164c5d56-df32-4e1c-b67a-048432926a91-crio-socket\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.587977 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:07.587908 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:25:07.587977 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:07.587931 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:25:07.588179 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:07.587981 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm podName:164c5d56-df32-4e1c-b67a-048432926a91 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:08.087960713 +0000 UTC m=+225.706393695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbtnk" (UID: "164c5d56-df32-4e1c-b67a-048432926a91") : configmap "kube-rbac-proxy" not found Jul 10 20:25:07.588179 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:07.588003 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls podName:164c5d56-df32-4e1c-b67a-048432926a91 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:08.087991422 +0000 UTC m=+225.706424406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbtnk" (UID: "164c5d56-df32-4e1c-b67a-048432926a91") : secret "insights-runtime-extractor-tls" not found Jul 10 20:25:07.588179 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.588016 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/164c5d56-df32-4e1c-b67a-048432926a91-data-volume\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.597209 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.597177 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcdrm\" (UniqueName: \"kubernetes.io/projected/164c5d56-df32-4e1c-b67a-048432926a91-kube-api-access-wcdrm\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:07.715948 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.715914 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:25:07.716365 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.716350 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/0.log" Jul 10 20:25:07.716431 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.716383 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ad657aa-76f6-400b-b80a-239f6b0aa519" containerID="6300054dc4ce5fa92587e1a4f0ebb752167c1a0f4d4859c7c8319ebb71a6a9f8" exitCode=255 Jul 10 20:25:07.716476 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.716462 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6zqnz" event={"ID":"4ad657aa-76f6-400b-b80a-239f6b0aa519","Type":"ContainerDied","Data":"6300054dc4ce5fa92587e1a4f0ebb752167c1a0f4d4859c7c8319ebb71a6a9f8"} Jul 10 20:25:07.716515 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.716502 2566 scope.go:117] "RemoveContainer" containerID="0c066b32c2a7cf289649980f30eadc6d4cc7a8520d1cbcf93e92bc37a7766e42" Jul 10 20:25:07.716732 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:07.716699 2566 scope.go:117] "RemoveContainer" containerID="6300054dc4ce5fa92587e1a4f0ebb752167c1a0f4d4859c7c8319ebb71a6a9f8" Jul 10 20:25:07.716914 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:07.716894 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-6zqnz_openshift-console-operator(4ad657aa-76f6-400b-b80a-239f6b0aa519)\"" pod="openshift-console-operator/console-operator-7866497494-6zqnz" podUID="4ad657aa-76f6-400b-b80a-239f6b0aa519" Jul 10 20:25:08.092206 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:08.092091 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:08.092206 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:08.092154 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:08.092446 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:08.092290 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:25:08.092446 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:08.092306 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:25:08.092446 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:08.092378 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls podName:164c5d56-df32-4e1c-b67a-048432926a91 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:09.092356888 +0000 UTC m=+226.710789871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbtnk" (UID: "164c5d56-df32-4e1c-b67a-048432926a91") : secret "insights-runtime-extractor-tls" not found Jul 10 20:25:08.092446 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:08.092398 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm podName:164c5d56-df32-4e1c-b67a-048432926a91 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:09.092388704 +0000 UTC m=+226.710821685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbtnk" (UID: "164c5d56-df32-4e1c-b67a-048432926a91") : configmap "kube-rbac-proxy" not found Jul 10 20:25:08.163853 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:08.163821 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:08.260615 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:08.260582 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:08.364562 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:08.364481 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:08.461319 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:08.461290 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:08.720537 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:08.720509 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:25:08.720967 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:08.720836 2566 scope.go:117] "RemoveContainer" containerID="6300054dc4ce5fa92587e1a4f0ebb752167c1a0f4d4859c7c8319ebb71a6a9f8" Jul 10 20:25:08.721075 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:08.721036 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-6zqnz_openshift-console-operator(4ad657aa-76f6-400b-b80a-239f6b0aa519)\"" pod="openshift-console-operator/console-operator-7866497494-6zqnz" podUID="4ad657aa-76f6-400b-b80a-239f6b0aa519" Jul 10 20:25:09.017861 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:09.017780 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:09.068254 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:09.068222 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:09.100749 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:09.100710 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:09.100749 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:09.100763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:09.100999 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:09.100857 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:25:09.100999 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:09.100869 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:25:09.100999 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:09.100925 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls podName:164c5d56-df32-4e1c-b67a-048432926a91 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:11.100910093 +0000 UTC m=+228.719343074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbtnk" (UID: "164c5d56-df32-4e1c-b67a-048432926a91") : secret "insights-runtime-extractor-tls" not found Jul 10 20:25:09.100999 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:09.100947 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm podName:164c5d56-df32-4e1c-b67a-048432926a91 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:11.10093665 +0000 UTC m=+228.719369632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbtnk" (UID: "164c5d56-df32-4e1c-b67a-048432926a91") : configmap "kube-rbac-proxy" not found Jul 10 20:25:09.523103 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:09.523081 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gk76z_1bb76bc0-7262-46cf-b492-7ccd2e542fe2/dns-node-resolver/0.log" Jul 10 20:25:10.323782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.323752 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bb2fz_e88eed6b-d362-4848-a548-699f174407ee/node-ca/0.log" Jul 10 20:25:10.610642 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.610565 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qbzfs"] Jul 10 20:25:10.613341 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.613321 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" Jul 10 20:25:10.616218 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.616198 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 10 20:25:10.617547 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.617529 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-k45dt\"" Jul 10 20:25:10.617624 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.617572 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 10 20:25:10.617675 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.617628 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 10 20:25:10.617675 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.617638 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 10 20:25:10.625138 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.625117 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qbzfs"] Jul 10 20:25:10.654206 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.654171 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:10.707364 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.707331 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:10.712416 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.712391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/582e5937-f31d-429a-8481-21af76538045-signing-cabundle\") pod \"service-ca-79f68b9f4f-qbzfs\" (UID: \"582e5937-f31d-429a-8481-21af76538045\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" Jul 10 20:25:10.712547 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.712531 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvtsb\" (UniqueName: \"kubernetes.io/projected/582e5937-f31d-429a-8481-21af76538045-kube-api-access-jvtsb\") pod \"service-ca-79f68b9f4f-qbzfs\" (UID: \"582e5937-f31d-429a-8481-21af76538045\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" Jul 10 20:25:10.712635 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.712618 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/582e5937-f31d-429a-8481-21af76538045-signing-key\") pod \"service-ca-79f68b9f4f-qbzfs\" (UID: \"582e5937-f31d-429a-8481-21af76538045\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" Jul 10 20:25:10.813955 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.813913 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtsb\" (UniqueName: \"kubernetes.io/projected/582e5937-f31d-429a-8481-21af76538045-kube-api-access-jvtsb\") pod \"service-ca-79f68b9f4f-qbzfs\" (UID: \"582e5937-f31d-429a-8481-21af76538045\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" Jul 10 20:25:10.814161 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.814010 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/582e5937-f31d-429a-8481-21af76538045-signing-key\") pod \"service-ca-79f68b9f4f-qbzfs\" (UID: \"582e5937-f31d-429a-8481-21af76538045\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" Jul 10 20:25:10.814161 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.814037 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/582e5937-f31d-429a-8481-21af76538045-signing-cabundle\") pod \"service-ca-79f68b9f4f-qbzfs\" (UID: \"582e5937-f31d-429a-8481-21af76538045\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" Jul 10 20:25:10.814787 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.814729 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/582e5937-f31d-429a-8481-21af76538045-signing-cabundle\") pod \"service-ca-79f68b9f4f-qbzfs\" (UID: \"582e5937-f31d-429a-8481-21af76538045\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" Jul 10 20:25:10.816594 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.816568 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/582e5937-f31d-429a-8481-21af76538045-signing-key\") pod \"service-ca-79f68b9f4f-qbzfs\" (UID: \"582e5937-f31d-429a-8481-21af76538045\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" Jul 10 20:25:10.822765 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.822740 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvtsb\" (UniqueName: \"kubernetes.io/projected/582e5937-f31d-429a-8481-21af76538045-kube-api-access-jvtsb\") pod \"service-ca-79f68b9f4f-qbzfs\" (UID: \"582e5937-f31d-429a-8481-21af76538045\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" Jul 10 20:25:10.922215 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:10.922133 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" Jul 10 20:25:11.046707 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:11.046665 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qbzfs"] Jul 10 20:25:11.049753 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:25:11.049723 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582e5937_f31d_429a_8481_21af76538045.slice/crio-2b37192497a0d2701c4808999c906059c721a98c767043a6ada1f2aa93685034 WatchSource:0}: Error finding container 2b37192497a0d2701c4808999c906059c721a98c767043a6ada1f2aa93685034: Status 404 returned error can't find the container with id 2b37192497a0d2701c4808999c906059c721a98c767043a6ada1f2aa93685034 Jul 10 20:25:11.117019 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:11.116988 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:11.117184 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:11.117025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:11.117184 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:11.117160 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:25:11.117255 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:11.117244 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls podName:164c5d56-df32-4e1c-b67a-048432926a91 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:15.117227686 +0000 UTC m=+232.735660670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbtnk" (UID: "164c5d56-df32-4e1c-b67a-048432926a91") : secret "insights-runtime-extractor-tls" not found Jul 10 20:25:11.117255 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:11.117162 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:25:11.117325 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:11.117291 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm podName:164c5d56-df32-4e1c-b67a-048432926a91 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:15.117279931 +0000 UTC m=+232.735712911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbtnk" (UID: "164c5d56-df32-4e1c-b67a-048432926a91") : configmap "kube-rbac-proxy" not found Jul 10 20:25:11.123275 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:11.123227 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6t2bs_19c473d4-be6e-444b-8de4-19962da37958/serve-healthcheck-canary/0.log" Jul 10 20:25:11.419384 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:11.419344 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:11.419812 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:11.419448 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:11.419812 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:11.419508 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 20:25:11.419812 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:11.419571 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle podName:76ef5f08-9086-4f3d-a0b7-5115bd070ea8 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:19.419554663 +0000 UTC m=+237.037987673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle") pod "router-default-6cf6c66c44-5lkdq" (UID: "76ef5f08-9086-4f3d-a0b7-5115bd070ea8") : configmap references non-existent config key: service-ca.crt Jul 10 20:25:11.419812 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:11.419595 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs podName:76ef5f08-9086-4f3d-a0b7-5115bd070ea8 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:19.419587239 +0000 UTC m=+237.038020220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs") pod "router-default-6cf6c66c44-5lkdq" (UID: "76ef5f08-9086-4f3d-a0b7-5115bd070ea8") : secret "router-metrics-certs-default" not found Jul 10 20:25:11.520538 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:11.520505 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l52v2\" (UID: \"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:11.520720 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:11.520665 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 20:25:11.520778 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:11.520734 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert podName:2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:19.520718159 +0000 UTC m=+237.139151147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-l52v2" (UID: "2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d") : secret "networking-console-plugin-cert" not found Jul 10 20:25:11.625770 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:11.625723 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:11.731645 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:11.731599 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" event={"ID":"582e5937-f31d-429a-8481-21af76538045","Type":"ContainerStarted","Data":"2b37192497a0d2701c4808999c906059c721a98c767043a6ada1f2aa93685034"} Jul 10 20:25:13.739039 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:13.739002 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" event={"ID":"582e5937-f31d-429a-8481-21af76538045","Type":"ContainerStarted","Data":"e3c0dc8463f422f046cf3ec26c2d1e4933a685407c5bcde1b746d54e539b5886"} Jul 10 20:25:13.759183 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:13.759119 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-qbzfs" podStartSLOduration=1.912085711 podStartE2EDuration="3.759096943s" totalImagesPullingTime="1.847011232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:13.757594288 +0000 UTC m=+231.376027293" watchObservedRunningTime="2026-07-10 20:25:13.759096943 +0000 UTC m=+231.377529945" Jul 10 20:25:13.890115 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:13.890006 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:13.890115 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:13.890083 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:13.890434 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:13.890421 2566 scope.go:117] "RemoveContainer" containerID="6300054dc4ce5fa92587e1a4f0ebb752167c1a0f4d4859c7c8319ebb71a6a9f8" Jul 10 20:25:13.890583 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:13.890566 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-6zqnz_openshift-console-operator(4ad657aa-76f6-400b-b80a-239f6b0aa519)\"" pod="openshift-console-operator/console-operator-7866497494-6zqnz" podUID="4ad657aa-76f6-400b-b80a-239f6b0aa519" Jul 10 20:25:14.391183 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:14.391145 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:14.653089 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:14.652952 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:14.751305 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:14.751267 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:14.860238 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:14.860201 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:15.023256 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:15.023209 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:15.125614 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:15.125572 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:15.152993 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:15.152955 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:15.153191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:15.153016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:15.153191 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:15.153116 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:25:15.153191 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:15.153143 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:25:15.153191 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:15.153183 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm podName:164c5d56-df32-4e1c-b67a-048432926a91 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:23.153163621 +0000 UTC m=+240.771596605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbtnk" (UID: "164c5d56-df32-4e1c-b67a-048432926a91") : configmap "kube-rbac-proxy" not found Jul 10 20:25:15.153346 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:15.153209 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls podName:164c5d56-df32-4e1c-b67a-048432926a91 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:23.15319044 +0000 UTC m=+240.771623425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbtnk" (UID: "164c5d56-df32-4e1c-b67a-048432926a91") : secret "insights-runtime-extractor-tls" not found Jul 10 20:25:15.227473 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:15.227440 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:16.257894 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:16.257866 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:16.454111 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:16.454075 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:16.662770 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:16.662685 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:16.904427 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:16.904398 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:17.065333 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:17.065284 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:17.987008 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:17.986977 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:18.161359 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:18.161328 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:18.262336 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:18.262251 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:18.319739 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:18.319708 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:18.458548 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:18.458512 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:19.489295 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:19.489245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:19.489678 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:19.489339 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:19.489678 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:19.489472 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle podName:76ef5f08-9086-4f3d-a0b7-5115bd070ea8 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:35.489454438 +0000 UTC m=+253.107887440 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle") pod "router-default-6cf6c66c44-5lkdq" (UID: "76ef5f08-9086-4f3d-a0b7-5115bd070ea8") : configmap references non-existent config key: service-ca.crt Jul 10 20:25:19.491953 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:19.491929 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-metrics-certs\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:19.590151 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:19.590103 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l52v2\" (UID: \"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:19.590297 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:19.590260 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 20:25:19.590349 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:19.590326 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert podName:2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:35.590308844 +0000 UTC m=+253.208741848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-l52v2" (UID: "2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d") : secret "networking-console-plugin-cert" not found Jul 10 20:25:20.114557 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:20.114515 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:20.253645 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:20.253611 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:20.310396 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:20.310368 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:20.454402 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:20.454372 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:20.654706 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:20.654668 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:20.755196 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:20.755105 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:20.855769 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:20.855732 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:20.957216 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:20.957178 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:21.058317 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:21.058233 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:22.252575 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:22.252533 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:22.454046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:22.454014 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:22.651809 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:22.651696 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:22.863743 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:22.863716 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:23.056194 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:23.056139 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:23.219610 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:23.219574 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:23.219806 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:23.219712 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:23.219875 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:23.219835 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:25:23.220300 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:23.220281 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls podName:164c5d56-df32-4e1c-b67a-048432926a91 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:39.220262656 +0000 UTC m=+256.838695636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbtnk" (UID: "164c5d56-df32-4e1c-b67a-048432926a91") : secret "insights-runtime-extractor-tls" not found Jul 10 20:25:23.220459 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:23.220333 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/164c5d56-df32-4e1c-b67a-048432926a91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:24.256223 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:24.256184 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:25.892512 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:25.892474 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:25.943251 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:25.943209 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:26.961650 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:26.961622 2566 scope.go:117] "RemoveContainer" containerID="6300054dc4ce5fa92587e1a4f0ebb752167c1a0f4d4859c7c8319ebb71a6a9f8" Jul 10 20:25:27.543283 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:27.543240 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:27.644685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:27.644631 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:27.744309 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:27.744271 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:27.783644 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:27.783625 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:25:27.783793 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:27.783707 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6zqnz" event={"ID":"4ad657aa-76f6-400b-b80a-239f6b0aa519","Type":"ContainerStarted","Data":"9c46f0a0a88dcc486f1c087c4c5157887733ad23782e160369ea81ba8b47e2e4"} Jul 10 20:25:27.784015 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:27.783994 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:27.788526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:27.788504 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-6zqnz" Jul 10 20:25:27.801676 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:27.801581 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-6zqnz" podStartSLOduration=22.321699378 podStartE2EDuration="24.801566085s" totalImagesPullingTime="2.479866707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:27.800337463 +0000 UTC m=+245.418770466" watchObservedRunningTime="2026-07-10 20:25:27.801566085 +0000 UTC m=+245.419999104" Jul 10 20:25:29.445620 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:29.445587 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:29.546228 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:29.546191 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:29.897096 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:29.896961 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:29.945369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:29.945332 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f79bf796d-s9zzk"] Jul 10 20:25:29.947452 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:29.947436 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:29.950665 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:29.950638 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 20:25:29.950819 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:29.950638 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 20:25:29.950819 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:29.950804 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 20:25:29.951971 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:29.951949 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s5ppj\"" Jul 10 20:25:29.956207 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:29.956184 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 20:25:29.963934 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:29.963910 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f79bf796d-s9zzk"] Jul 10 20:25:29.995535 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:29.995505 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:30.063347 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.063312 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:30.073246 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.073221 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20684401-34fd-4f59-8eab-261246fbc840-bound-sa-token\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.073368 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.073276 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20684401-34fd-4f59-8eab-261246fbc840-ca-trust-extracted\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.073368 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.073330 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk62p\" (UniqueName: \"kubernetes.io/projected/20684401-34fd-4f59-8eab-261246fbc840-kube-api-access-rk62p\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.073368 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.073351 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20684401-34fd-4f59-8eab-261246fbc840-image-registry-private-configuration\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.073504 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.073381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20684401-34fd-4f59-8eab-261246fbc840-registry-certificates\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.073504 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.073435 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20684401-34fd-4f59-8eab-261246fbc840-trusted-ca\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.073504 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.073465 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20684401-34fd-4f59-8eab-261246fbc840-installation-pull-secrets\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.073604 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.073509 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20684401-34fd-4f59-8eab-261246fbc840-registry-tls\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.174105 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.173988 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20684401-34fd-4f59-8eab-261246fbc840-ca-trust-extracted\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.174105 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.174048 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk62p\" (UniqueName: \"kubernetes.io/projected/20684401-34fd-4f59-8eab-261246fbc840-kube-api-access-rk62p\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.174105 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.174103 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20684401-34fd-4f59-8eab-261246fbc840-image-registry-private-configuration\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.174386 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.174147 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20684401-34fd-4f59-8eab-261246fbc840-registry-certificates\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.174386 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.174177 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20684401-34fd-4f59-8eab-261246fbc840-trusted-ca\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.174386 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.174198 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20684401-34fd-4f59-8eab-261246fbc840-installation-pull-secrets\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.174386 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.174232 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20684401-34fd-4f59-8eab-261246fbc840-registry-tls\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.174386 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.174344 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20684401-34fd-4f59-8eab-261246fbc840-bound-sa-token\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.174636 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.174457 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20684401-34fd-4f59-8eab-261246fbc840-ca-trust-extracted\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.175094 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.175045 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20684401-34fd-4f59-8eab-261246fbc840-registry-certificates\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.175227 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.175176 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20684401-34fd-4f59-8eab-261246fbc840-trusted-ca\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.176713 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.176687 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20684401-34fd-4f59-8eab-261246fbc840-installation-pull-secrets\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.176877 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.176857 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20684401-34fd-4f59-8eab-261246fbc840-image-registry-private-configuration\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.176942 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.176886 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20684401-34fd-4f59-8eab-261246fbc840-registry-tls\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.181646 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.181625 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20684401-34fd-4f59-8eab-261246fbc840-bound-sa-token\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.182212 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.182190 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk62p\" (UniqueName: \"kubernetes.io/projected/20684401-34fd-4f59-8eab-261246fbc840-kube-api-access-rk62p\") pod \"image-registry-5f79bf796d-s9zzk\" (UID: \"20684401-34fd-4f59-8eab-261246fbc840\") " pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.258390 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.258344 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.391804 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.391771 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f79bf796d-s9zzk"] Jul 10 20:25:30.394588 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:25:30.394558 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20684401_34fd_4f59_8eab_261246fbc840.slice/crio-abaea351af469ee57ee97a1b908dce13fed685fb216faa4b55fc033ec16a0ca4 WatchSource:0}: Error finding container abaea351af469ee57ee97a1b908dce13fed685fb216faa4b55fc033ec16a0ca4: Status 404 returned error can't find the container with id abaea351af469ee57ee97a1b908dce13fed685fb216faa4b55fc033ec16a0ca4 Jul 10 20:25:30.794674 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.794587 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" event={"ID":"20684401-34fd-4f59-8eab-261246fbc840","Type":"ContainerStarted","Data":"179f0857210b21112934b1c23a92a1156875d0285ce306f1a76501b8973eba31"} Jul 10 20:25:30.794674 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.794642 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" event={"ID":"20684401-34fd-4f59-8eab-261246fbc840","Type":"ContainerStarted","Data":"abaea351af469ee57ee97a1b908dce13fed685fb216faa4b55fc033ec16a0ca4"} Jul 10 20:25:30.795198 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.794714 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:25:30.812970 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:30.812921 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" podStartSLOduration=1.812905424 podStartE2EDuration="1.812905424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:30.811639787 +0000 UTC m=+248.430072837" watchObservedRunningTime="2026-07-10 20:25:30.812905424 +0000 UTC m=+248.431338426" Jul 10 20:25:31.695454 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:31.695421 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:31.754409 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:31.754377 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:33.502008 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:33.501975 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:33.556978 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:33.556950 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:33.807820 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:33.807732 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:25:33.810115 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:33.810096 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9300a4a2-82bc-450e-8fe5-c5382a177fa4-metrics-certs\") pod \"network-metrics-daemon-2m52m\" (UID: \"9300a4a2-82bc-450e-8fe5-c5382a177fa4\") " pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:25:33.965748 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:33.965711 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mr56z\"" Jul 10 20:25:33.973869 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:33.973844 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2m52m" Jul 10 20:25:34.105700 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:34.105664 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2m52m"] Jul 10 20:25:34.108627 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:25:34.108597 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9300a4a2_82bc_450e_8fe5_c5382a177fa4.slice/crio-ab360b544cf25633d925049a6ff391144785250c30fb8f19b3c639237e3318ea WatchSource:0}: Error finding container ab360b544cf25633d925049a6ff391144785250c30fb8f19b3c639237e3318ea: Status 404 returned error can't find the container with id ab360b544cf25633d925049a6ff391144785250c30fb8f19b3c639237e3318ea Jul 10 20:25:34.806482 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:34.806446 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2m52m" event={"ID":"9300a4a2-82bc-450e-8fe5-c5382a177fa4","Type":"ContainerStarted","Data":"ab360b544cf25633d925049a6ff391144785250c30fb8f19b3c639237e3318ea"} Jul 10 20:25:35.521660 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.521618 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:35.522268 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.522247 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76ef5f08-9086-4f3d-a0b7-5115bd070ea8-service-ca-bundle\") pod \"router-default-6cf6c66c44-5lkdq\" (UID: \"76ef5f08-9086-4f3d-a0b7-5115bd070ea8\") " pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:35.622067 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.622025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l52v2\" (UID: \"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:35.624708 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.624679 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l52v2\" (UID: \"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:35.698676 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.698641 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5b2pw\"" Jul 10 20:25:35.706952 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.706921 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:35.776446 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.776369 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wc2tx\"" Jul 10 20:25:35.784493 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.784471 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" Jul 10 20:25:35.813167 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.813128 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2m52m" event={"ID":"9300a4a2-82bc-450e-8fe5-c5382a177fa4","Type":"ContainerStarted","Data":"0ad481e075e6109763757242241d1e1f7da103d434203164ebe91415379e187c"} Jul 10 20:25:35.813604 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.813196 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2m52m" event={"ID":"9300a4a2-82bc-450e-8fe5-c5382a177fa4","Type":"ContainerStarted","Data":"9069066dc36e85b5737365f21b40883fb8431ff5c09bf4a973e5461addbd4d0a"} Jul 10 20:25:35.828933 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.828885 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2m52m" podStartSLOduration=251.877028558 podStartE2EDuration="4m12.828864302s" totalImagesPullingTime="951.835744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:35.828852136 +0000 UTC m=+253.447285139" watchObservedRunningTime="2026-07-10 20:25:35.828864302 +0000 UTC m=+253.447297310" Jul 10 20:25:35.841444 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.841411 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6cf6c66c44-5lkdq"] Jul 10 20:25:35.844484 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:25:35.844452 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ef5f08_9086_4f3d_a0b7_5115bd070ea8.slice/crio-63c9f74df69eacda25ecf6e0105637e69b762ad5ef5b8fc930e546d13ed2226d WatchSource:0}: Error finding container 63c9f74df69eacda25ecf6e0105637e69b762ad5ef5b8fc930e546d13ed2226d: Status 404 returned error can't find the container with id 63c9f74df69eacda25ecf6e0105637e69b762ad5ef5b8fc930e546d13ed2226d Jul 10 20:25:35.930158 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.929598 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-l52v2"] Jul 10 20:25:35.943988 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:25:35.943960 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d8bdeb4_b0c0_4be5_9386_9ba5dc958c9d.slice/crio-a08b2f118a3088831f19597ec1a72770859efe2aefa467ccecb338c8a5a16479 WatchSource:0}: Error finding container a08b2f118a3088831f19597ec1a72770859efe2aefa467ccecb338c8a5a16479: Status 404 returned error can't find the container with id a08b2f118a3088831f19597ec1a72770859efe2aefa467ccecb338c8a5a16479 Jul 10 20:25:35.948614 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:35.948589 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:36.015169 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:36.015135 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:36.817831 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:36.817788 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" event={"ID":"76ef5f08-9086-4f3d-a0b7-5115bd070ea8","Type":"ContainerStarted","Data":"2f170b498b07eff7c3c2ff32faebecf459ef6e572ff9d8607a91e9a5badae1ba"} Jul 10 20:25:36.818327 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:36.817853 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" event={"ID":"76ef5f08-9086-4f3d-a0b7-5115bd070ea8","Type":"ContainerStarted","Data":"63c9f74df69eacda25ecf6e0105637e69b762ad5ef5b8fc930e546d13ed2226d"} Jul 10 20:25:36.819165 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:36.819130 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" event={"ID":"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d","Type":"ContainerStarted","Data":"a08b2f118a3088831f19597ec1a72770859efe2aefa467ccecb338c8a5a16479"} Jul 10 20:25:36.837776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:36.837697 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" podStartSLOduration=33.837675233 podStartE2EDuration="33.837675233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:36.836558501 +0000 UTC m=+254.454991505" watchObservedRunningTime="2026-07-10 20:25:36.837675233 +0000 UTC m=+254.456108237" Jul 10 20:25:37.456041 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:37.456000 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:37.504882 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:37.504812 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:37.707819 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:37.707774 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:37.710438 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:37.710412 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:37.828627 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:37.828529 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" event={"ID":"2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d","Type":"ContainerStarted","Data":"d1eba4a1926e8c078be409e549b63bbfd63c5907d21d6ac299956a58c1d6b899"} Jul 10 20:25:37.829093 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:37.828843 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:37.830170 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:37.830152 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6cf6c66c44-5lkdq" Jul 10 20:25:37.843986 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:37.843937 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-l52v2" podStartSLOduration=33.569070112 podStartE2EDuration="34.843921958s" totalImagesPullingTime="1.274851846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:37.843522836 +0000 UTC m=+255.461955852" watchObservedRunningTime="2026-07-10 20:25:37.843921958 +0000 UTC m=+255.462354970" Jul 10 20:25:37.946791 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:37.946756 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:38.008279 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:38.008249 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:39.249437 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:39.249387 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:39.251819 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:39.251796 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/164c5d56-df32-4e1c-b67a-048432926a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbtnk\" (UID: \"164c5d56-df32-4e1c-b67a-048432926a91\") " pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:39.283206 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:39.283169 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mrs5z\"" Jul 10 20:25:39.291417 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:39.291386 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jbtnk" Jul 10 20:25:39.437816 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:39.437786 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jbtnk"] Jul 10 20:25:39.440578 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:25:39.440553 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164c5d56_df32_4e1c_b67a_048432926a91.slice/crio-78dd181b5fe56bcb0e4bd0b5a07b681930afe0da4f5fa23c34474e5359a72896 WatchSource:0}: Error finding container 78dd181b5fe56bcb0e4bd0b5a07b681930afe0da4f5fa23c34474e5359a72896: Status 404 returned error can't find the container with id 78dd181b5fe56bcb0e4bd0b5a07b681930afe0da4f5fa23c34474e5359a72896 Jul 10 20:25:39.836115 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:39.836076 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jbtnk" event={"ID":"164c5d56-df32-4e1c-b67a-048432926a91","Type":"ContainerStarted","Data":"78dd181b5fe56bcb0e4bd0b5a07b681930afe0da4f5fa23c34474e5359a72896"} Jul 10 20:25:39.877409 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:39.877377 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:39.978355 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:39.978321 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:40.032604 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:40.032572 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:40.139658 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:40.139559 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:43.851618 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:43.851582 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jbtnk" event={"ID":"164c5d56-df32-4e1c-b67a-048432926a91","Type":"ContainerStarted","Data":"a179753f08b772fac5f5188f0200ea925eee7d8435b3e1215a33ea075e3eca4b"} Jul 10 20:25:44.857155 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:44.857106 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jbtnk" event={"ID":"164c5d56-df32-4e1c-b67a-048432926a91","Type":"ContainerStarted","Data":"b4575a2e76fc5334be4c33aad56fe9b24a24fbb83e2859cdaf06e514e8533612"} Jul 10 20:25:46.254206 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:46.254170 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:46.305608 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:46.305574 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:46.455683 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:46.455372 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:46.556875 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:46.556791 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:46.865325 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:46.865238 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jbtnk" event={"ID":"164c5d56-df32-4e1c-b67a-048432926a91","Type":"ContainerStarted","Data":"d1eb1a0b432f4a51c41162c742ad3de39b725089df2b17a32fce67edacb52c76"} Jul 10 20:25:46.882217 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:46.882170 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jbtnk" podStartSLOduration=33.014993354 podStartE2EDuration="39.882153462s" totalImagesPullingTime="6.867160108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:25:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:46.881425149 +0000 UTC m=+264.499858166" watchObservedRunningTime="2026-07-10 20:25:46.882153462 +0000 UTC m=+264.500586490" Jul 10 20:25:48.860795 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:48.860762 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:48.960224 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:48.960193 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:49.859701 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:49.859670 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:49.918219 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:49.918188 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:50.262842 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:50.262803 2566 patch_prober.go:28] interesting pod/image-registry-5f79bf796d-s9zzk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 20:25:50.262999 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:50.262856 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" podUID="20684401-34fd-4f59-8eab-261246fbc840" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 20:25:51.801918 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:51.801883 2566 patch_prober.go:28] interesting pod/image-registry-5f79bf796d-s9zzk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 20:25:51.802304 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:51.801935 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" podUID="20684401-34fd-4f59-8eab-261246fbc840" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 20:25:52.024715 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.024680 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:52.062645 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.062556 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-2zrqw"] Jul 10 20:25:52.064699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.064675 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.067425 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.067395 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 10 20:25:52.067547 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.067457 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 20:25:52.067547 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.067403 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 10 20:25:52.067668 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.067580 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2ldtg\"" Jul 10 20:25:52.069022 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.069005 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 20:25:52.069107 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.069047 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 20:25:52.075158 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.075134 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-2zrqw"] Jul 10 20:25:52.089504 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.089469 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:52.158613 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.158580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfhjq\" (UniqueName: \"kubernetes.io/projected/68647829-1c26-4658-ad0f-67945f02e250-kube-api-access-gfhjq\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.158752 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.158662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68647829-1c26-4658-ad0f-67945f02e250-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.158752 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.158712 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68647829-1c26-4658-ad0f-67945f02e250-metrics-client-ca\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.158752 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.158733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68647829-1c26-4658-ad0f-67945f02e250-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.259535 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.259497 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68647829-1c26-4658-ad0f-67945f02e250-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.259708 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.259546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfhjq\" (UniqueName: \"kubernetes.io/projected/68647829-1c26-4658-ad0f-67945f02e250-kube-api-access-gfhjq\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.259708 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.259608 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68647829-1c26-4658-ad0f-67945f02e250-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.259708 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:52.259652 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 10 20:25:52.259708 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.259670 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68647829-1c26-4658-ad0f-67945f02e250-metrics-client-ca\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.259936 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:52.259717 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68647829-1c26-4658-ad0f-67945f02e250-prometheus-operator-tls podName:68647829-1c26-4658-ad0f-67945f02e250 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:52.759700633 +0000 UTC m=+270.378133614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/68647829-1c26-4658-ad0f-67945f02e250-prometheus-operator-tls") pod "prometheus-operator-64785b6675-2zrqw" (UID: "68647829-1c26-4658-ad0f-67945f02e250") : secret "prometheus-operator-tls" not found Jul 10 20:25:52.260369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.260345 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68647829-1c26-4658-ad0f-67945f02e250-metrics-client-ca\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.262241 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.262218 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68647829-1c26-4658-ad0f-67945f02e250-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.269382 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.269351 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfhjq\" (UniqueName: \"kubernetes.io/projected/68647829-1c26-4658-ad0f-67945f02e250-kube-api-access-gfhjq\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.399583 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.399499 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:52.763781 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.763737 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68647829-1c26-4658-ad0f-67945f02e250-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.766288 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.766264 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68647829-1c26-4658-ad0f-67945f02e250-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2zrqw\" (UID: \"68647829-1c26-4658-ad0f-67945f02e250\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:52.973690 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:52.973649 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" Jul 10 20:25:53.104420 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:53.104385 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-2zrqw"] Jul 10 20:25:53.107366 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:25:53.107341 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68647829_1c26_4658_ad0f_67945f02e250.slice/crio-ead37e0a9f555074ec67ee78d408a21855052d2e0f5c9c4409ff007f10d88df3 WatchSource:0}: Error finding container ead37e0a9f555074ec67ee78d408a21855052d2e0f5c9c4409ff007f10d88df3: Status 404 returned error can't find the container with id ead37e0a9f555074ec67ee78d408a21855052d2e0f5c9c4409ff007f10d88df3 Jul 10 20:25:53.891853 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:53.891813 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" event={"ID":"68647829-1c26-4658-ad0f-67945f02e250","Type":"ContainerStarted","Data":"ead37e0a9f555074ec67ee78d408a21855052d2e0f5c9c4409ff007f10d88df3"} Jul 10 20:25:54.705692 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:54.705659 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:54.805549 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:54.805506 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:54.861016 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:54.860984 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:54.897319 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:54.897282 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" event={"ID":"68647829-1c26-4658-ad0f-67945f02e250","Type":"ContainerStarted","Data":"3d634135c248a7096daaa846fb16c7bf31f451cebc03a215dd5b932878fbf316"} Jul 10 20:25:54.897466 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:54.897350 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" event={"ID":"68647829-1c26-4658-ad0f-67945f02e250","Type":"ContainerStarted","Data":"b990a71c2858ce97b4e90ccd9d44f13ab4d638ede46ebe7dbfad4ff9fd15b3e3"} Jul 10 20:25:54.917881 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:54.917820 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-2zrqw" podStartSLOduration=1.623122103 podStartE2EDuration="2.917800727s" totalImagesPullingTime="1.294678624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:54.916712281 +0000 UTC m=+272.535145308" watchObservedRunningTime="2026-07-10 20:25:54.917800727 +0000 UTC m=+272.536233730" Jul 10 20:25:55.386257 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:55.386218 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:55.441919 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:55.441886 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:56.184343 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.184312 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:56.403401 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.403367 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:56.431490 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.431451 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-5z4z7"] Jul 10 20:25:56.434245 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.434216 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.437592 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.437529 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 10 20:25:56.437592 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.437572 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 10 20:25:56.438174 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.438151 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 10 20:25:56.438994 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.438975 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-46489\"" Jul 10 20:25:56.453813 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.453780 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-5z4z7"] Jul 10 20:25:56.455267 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.455241 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4259l"] Jul 10 20:25:56.457832 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.457807 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.460851 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.460829 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 20:25:56.461339 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.461320 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d9kfq\"" Jul 10 20:25:56.461533 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.461273 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 20:25:56.461600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.461412 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 20:25:56.495677 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.495642 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:56.495841 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.495654 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-wtmp\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.495841 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.495737 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26bcec1a-a226-4723-b55f-9531478368cc-metrics-client-ca\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.495841 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.495769 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4bcr\" (UniqueName: \"kubernetes.io/projected/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-api-access-d4bcr\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.495841 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.495814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.496046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.495850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.496046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.495879 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-tls\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.496046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.495903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b98aa11-069e-4e6b-b81c-81d9780dc593-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.496046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.495929 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzh88\" (UniqueName: \"kubernetes.io/projected/26bcec1a-a226-4723-b55f-9531478368cc-kube-api-access-hzh88\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.496046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.495954 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.496046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.495984 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b98aa11-069e-4e6b-b81c-81d9780dc593-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.496046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.496010 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26bcec1a-a226-4723-b55f-9531478368cc-sys\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.496046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.496033 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/26bcec1a-a226-4723-b55f-9531478368cc-root\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.496391 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.496108 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-textfile\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.496391 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.496154 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.496391 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.496201 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.596968 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.596920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26bcec1a-a226-4723-b55f-9531478368cc-metrics-client-ca\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.596978 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4bcr\" (UniqueName: \"kubernetes.io/projected/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-api-access-d4bcr\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.597191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597019 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.597191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597071 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.597191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-tls\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597124 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b98aa11-069e-4e6b-b81c-81d9780dc593-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.597191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzh88\" (UniqueName: \"kubernetes.io/projected/26bcec1a-a226-4723-b55f-9531478368cc-kube-api-access-hzh88\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597172 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597200 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b98aa11-069e-4e6b-b81c-81d9780dc593-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.597526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597224 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26bcec1a-a226-4723-b55f-9531478368cc-sys\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597249 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/26bcec1a-a226-4723-b55f-9531478368cc-root\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597280 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-textfile\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597314 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597361 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.597526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597394 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-wtmp\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597844 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597556 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-wtmp\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597844 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597611 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26bcec1a-a226-4723-b55f-9531478368cc-sys\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597844 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597631 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26bcec1a-a226-4723-b55f-9531478368cc-metrics-client-ca\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597844 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597653 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/26bcec1a-a226-4723-b55f-9531478368cc-root\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.597844 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:56.597747 2566 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 10 20:25:56.597844 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:56.597819 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-state-metrics-tls podName:3b98aa11-069e-4e6b-b81c-81d9780dc593 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:57.097800369 +0000 UTC m=+274.716233356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-5z4z7" (UID: "3b98aa11-069e-4e6b-b81c-81d9780dc593") : secret "kube-state-metrics-tls" not found Jul 10 20:25:56.597844 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.597825 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.598197 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.598108 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.598197 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.598136 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b98aa11-069e-4e6b-b81c-81d9780dc593-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.598300 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.598196 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b98aa11-069e-4e6b-b81c-81d9780dc593-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.598356 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.598339 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-textfile\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.598409 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:56.598345 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 10 20:25:56.598409 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:25:56.598408 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-tls podName:26bcec1a-a226-4723-b55f-9531478368cc nodeName:}" failed. No retries permitted until 2026-07-10 20:25:57.098389964 +0000 UTC m=+274.716822950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-tls") pod "node-exporter-4259l" (UID: "26bcec1a-a226-4723-b55f-9531478368cc") : secret "node-exporter-tls" not found Jul 10 20:25:56.603387 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.603356 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.615001 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.614973 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzh88\" (UniqueName: \"kubernetes.io/projected/26bcec1a-a226-4723-b55f-9531478368cc-kube-api-access-hzh88\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:56.615176 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.615132 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4bcr\" (UniqueName: \"kubernetes.io/projected/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-api-access-d4bcr\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.616775 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.616754 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:56.618346 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.618323 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:56.717039 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.716944 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:56.817536 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.817492 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:56.917313 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:56.917269 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:57.017837 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.017756 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:57.101844 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.101798 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-tls\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:57.102026 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.101883 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:57.104831 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.104797 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/26bcec1a-a226-4723-b55f-9531478368cc-node-exporter-tls\") pod \"node-exporter-4259l\" (UID: \"26bcec1a-a226-4723-b55f-9531478368cc\") " pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:57.104966 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.104864 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b98aa11-069e-4e6b-b81c-81d9780dc593-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-5z4z7\" (UID: \"3b98aa11-069e-4e6b-b81c-81d9780dc593\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:57.119326 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.119245 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:57.218076 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.218026 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:57.345487 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.345378 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" Jul 10 20:25:57.370237 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.370200 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4259l" Jul 10 20:25:57.414461 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.414314 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:57.487515 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.487477 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:57.505386 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.505343 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-5z4z7"] Jul 10 20:25:57.509999 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:25:57.509960 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b98aa11_069e_4e6b_b81c_81d9780dc593.slice/crio-d6cc3e1ffa298758f7e0bf3563657b81c01d07c6350f13b109e711d2b60624ec WatchSource:0}: Error finding container d6cc3e1ffa298758f7e0bf3563657b81c01d07c6350f13b109e711d2b60624ec: Status 404 returned error can't find the container with id d6cc3e1ffa298758f7e0bf3563657b81c01d07c6350f13b109e711d2b60624ec Jul 10 20:25:57.627694 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.627605 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:57.727343 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.727305 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:57.909742 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.909649 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4259l" event={"ID":"26bcec1a-a226-4723-b55f-9531478368cc","Type":"ContainerStarted","Data":"02d0ceae1281cb95b9994ee562d8c37c26f2f0f167ddafafa89d9b89c984e526"} Jul 10 20:25:57.911048 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:57.911016 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" event={"ID":"3b98aa11-069e-4e6b-b81c-81d9780dc593","Type":"ContainerStarted","Data":"d6cc3e1ffa298758f7e0bf3563657b81c01d07c6350f13b109e711d2b60624ec"} Jul 10 20:25:58.915485 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:58.915445 2566 generic.go:356] "Generic (PLEG): container finished" podID="26bcec1a-a226-4723-b55f-9531478368cc" containerID="9e8d468a1d12449873cb561f3c1166596e0a9fade07383b380abc2a3ce9ca8db" exitCode=0 Jul 10 20:25:58.915939 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:58.915515 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4259l" event={"ID":"26bcec1a-a226-4723-b55f-9531478368cc","Type":"ContainerDied","Data":"9e8d468a1d12449873cb561f3c1166596e0a9fade07383b380abc2a3ce9ca8db"} Jul 10 20:25:59.396474 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:59.396419 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:59.525097 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:59.525041 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:59.584900 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:59.584863 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:59.823380 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:59.823336 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:25:59.920870 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:59.920828 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" event={"ID":"3b98aa11-069e-4e6b-b81c-81d9780dc593","Type":"ContainerStarted","Data":"ea24f8e2f268c906402274ae8b381eed8ea8d94027ca88fba851d0430d5ecf61"} Jul 10 20:25:59.921329 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:59.920942 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" event={"ID":"3b98aa11-069e-4e6b-b81c-81d9780dc593","Type":"ContainerStarted","Data":"07a28bac2b2e049da9302e8a6b4e361148c561d7ea6f78d1d5ffbd9ca0f3f4a1"} Jul 10 20:25:59.921329 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:59.920967 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" event={"ID":"3b98aa11-069e-4e6b-b81c-81d9780dc593","Type":"ContainerStarted","Data":"e7911e9f61f01e3a8c37c7ac61191ed5460fafa6191b08c4fcddb2c18508354c"} Jul 10 20:25:59.922833 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:59.922804 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4259l" event={"ID":"26bcec1a-a226-4723-b55f-9531478368cc","Type":"ContainerStarted","Data":"a5e2f9f0f7a0a80b789713ebf5e14979c44ebc5559e4d79860fe31c072b1fb76"} Jul 10 20:25:59.922964 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:59.922853 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4259l" event={"ID":"26bcec1a-a226-4723-b55f-9531478368cc","Type":"ContainerStarted","Data":"1750dbb27fed809df79f9782bbdc831735de0a91124b8d83f04a118a86bb54b3"} Jul 10 20:25:59.939789 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:59.939734 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-5z4z7" podStartSLOduration=2.532878683 podStartE2EDuration="3.93971951s" totalImagesPullingTime="1.406840827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:59.937489784 +0000 UTC m=+277.555922787" watchObservedRunningTime="2026-07-10 20:25:59.93971951 +0000 UTC m=+277.558152520" Jul 10 20:25:59.959436 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:25:59.959384 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4259l" podStartSLOduration=2.862964484 podStartE2EDuration="3.959365513s" totalImagesPullingTime="1.018024587s" totalInitContainerRuntime="78.376442ms" isStatefulPod=true podCreationTimestamp="2026-07-10 20:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:59.958569779 +0000 UTC m=+277.577002803" watchObservedRunningTime="2026-07-10 20:25:59.959365513 +0000 UTC m=+277.577798515" Jul 10 20:26:00.263374 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.263336 2566 patch_prober.go:28] interesting pod/image-registry-5f79bf796d-s9zzk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 20:26:00.263517 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.263387 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" podUID="20684401-34fd-4f59-8eab-261246fbc840" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 20:26:00.742353 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.742313 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv"] Jul 10 20:26:00.744526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.744504 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.747395 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.747371 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 10 20:26:00.747530 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.747513 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 20:26:00.748660 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.748640 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 10 20:26:00.748727 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.748702 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9l8dlo4rrlgv7\"" Jul 10 20:26:00.748791 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.748771 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-cpqb4\"" Jul 10 20:26:00.748860 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.748774 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 10 20:26:00.755255 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.755230 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv"] Jul 10 20:26:00.832999 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.832950 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e887bce6-4515-44c5-b099-6c317fb743ac-secret-metrics-server-tls\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.832999 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.832999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgx8f\" (UniqueName: \"kubernetes.io/projected/e887bce6-4515-44c5-b099-6c317fb743ac-kube-api-access-cgx8f\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.833254 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.833135 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e887bce6-4515-44c5-b099-6c317fb743ac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.833254 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.833187 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e887bce6-4515-44c5-b099-6c317fb743ac-client-ca-bundle\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.833254 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.833239 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e887bce6-4515-44c5-b099-6c317fb743ac-secret-metrics-server-client-certs\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.833365 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.833269 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e887bce6-4515-44c5-b099-6c317fb743ac-metrics-server-audit-profiles\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.833365 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.833295 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e887bce6-4515-44c5-b099-6c317fb743ac-audit-log\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.934587 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.934555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e887bce6-4515-44c5-b099-6c317fb743ac-secret-metrics-server-tls\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.934587 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.934593 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgx8f\" (UniqueName: \"kubernetes.io/projected/e887bce6-4515-44c5-b099-6c317fb743ac-kube-api-access-cgx8f\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.935032 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.934632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e887bce6-4515-44c5-b099-6c317fb743ac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.935032 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.934655 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e887bce6-4515-44c5-b099-6c317fb743ac-client-ca-bundle\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.935032 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.934687 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e887bce6-4515-44c5-b099-6c317fb743ac-secret-metrics-server-client-certs\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.935032 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.934708 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e887bce6-4515-44c5-b099-6c317fb743ac-metrics-server-audit-profiles\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.935032 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.934739 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e887bce6-4515-44c5-b099-6c317fb743ac-audit-log\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.935288 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.935172 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e887bce6-4515-44c5-b099-6c317fb743ac-audit-log\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.935626 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.935604 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e887bce6-4515-44c5-b099-6c317fb743ac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.936165 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.936143 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e887bce6-4515-44c5-b099-6c317fb743ac-metrics-server-audit-profiles\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.937316 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.937298 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e887bce6-4515-44c5-b099-6c317fb743ac-secret-metrics-server-tls\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.937373 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.937297 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e887bce6-4515-44c5-b099-6c317fb743ac-client-ca-bundle\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.937518 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.937501 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e887bce6-4515-44c5-b099-6c317fb743ac-secret-metrics-server-client-certs\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:00.943800 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:00.943774 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgx8f\" (UniqueName: \"kubernetes.io/projected/e887bce6-4515-44c5-b099-6c317fb743ac-kube-api-access-cgx8f\") pod \"metrics-server-6bd9fdd8b9-wp5kv\" (UID: \"e887bce6-4515-44c5-b099-6c317fb743ac\") " pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:01.055068 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.054971 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:01.197574 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.197537 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv"] Jul 10 20:26:01.200867 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:26:01.200838 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode887bce6_4515_44c5_b099_6c317fb743ac.slice/crio-63643d697506cede7db60aa13ef01ba92a35b7744782003d5b7057410c3ba1f0 WatchSource:0}: Error finding container 63643d697506cede7db60aa13ef01ba92a35b7744782003d5b7057410c3ba1f0: Status 404 returned error can't find the container with id 63643d697506cede7db60aa13ef01ba92a35b7744782003d5b7057410c3ba1f0 Jul 10 20:26:01.217639 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.217610 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp"] Jul 10 20:26:01.220599 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.220574 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" Jul 10 20:26:01.223571 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.223544 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 10 20:26:01.223688 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.223626 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-nwpcs\"" Jul 10 20:26:01.230647 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.230621 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp"] Jul 10 20:26:01.238515 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.238469 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbp5k\" (UniqueName: \"kubernetes.io/projected/69cc0da3-1e81-49c8-b68c-dfe126c465e6-kube-api-access-nbp5k\") pod \"monitoring-plugin-5f68df7f58-xqztp\" (UID: \"69cc0da3-1e81-49c8-b68c-dfe126c465e6\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" Jul 10 20:26:01.238682 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.238601 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69cc0da3-1e81-49c8-b68c-dfe126c465e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xqztp\" (UID: \"69cc0da3-1e81-49c8-b68c-dfe126c465e6\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" Jul 10 20:26:01.253806 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.253769 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:01.319767 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.319681 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:01.339291 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.339255 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbp5k\" (UniqueName: \"kubernetes.io/projected/69cc0da3-1e81-49c8-b68c-dfe126c465e6-kube-api-access-nbp5k\") pod \"monitoring-plugin-5f68df7f58-xqztp\" (UID: \"69cc0da3-1e81-49c8-b68c-dfe126c465e6\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" Jul 10 20:26:01.339502 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.339319 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69cc0da3-1e81-49c8-b68c-dfe126c465e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xqztp\" (UID: \"69cc0da3-1e81-49c8-b68c-dfe126c465e6\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" Jul 10 20:26:01.339502 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:26:01.339433 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 10 20:26:01.339502 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:26:01.339501 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69cc0da3-1e81-49c8-b68c-dfe126c465e6-monitoring-plugin-cert podName:69cc0da3-1e81-49c8-b68c-dfe126c465e6 nodeName:}" failed. No retries permitted until 2026-07-10 20:26:01.839486722 +0000 UTC m=+279.457919704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/69cc0da3-1e81-49c8-b68c-dfe126c465e6-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-xqztp" (UID: "69cc0da3-1e81-49c8-b68c-dfe126c465e6") : secret "monitoring-plugin-cert" not found Jul 10 20:26:01.347989 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.347960 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbp5k\" (UniqueName: \"kubernetes.io/projected/69cc0da3-1e81-49c8-b68c-dfe126c465e6-kube-api-access-nbp5k\") pod \"monitoring-plugin-5f68df7f58-xqztp\" (UID: \"69cc0da3-1e81-49c8-b68c-dfe126c465e6\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" Jul 10 20:26:01.409617 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.409571 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:01.734021 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.733971 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66d9859d99-lp7wt"] Jul 10 20:26:01.736496 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.736477 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.739627 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.739602 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 10 20:26:01.739801 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.739780 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 10 20:26:01.739860 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.739845 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-m2752\"" Jul 10 20:26:01.739936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.739919 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 10 20:26:01.739991 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.739931 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 10 20:26:01.739991 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.739934 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 10 20:26:01.748871 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.747978 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 10 20:26:01.749885 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.749767 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66d9859d99-lp7wt"] Jul 10 20:26:01.803225 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.803183 2566 patch_prober.go:28] interesting pod/image-registry-5f79bf796d-s9zzk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 20:26:01.803410 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.803273 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" podUID="20684401-34fd-4f59-8eab-261246fbc840" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 20:26:01.843504 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.843460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366082b1-cdf0-48d2-ac4f-513cf4c3adff-serving-certs-ca-bundle\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.843691 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.843522 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/366082b1-cdf0-48d2-ac4f-513cf4c3adff-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.843691 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.843545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/366082b1-cdf0-48d2-ac4f-513cf4c3adff-federate-client-tls\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.843691 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.843564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w86mk\" (UniqueName: \"kubernetes.io/projected/366082b1-cdf0-48d2-ac4f-513cf4c3adff-kube-api-access-w86mk\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.843691 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.843636 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/366082b1-cdf0-48d2-ac4f-513cf4c3adff-secret-telemeter-client\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.843691 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.843675 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366082b1-cdf0-48d2-ac4f-513cf4c3adff-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.843949 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.843745 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/366082b1-cdf0-48d2-ac4f-513cf4c3adff-metrics-client-ca\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.843949 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.843828 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69cc0da3-1e81-49c8-b68c-dfe126c465e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xqztp\" (UID: \"69cc0da3-1e81-49c8-b68c-dfe126c465e6\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" Jul 10 20:26:01.843949 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.843858 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/366082b1-cdf0-48d2-ac4f-513cf4c3adff-telemeter-client-tls\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.846744 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.846711 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69cc0da3-1e81-49c8-b68c-dfe126c465e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xqztp\" (UID: \"69cc0da3-1e81-49c8-b68c-dfe126c465e6\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" Jul 10 20:26:01.932554 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.932515 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" event={"ID":"e887bce6-4515-44c5-b099-6c317fb743ac","Type":"ContainerStarted","Data":"63643d697506cede7db60aa13ef01ba92a35b7744782003d5b7057410c3ba1f0"} Jul 10 20:26:01.945097 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.945039 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366082b1-cdf0-48d2-ac4f-513cf4c3adff-serving-certs-ca-bundle\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.946600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.945114 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/366082b1-cdf0-48d2-ac4f-513cf4c3adff-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.946600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.945149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/366082b1-cdf0-48d2-ac4f-513cf4c3adff-federate-client-tls\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.946600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.945178 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86mk\" (UniqueName: \"kubernetes.io/projected/366082b1-cdf0-48d2-ac4f-513cf4c3adff-kube-api-access-w86mk\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.946600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.945241 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/366082b1-cdf0-48d2-ac4f-513cf4c3adff-secret-telemeter-client\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.946600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.945265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366082b1-cdf0-48d2-ac4f-513cf4c3adff-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.946600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.945301 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/366082b1-cdf0-48d2-ac4f-513cf4c3adff-metrics-client-ca\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.946600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.945341 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/366082b1-cdf0-48d2-ac4f-513cf4c3adff-telemeter-client-tls\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.946600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.946418 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/366082b1-cdf0-48d2-ac4f-513cf4c3adff-metrics-client-ca\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.947520 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.947218 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366082b1-cdf0-48d2-ac4f-513cf4c3adff-serving-certs-ca-bundle\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.947651 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.947568 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366082b1-cdf0-48d2-ac4f-513cf4c3adff-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.948452 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.948406 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/366082b1-cdf0-48d2-ac4f-513cf4c3adff-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.949468 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.948978 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/366082b1-cdf0-48d2-ac4f-513cf4c3adff-secret-telemeter-client\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.949468 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.949113 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/366082b1-cdf0-48d2-ac4f-513cf4c3adff-federate-client-tls\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.949468 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.949423 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/366082b1-cdf0-48d2-ac4f-513cf4c3adff-telemeter-client-tls\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:01.954357 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:01.954331 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w86mk\" (UniqueName: \"kubernetes.io/projected/366082b1-cdf0-48d2-ac4f-513cf4c3adff-kube-api-access-w86mk\") pod \"telemeter-client-66d9859d99-lp7wt\" (UID: \"366082b1-cdf0-48d2-ac4f-513cf4c3adff\") " pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:02.046283 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.046190 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" Jul 10 20:26:02.132414 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.132346 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" Jul 10 20:26:02.218996 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.218901 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66d9859d99-lp7wt"] Jul 10 20:26:02.316437 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.316351 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp"] Jul 10 20:26:02.667282 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.667181 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:02.672677 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.672532 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 20:26:02.676801 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.676763 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.679479 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.679451 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-61uusikqfvlpm\"" Jul 10 20:26:02.681776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.679662 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 20:26:02.681776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.679735 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 20:26:02.681776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.679794 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 20:26:02.681776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.679952 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 20:26:02.681776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.680009 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wmd8m\"" Jul 10 20:26:02.681776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.680102 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 20:26:02.681776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.680141 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 20:26:02.681776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.681175 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 20:26:02.681776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.681189 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 20:26:02.681776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.681356 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 20:26:02.681776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.681360 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 20:26:02.682693 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.682486 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 20:26:02.682693 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.682560 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 20:26:02.682693 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.682600 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 20:26:02.683315 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.683141 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 20:26:02.692035 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.691994 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 20:26:02.728511 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:26:02.728464 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69cc0da3_1e81_49c8_b68c_dfe126c465e6.slice/crio-bafc3a4ce4836d57c8b21d3ca7a998da0170c0f421b787cd26aba11b3e4c308b WatchSource:0}: Error finding container bafc3a4ce4836d57c8b21d3ca7a998da0170c0f421b787cd26aba11b3e4c308b: Status 404 returned error can't find the container with id bafc3a4ce4836d57c8b21d3ca7a998da0170c0f421b787cd26aba11b3e4c308b Jul 10 20:26:02.757209 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757209 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757437 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757288 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-config\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757437 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757437 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757431 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757603 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757514 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-web-config\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757603 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757546 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757603 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757575 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757737 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757613 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24153bef-ece6-40ed-9127-0d9ebd67738f-config-out\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757737 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757737 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757676 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757737 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757698 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757917 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757772 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757917 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24153bef-ece6-40ed-9127-0d9ebd67738f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.757917 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.758076 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.758076 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.757963 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.758076 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.758012 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.758076 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.758035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.758076 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.758073 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5gqb\" (UniqueName: \"kubernetes.io/projected/24153bef-ece6-40ed-9127-0d9ebd67738f-kube-api-access-q5gqb\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.859518 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859472 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.859687 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859528 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24153bef-ece6-40ed-9127-0d9ebd67738f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.859687 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.859687 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.859687 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859619 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.859687 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859659 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.859687 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859683 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859705 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gqb\" (UniqueName: \"kubernetes.io/projected/24153bef-ece6-40ed-9127-0d9ebd67738f-kube-api-access-q5gqb\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859760 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859797 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-config\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859818 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859850 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859912 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-web-config\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859937 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.859964 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.860000 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24153bef-ece6-40ed-9127-0d9ebd67738f-config-out\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860520 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.860022 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860520 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.860078 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860520 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.860107 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.860666 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.860554 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.862012 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.861289 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.862012 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.861666 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.862012 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.861778 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.862012 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.861988 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.862439 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.862378 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.862567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.862457 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.863571 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.863259 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-config\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.864325 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.864278 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24153bef-ece6-40ed-9127-0d9ebd67738f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.865469 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.865442 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.867229 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.867185 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.867407 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.867356 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.867794 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.867751 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.868243 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.868190 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.868809 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.868325 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.868809 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.868760 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.868809 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.868765 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.870413 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.870387 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24153bef-ece6-40ed-9127-0d9ebd67738f-config-out\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.871229 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.871211 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-web-config\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.871590 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.871570 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5gqb\" (UniqueName: \"kubernetes.io/projected/24153bef-ece6-40ed-9127-0d9ebd67738f-kube-api-access-q5gqb\") pod \"prometheus-k8s-0\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:02.937361 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.937328 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" event={"ID":"69cc0da3-1e81-49c8-b68c-dfe126c465e6","Type":"ContainerStarted","Data":"bafc3a4ce4836d57c8b21d3ca7a998da0170c0f421b787cd26aba11b3e4c308b"} Jul 10 20:26:02.938691 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.938650 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" event={"ID":"366082b1-cdf0-48d2-ac4f-513cf4c3adff","Type":"ContainerStarted","Data":"2040a4a70bfdcc205312fd877b3577f1f1bc4b41868d4cdeac1136435f05646b"} Jul 10 20:26:02.940455 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.940428 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" event={"ID":"e887bce6-4515-44c5-b099-6c317fb743ac","Type":"ContainerStarted","Data":"5e99915e5af7547f128cf94c79c912b71956725724922553fc1404a2d8f1a7d8"} Jul 10 20:26:02.961154 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.960173 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" podStartSLOduration=1.403017114 podStartE2EDuration="2.960144703s" totalImagesPullingTime="1.557127589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:26:02.957997429 +0000 UTC m=+280.576430435" watchObservedRunningTime="2026-07-10 20:26:02.960144703 +0000 UTC m=+280.578577701" Jul 10 20:26:02.991177 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:02.991094 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:03.176068 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:03.175943 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 20:26:03.180885 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:26:03.180850 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24153bef_ece6_40ed_9127_0d9ebd67738f.slice/crio-ff856095f9a25a8a8aebb8ed21ce3fd970e6b8df5572d3933175a24595d6c883 WatchSource:0}: Error finding container ff856095f9a25a8a8aebb8ed21ce3fd970e6b8df5572d3933175a24595d6c883: Status 404 returned error can't find the container with id ff856095f9a25a8a8aebb8ed21ce3fd970e6b8df5572d3933175a24595d6c883 Jul 10 20:26:03.946497 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:03.946444 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerStarted","Data":"ff856095f9a25a8a8aebb8ed21ce3fd970e6b8df5572d3933175a24595d6c883"} Jul 10 20:26:04.942419 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:04.942369 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:05.042685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:05.042658 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:05.551775 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:26:05.551671 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-j9npz" podUID="c0418812-8ccc-41ad-9183-9c39907f63ae" Jul 10 20:26:05.957679 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:05.957642 2566 generic.go:356] "Generic (PLEG): container finished" podID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerID="e85f0d1aac679052c2a1ac683b90fd47313dc82ad59c47e0f5845189c4545021" exitCode=0 Jul 10 20:26:05.958154 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:05.957726 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerDied","Data":"e85f0d1aac679052c2a1ac683b90fd47313dc82ad59c47e0f5845189c4545021"} Jul 10 20:26:05.959430 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:05.959366 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" event={"ID":"69cc0da3-1e81-49c8-b68c-dfe126c465e6","Type":"ContainerStarted","Data":"99f9f4df309e99bff25e064ba3ed45051542cda9e059c99a35bee2a8d8acb3e7"} Jul 10 20:26:05.959644 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:05.959553 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" Jul 10 20:26:05.961951 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:05.961933 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j9npz" Jul 10 20:26:05.962304 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:05.962278 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" event={"ID":"366082b1-cdf0-48d2-ac4f-513cf4c3adff","Type":"ContainerStarted","Data":"b362844de6546fa18fec543f32279095646671e58e9693e291a6fc6d3b6d7cb7"} Jul 10 20:26:05.962397 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:05.962331 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" event={"ID":"366082b1-cdf0-48d2-ac4f-513cf4c3adff","Type":"ContainerStarted","Data":"a1ce72135dc3ed1322a91ae15d32a22156077dd93e2ab4db0e86aa13d19597fa"} Jul 10 20:26:05.962397 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:05.962361 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" event={"ID":"366082b1-cdf0-48d2-ac4f-513cf4c3adff","Type":"ContainerStarted","Data":"f5459dd1bf56c15606a0e9b7e4c71dbfcb15231a2f03777be8abc86404701819"} Jul 10 20:26:05.969215 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:05.965960 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" Jul 10 20:26:06.013712 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:06.013661 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66d9859d99-lp7wt" podStartSLOduration=2.229688693 podStartE2EDuration="5.013644585s" totalImagesPullingTime="2.783955892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:26:06.012337167 +0000 UTC m=+283.630770194" watchObservedRunningTime="2026-07-10 20:26:06.013644585 +0000 UTC m=+283.632077589" Jul 10 20:26:06.028168 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:06.028106 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xqztp" podStartSLOduration=2.754583369 podStartE2EDuration="5.02808857s" totalImagesPullingTime="2.273505201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:26:06.027099831 +0000 UTC m=+283.645532860" watchObservedRunningTime="2026-07-10 20:26:06.02808857 +0000 UTC m=+283.646521573" Jul 10 20:26:06.292246 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:06.292164 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:06.343706 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:06.343658 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:06.920326 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:06.920283 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:07.122612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:07.122576 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:07.177154 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:07.177049 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:09.229697 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:09.229670 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:26:09.232519 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:09.232434 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0418812-8ccc-41ad-9183-9c39907f63ae-metrics-tls\") pod \"dns-default-j9npz\" (UID: \"c0418812-8ccc-41ad-9183-9c39907f63ae\") " pod="openshift-dns/dns-default-j9npz" Jul 10 20:26:09.264917 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:09.264895 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgw85\"" Jul 10 20:26:09.273219 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:09.273141 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j9npz" Jul 10 20:26:09.443946 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:09.443919 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j9npz"] Jul 10 20:26:09.445900 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:26:09.445876 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0418812_8ccc_41ad_9183_9c39907f63ae.slice/crio-ea9025408a69d0e59375575000b765836aa6a697ebaf498198051f60bccca031 WatchSource:0}: Error finding container ea9025408a69d0e59375575000b765836aa6a697ebaf498198051f60bccca031: Status 404 returned error can't find the container with id ea9025408a69d0e59375575000b765836aa6a697ebaf498198051f60bccca031 Jul 10 20:26:09.984580 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:09.984460 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j9npz" event={"ID":"c0418812-8ccc-41ad-9183-9c39907f63ae","Type":"ContainerStarted","Data":"ea9025408a69d0e59375575000b765836aa6a697ebaf498198051f60bccca031"} Jul 10 20:26:09.987841 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:09.987808 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerStarted","Data":"c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52"} Jul 10 20:26:09.988112 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:09.988093 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerStarted","Data":"4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0"} Jul 10 20:26:10.263628 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:10.263541 2566 patch_prober.go:28] interesting pod/image-registry-5f79bf796d-s9zzk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 20:26:10.263628 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:10.263605 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" podUID="20684401-34fd-4f59-8eab-261246fbc840" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 20:26:10.264247 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:10.263657 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:26:10.264303 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:10.264263 2566 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"179f0857210b21112934b1c23a92a1156875d0285ce306f1a76501b8973eba31"} pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" containerMessage="Container registry failed liveness probe, will be restarted" Jul 10 20:26:10.272258 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:10.272221 2566 patch_prober.go:28] interesting pod/image-registry-5f79bf796d-s9zzk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 20:26:10.272419 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:10.272289 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" podUID="20684401-34fd-4f59-8eab-261246fbc840" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 20:26:12.000218 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:12.000179 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j9npz" event={"ID":"c0418812-8ccc-41ad-9183-9c39907f63ae","Type":"ContainerStarted","Data":"1e65f001cc54dff334e3f6bf30aca4437cf0e4c240fd2d047bb826f8bf731338"} Jul 10 20:26:12.000697 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:12.000246 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j9npz" event={"ID":"c0418812-8ccc-41ad-9183-9c39907f63ae","Type":"ContainerStarted","Data":"a852c44ee83b3f316f7e1d2515ce9bcd78ce06fc5bda1ce31ac8a14cde26ace2"} Jul 10 20:26:12.000697 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:12.000273 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j9npz" Jul 10 20:26:12.003437 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:12.003355 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerStarted","Data":"c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc"} Jul 10 20:26:12.003437 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:12.003415 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerStarted","Data":"b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077"} Jul 10 20:26:12.003604 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:12.003452 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerStarted","Data":"ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73"} Jul 10 20:26:12.003604 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:12.003476 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerStarted","Data":"a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc"} Jul 10 20:26:12.017778 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:12.017730 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j9npz" podStartSLOduration=250.940532752 podStartE2EDuration="4m13.017716433s" totalImagesPullingTime="2.077183681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:26:12.016566113 +0000 UTC m=+289.634999129" watchObservedRunningTime="2026-07-10 20:26:12.017716433 +0000 UTC m=+289.636149435" Jul 10 20:26:12.044220 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:12.044100 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7553762429999997 podStartE2EDuration="10.04407268s" totalImagesPullingTime="7.26582659s" totalInitContainerRuntime="22.869847ms" isStatefulPod=false podCreationTimestamp="2026-07-10 20:26:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:26:12.041487 +0000 UTC m=+289.659920003" watchObservedRunningTime="2026-07-10 20:26:12.04407268 +0000 UTC m=+289.662505678" Jul 10 20:26:12.991279 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:12.991232 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:26:14.468761 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:14.468723 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:14.569388 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:14.569350 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:20.268443 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:20.268409 2566 patch_prober.go:28] interesting pod/image-registry-5f79bf796d-s9zzk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 20:26:20.268788 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:20.268461 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" podUID="20684401-34fd-4f59-8eab-261246fbc840" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 20:26:21.055618 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:21.055580 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:21.055766 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:21.055641 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:21.760083 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:21.760040 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:22.010834 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:22.010735 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j9npz" Jul 10 20:26:22.824634 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:22.824292 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:26:22.824634 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:22.824554 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:26:22.829508 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:22.829483 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:26:22.829854 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:22.829833 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:26:22.837494 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:22.837470 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 20:26:22.910462 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:22.910425 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:22.994538 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:22.994406 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:23.097379 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:23.097293 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:24.771235 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:24.771204 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:24.823122 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:24.823045 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:24.900405 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:24.900352 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:24.964778 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:24.964745 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:26.621713 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:26.621676 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:26.675772 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:26.675730 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:30.268588 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:30.268561 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:26:30.391267 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:30.391239 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:30.571214 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:30.571126 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:30.670732 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:30.670693 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:31.833539 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:31.833497 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:31.936257 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:31.936210 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:33.971267 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:33.971207 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:34.026336 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:34.026297 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:35.292706 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:35.292664 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" podUID="20684401-34fd-4f59-8eab-261246fbc840" containerName="registry" containerID="cri-o://179f0857210b21112934b1c23a92a1156875d0285ce306f1a76501b8973eba31" gracePeriod=30 Jul 10 20:26:36.101960 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:36.101921 2566 generic.go:356] "Generic (PLEG): container finished" podID="20684401-34fd-4f59-8eab-261246fbc840" containerID="179f0857210b21112934b1c23a92a1156875d0285ce306f1a76501b8973eba31" exitCode=0 Jul 10 20:26:36.102160 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:36.102021 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" event={"ID":"20684401-34fd-4f59-8eab-261246fbc840","Type":"ContainerDied","Data":"179f0857210b21112934b1c23a92a1156875d0285ce306f1a76501b8973eba31"} Jul 10 20:26:36.102160 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:36.102093 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" event={"ID":"20684401-34fd-4f59-8eab-261246fbc840","Type":"ContainerStarted","Data":"8bb7cb0bfb475f120467a326ca14731d9088b5787d4a89c3c65208dd65b1cd08"} Jul 10 20:26:36.102275 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:36.102216 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:26:36.267224 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:36.267187 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:36.319663 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:36.319621 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:37.111602 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:37.111567 2566 generic.go:356] "Generic (PLEG): container finished" podID="ec3ded59-60c6-4116-9c40-a4adaa038b90" containerID="341cae2a1c2d272d8e6a273cc30869397c64a59dcc818d2271712ee11f988131" exitCode=0 Jul 10 20:26:37.111759 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:37.111639 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" event={"ID":"ec3ded59-60c6-4116-9c40-a4adaa038b90","Type":"ContainerDied","Data":"341cae2a1c2d272d8e6a273cc30869397c64a59dcc818d2271712ee11f988131"} Jul 10 20:26:37.112069 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:37.112027 2566 scope.go:117] "RemoveContainer" containerID="341cae2a1c2d272d8e6a273cc30869397c64a59dcc818d2271712ee11f988131" Jul 10 20:26:37.822437 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:37.822405 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5f79bf796d-s9zzk_20684401-34fd-4f59-8eab-261246fbc840/registry/0.log" Jul 10 20:26:37.829071 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:37.829012 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5f79bf796d-s9zzk_20684401-34fd-4f59-8eab-261246fbc840/registry/1.log" Jul 10 20:26:38.117655 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:38.117570 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-9r9sr" event={"ID":"ec3ded59-60c6-4116-9c40-a4adaa038b90","Type":"ContainerStarted","Data":"6155a972596e0cbb290f1db9f8e4adab898199460f57ac31e50f3da250782a5a"} Jul 10 20:26:38.176073 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:38.176034 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bb2fz_e88eed6b-d362-4848-a548-699f174407ee/node-ca/0.log" Jul 10 20:26:38.776005 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:38.775972 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cf6c66c44-5lkdq_76ef5f08-9086-4f3d-a0b7-5115bd070ea8/router/0.log" Jul 10 20:26:38.979291 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:38.979245 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6t2bs_19c473d4-be6e-444b-8de4-19962da37958/serve-healthcheck-canary/0.log" Jul 10 20:26:41.060974 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:41.060940 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:41.064698 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:41.064675 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6bd9fdd8b9-wp5kv" Jul 10 20:26:46.600168 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:46.600134 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:46.701512 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:46.701474 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:46.758967 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:46.758931 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:54.814346 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:54.814312 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:54.866603 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:54.866565 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:57.116141 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:57.116110 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f79bf796d-s9zzk" Jul 10 20:26:57.407497 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:57.407407 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:26:57.461202 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:26:57.461152 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:02.991731 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:02.991685 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:03.008506 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:03.008477 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:03.256032 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:03.255951 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:09.772432 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:09.772369 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:09.826738 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:09.826698 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:12.529379 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:12.529340 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:12.589261 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:12.589170 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:21.014426 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.014387 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 20:27:21.015440 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.015403 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="prometheus" containerID="cri-o://4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0" gracePeriod=600 Jul 10 20:27:21.015871 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.015827 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="config-reloader" containerID="cri-o://c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52" gracePeriod=600 Jul 10 20:27:21.016074 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.015622 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="kube-rbac-proxy-web" containerID="cri-o://ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73" gracePeriod=600 Jul 10 20:27:21.016074 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.015664 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="kube-rbac-proxy" containerID="cri-o://b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077" gracePeriod=600 Jul 10 20:27:21.016074 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.015852 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="thanos-sidecar" containerID="cri-o://a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc" gracePeriod=600 Jul 10 20:27:21.016074 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.015923 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc" gracePeriod=600 Jul 10 20:27:21.314493 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.314386 2566 generic.go:356] "Generic (PLEG): container finished" podID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerID="ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73" exitCode=0 Jul 10 20:27:21.314493 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.314423 2566 generic.go:356] "Generic (PLEG): container finished" podID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerID="a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc" exitCode=0 Jul 10 20:27:21.314493 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.314431 2566 generic.go:356] "Generic (PLEG): container finished" podID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerID="c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52" exitCode=0 Jul 10 20:27:21.314768 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.314503 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerDied","Data":"ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73"} Jul 10 20:27:21.314768 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.314573 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerDied","Data":"a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc"} Jul 10 20:27:21.314768 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:21.314612 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerDied","Data":"c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52"} Jul 10 20:27:22.323505 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:22.323472 2566 generic.go:356] "Generic (PLEG): container finished" podID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerID="c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc" exitCode=0 Jul 10 20:27:22.323505 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:22.323498 2566 generic.go:356] "Generic (PLEG): container finished" podID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerID="b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077" exitCode=0 Jul 10 20:27:22.323902 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:22.323540 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerDied","Data":"c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc"} Jul 10 20:27:22.323902 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:22.323604 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerDied","Data":"b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077"} Jul 10 20:27:23.241181 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:23.241128 2566 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 10 20:27:23.242173 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:23.242137 2566 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 10 20:27:23.243101 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:23.243038 2566 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 10 20:27:23.243189 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:23.243122 2566 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="prometheus" probeResult="unknown" Jul 10 20:27:24.776546 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:24.776506 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:24.833299 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:24.833257 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:27.309206 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:27.309172 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:27.410020 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:27.409966 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:27.849191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:27.849160 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:27.899419 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:27.899386 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:27.962716 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:27.962677 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:28.240104 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:28.240043 2566 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0 is running failed: container process not found" containerID="4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 10 20:27:28.240398 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:28.240341 2566 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0 is running failed: container process not found" containerID="4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 10 20:27:28.240734 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:28.240700 2566 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0 is running failed: container process not found" containerID="4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 10 20:27:28.240835 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:28.240746 2566 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0 is running failed: container process not found" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="prometheus" probeResult="unknown" Jul 10 20:27:28.278134 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.278107 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.341112 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341075 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-kube-rbac-proxy\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.341567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341134 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-2\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.341567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341172 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24153bef-ece6-40ed-9127-0d9ebd67738f-tls-assets\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.341567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341209 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-kubelet-serving-ca-bundle\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.341567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341235 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-0\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.341567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341492 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-thanos-prometheus-http-client-file\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.341567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341545 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-db\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.341852 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341605 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-trusted-ca-bundle\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.341852 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341641 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-web-config\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.341852 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341667 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.341852 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341710 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24153bef-ece6-40ed-9127-0d9ebd67738f-config-out\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.341852 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341768 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-metrics-client-certs\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.341852 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341818 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-metrics-client-ca\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.342124 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341862 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-config\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.342124 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341887 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-1\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.342124 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341912 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-grpc-tls\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.342124 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341940 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.342124 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341971 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-tls\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.342124 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.341997 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-serving-certs-ca-bundle\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.342124 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.342025 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5gqb\" (UniqueName: \"kubernetes.io/projected/24153bef-ece6-40ed-9127-0d9ebd67738f-kube-api-access-q5gqb\") pod \"24153bef-ece6-40ed-9127-0d9ebd67738f\" (UID: \"24153bef-ece6-40ed-9127-0d9ebd67738f\") " Jul 10 20:27:28.343403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.342544 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:27:28.343403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.342572 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:27:28.343403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.343112 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:27:28.343403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.343168 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:27:28.343955 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.343923 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:27:28.344048 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.343954 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:27:28.344048 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.344012 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:27:28.344858 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.344827 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:27:28.346769 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.346744 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:28.349153 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.348909 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24153bef-ece6-40ed-9127-0d9ebd67738f-config-out" (OuterVolumeSpecName: "config-out") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:27:28.349153 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.348917 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:28.349153 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.348950 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-config" (OuterVolumeSpecName: "config") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:28.349153 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.349007 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24153bef-ece6-40ed-9127-0d9ebd67738f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:27:28.349153 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.349090 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24153bef-ece6-40ed-9127-0d9ebd67738f-kube-api-access-q5gqb" (OuterVolumeSpecName: "kube-api-access-q5gqb") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "kube-api-access-q5gqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:27:28.349153 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.349112 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:28.349526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.349464 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:28.350151 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.350040 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:28.353272 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.351195 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:28.353272 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.351220 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:28.361668 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.361636 2566 generic.go:356] "Generic (PLEG): container finished" podID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerID="4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0" exitCode=0 Jul 10 20:27:28.361800 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.361768 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerDied","Data":"4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0"} Jul 10 20:27:28.361800 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.361744 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.361914 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.361897 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24153bef-ece6-40ed-9127-0d9ebd67738f","Type":"ContainerDied","Data":"ff856095f9a25a8a8aebb8ed21ce3fd970e6b8df5572d3933175a24595d6c883"} Jul 10 20:27:28.361969 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.361953 2566 scope.go:117] "RemoveContainer" containerID="c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc" Jul 10 20:27:28.369238 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.369209 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-web-config" (OuterVolumeSpecName: "web-config") pod "24153bef-ece6-40ed-9127-0d9ebd67738f" (UID: "24153bef-ece6-40ed-9127-0d9ebd67738f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:28.373920 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.373895 2566 scope.go:117] "RemoveContainer" containerID="b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077" Jul 10 20:27:28.381747 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.381730 2566 scope.go:117] "RemoveContainer" containerID="ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73" Jul 10 20:27:28.389043 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.389021 2566 scope.go:117] "RemoveContainer" containerID="a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc" Jul 10 20:27:28.396217 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.396198 2566 scope.go:117] "RemoveContainer" containerID="c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52" Jul 10 20:27:28.403296 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.403273 2566 scope.go:117] "RemoveContainer" containerID="4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0" Jul 10 20:27:28.411173 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.411153 2566 scope.go:117] "RemoveContainer" containerID="e85f0d1aac679052c2a1ac683b90fd47313dc82ad59c47e0f5845189c4545021" Jul 10 20:27:28.418287 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.418268 2566 scope.go:117] "RemoveContainer" containerID="c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc" Jul 10 20:27:28.418569 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:28.418549 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc\": container with ID starting with c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc not found: ID does not exist" containerID="c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc" Jul 10 20:27:28.418620 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.418586 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc"} err="failed to get container status \"c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc\": rpc error: code = NotFound desc = could not find container \"c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc\": container with ID starting with c0586d13bea2e466a5081cef5c860f755de4de6d331bc8101173c599c548dbbc not found: ID does not exist" Jul 10 20:27:28.418620 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.418608 2566 scope.go:117] "RemoveContainer" containerID="b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077" Jul 10 20:27:28.418852 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:28.418834 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077\": container with ID starting with b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077 not found: ID does not exist" containerID="b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077" Jul 10 20:27:28.418895 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.418857 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077"} err="failed to get container status \"b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077\": rpc error: code = NotFound desc = could not find container \"b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077\": container with ID starting with b7dae2451ab75a640fa7a151b169df51ddf8f83806295c7dd4fe98277b93e077 not found: ID does not exist" Jul 10 20:27:28.418895 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.418874 2566 scope.go:117] "RemoveContainer" containerID="ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73" Jul 10 20:27:28.419097 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:28.419076 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73\": container with ID starting with ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73 not found: ID does not exist" containerID="ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73" Jul 10 20:27:28.419144 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.419103 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73"} err="failed to get container status \"ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73\": rpc error: code = NotFound desc = could not find container \"ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73\": container with ID starting with ae0e363a09387d21e94a1dd99c4c40b0e274da4741d778e8541711af79387d73 not found: ID does not exist" Jul 10 20:27:28.419144 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.419117 2566 scope.go:117] "RemoveContainer" containerID="a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc" Jul 10 20:27:28.419340 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:28.419322 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc\": container with ID starting with a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc not found: ID does not exist" containerID="a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc" Jul 10 20:27:28.419406 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.419348 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc"} err="failed to get container status \"a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc\": rpc error: code = NotFound desc = could not find container \"a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc\": container with ID starting with a48f29502c768e690138551c52319600dc98fddcbc424368fe1d263fb32934dc not found: ID does not exist" Jul 10 20:27:28.419406 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.419369 2566 scope.go:117] "RemoveContainer" containerID="c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52" Jul 10 20:27:28.419600 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:28.419585 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52\": container with ID starting with c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52 not found: ID does not exist" containerID="c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52" Jul 10 20:27:28.419638 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.419605 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52"} err="failed to get container status \"c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52\": rpc error: code = NotFound desc = could not find container \"c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52\": container with ID starting with c664ace39c7ca7bcc412e13c5762e5a543987b2056d453b54c3cfd0039d72e52 not found: ID does not exist" Jul 10 20:27:28.419638 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.419618 2566 scope.go:117] "RemoveContainer" containerID="4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0" Jul 10 20:27:28.419838 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:28.419823 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0\": container with ID starting with 4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0 not found: ID does not exist" containerID="4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0" Jul 10 20:27:28.419881 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.419842 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0"} err="failed to get container status \"4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0\": rpc error: code = NotFound desc = could not find container \"4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0\": container with ID starting with 4b3f876e6ea8c0bcec6828315dbc7167b993254d014cc35593d6f556a9ed1bf0 not found: ID does not exist" Jul 10 20:27:28.419881 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.419857 2566 scope.go:117] "RemoveContainer" containerID="e85f0d1aac679052c2a1ac683b90fd47313dc82ad59c47e0f5845189c4545021" Jul 10 20:27:28.420086 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:27:28.420067 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e85f0d1aac679052c2a1ac683b90fd47313dc82ad59c47e0f5845189c4545021\": container with ID starting with e85f0d1aac679052c2a1ac683b90fd47313dc82ad59c47e0f5845189c4545021 not found: ID does not exist" containerID="e85f0d1aac679052c2a1ac683b90fd47313dc82ad59c47e0f5845189c4545021" Jul 10 20:27:28.420135 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.420093 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e85f0d1aac679052c2a1ac683b90fd47313dc82ad59c47e0f5845189c4545021"} err="failed to get container status \"e85f0d1aac679052c2a1ac683b90fd47313dc82ad59c47e0f5845189c4545021\": rpc error: code = NotFound desc = could not find container \"e85f0d1aac679052c2a1ac683b90fd47313dc82ad59c47e0f5845189c4545021\": container with ID starting with e85f0d1aac679052c2a1ac683b90fd47313dc82ad59c47e0f5845189c4545021 not found: ID does not exist" Jul 10 20:27:28.443163 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443123 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-metrics-client-ca\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443163 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443158 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-config\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443171 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443185 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-grpc-tls\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443200 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443212 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443224 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443237 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5gqb\" (UniqueName: \"kubernetes.io/projected/24153bef-ece6-40ed-9127-0d9ebd67738f-kube-api-access-q5gqb\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443248 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-kube-rbac-proxy\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443259 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443272 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24153bef-ece6-40ed-9127-0d9ebd67738f-tls-assets\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443284 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443297 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443310 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443322 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-k8s-db\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443336 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24153bef-ece6-40ed-9127-0d9ebd67738f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443766 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443379 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-web-config\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443766 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443393 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443766 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443407 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24153bef-ece6-40ed-9127-0d9ebd67738f-config-out\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.443766 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.443419 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24153bef-ece6-40ed-9127-0d9ebd67738f-secret-metrics-client-certs\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:27:28.573278 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.573248 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:28.625284 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.625209 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:28.686791 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.686749 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 20:27:28.691100 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.691072 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 20:27:28.714685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.714651 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 20:27:28.714943 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.714930 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="thanos-sidecar" Jul 10 20:27:28.714995 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.714945 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="thanos-sidecar" Jul 10 20:27:28.714995 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.714955 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="prometheus" Jul 10 20:27:28.714995 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.714960 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="prometheus" Jul 10 20:27:28.714995 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.714966 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="config-reloader" Jul 10 20:27:28.714995 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.714972 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="config-reloader" Jul 10 20:27:28.714995 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.714979 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="kube-rbac-proxy" Jul 10 20:27:28.714995 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.714984 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="kube-rbac-proxy" Jul 10 20:27:28.714995 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.714992 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="init-config-reloader" Jul 10 20:27:28.714995 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.714997 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="init-config-reloader" Jul 10 20:27:28.715309 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.715005 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="kube-rbac-proxy-thanos" Jul 10 20:27:28.715309 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.715011 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="kube-rbac-proxy-thanos" Jul 10 20:27:28.715309 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.715023 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="kube-rbac-proxy-web" Jul 10 20:27:28.715309 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.715028 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="kube-rbac-proxy-web" Jul 10 20:27:28.715309 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.715086 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="config-reloader" Jul 10 20:27:28.715309 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.715093 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="thanos-sidecar" Jul 10 20:27:28.715309 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.715100 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="prometheus" Jul 10 20:27:28.715309 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.715107 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="kube-rbac-proxy-thanos" Jul 10 20:27:28.715309 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.715114 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="kube-rbac-proxy-web" Jul 10 20:27:28.715309 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.715118 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" containerName="kube-rbac-proxy" Jul 10 20:27:28.720554 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.720528 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.723406 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.723380 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 20:27:28.723525 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.723386 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 20:27:28.723866 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.723846 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 20:27:28.723958 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.723871 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 20:27:28.723958 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.723892 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 20:27:28.723958 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.723930 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 20:27:28.723958 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.723896 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 20:27:28.724262 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.723997 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 20:27:28.724262 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.724215 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 20:27:28.724425 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.724286 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 20:27:28.724425 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.724287 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wmd8m\"" Jul 10 20:27:28.724425 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.724400 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 20:27:28.724425 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.724418 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 20:27:28.724655 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.724503 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-61uusikqfvlpm\"" Jul 10 20:27:28.728541 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.728518 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 20:27:28.729930 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.729913 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 20:27:28.733544 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.733517 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 20:27:28.847044 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847011 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847244 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847244 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847112 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847244 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847138 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xrh4\" (UniqueName: \"kubernetes.io/projected/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-kube-api-access-5xrh4\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847244 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847183 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847244 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847244 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847449 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847287 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847449 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847449 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847366 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847449 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847419 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847449 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847435 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847461 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847485 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847513 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847552 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847571 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847824 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847613 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-config\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847824 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847646 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.847824 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.847661 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948407 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948369 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-config\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948407 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948410 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948439 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948465 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948489 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948513 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948537 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xrh4\" (UniqueName: \"kubernetes.io/projected/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-kube-api-access-5xrh4\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948578 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948623 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948653 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948674 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.948709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948695 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.949278 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948744 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.949278 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.949278 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948812 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.949278 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948839 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.949278 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948863 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.949278 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948891 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.949278 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.948917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.949278 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.949146 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.949662 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.949437 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.949822 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.949796 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.951525 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.951494 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.951857 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.951827 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.951940 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.951889 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.951940 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.951924 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-config\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.952029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.951948 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.952297 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.952267 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.952620 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.952594 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.952698 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.952666 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.953296 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.953268 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.953384 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.953293 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.953633 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.953613 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.954165 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.954139 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.954246 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.954202 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.954567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.954540 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.954666 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.954648 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.954852 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.954835 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.957917 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.957893 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xrh4\" (UniqueName: \"kubernetes.io/projected/6e47f868-95c9-4fa6-ab3b-a111da46aa4b-kube-api-access-5xrh4\") pod \"prometheus-k8s-0\" (UID: \"6e47f868-95c9-4fa6-ab3b-a111da46aa4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:28.966517 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:28.966490 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24153bef-ece6-40ed-9127-0d9ebd67738f" path="/var/lib/kubelet/pods/24153bef-ece6-40ed-9127-0d9ebd67738f/volumes" Jul 10 20:27:29.033775 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:29.033733 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:29.181544 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:29.181518 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 20:27:29.184065 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:27:29.184024 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e47f868_95c9_4fa6_ab3b_a111da46aa4b.slice/crio-fb2639955c86e8b67d39969c4bd6b26338dee246085bfc19ff198d0cb8b30936 WatchSource:0}: Error finding container fb2639955c86e8b67d39969c4bd6b26338dee246085bfc19ff198d0cb8b30936: Status 404 returned error can't find the container with id fb2639955c86e8b67d39969c4bd6b26338dee246085bfc19ff198d0cb8b30936 Jul 10 20:27:29.368016 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:29.367982 2566 generic.go:356] "Generic (PLEG): container finished" podID="6e47f868-95c9-4fa6-ab3b-a111da46aa4b" containerID="26de71dcaec4f3c1dd3b96cad3e80d36010247e6e6c6dabb9885518e3abe0d9a" exitCode=0 Jul 10 20:27:29.368444 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:29.368042 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e47f868-95c9-4fa6-ab3b-a111da46aa4b","Type":"ContainerDied","Data":"26de71dcaec4f3c1dd3b96cad3e80d36010247e6e6c6dabb9885518e3abe0d9a"} Jul 10 20:27:29.368444 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:29.368130 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e47f868-95c9-4fa6-ab3b-a111da46aa4b","Type":"ContainerStarted","Data":"fb2639955c86e8b67d39969c4bd6b26338dee246085bfc19ff198d0cb8b30936"} Jul 10 20:27:30.375703 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:30.375666 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e47f868-95c9-4fa6-ab3b-a111da46aa4b","Type":"ContainerStarted","Data":"aaa720e2d55493585f4511670cb1fa2946f91aa26e439956a431926311cfb479"} Jul 10 20:27:30.376179 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:30.375732 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e47f868-95c9-4fa6-ab3b-a111da46aa4b","Type":"ContainerStarted","Data":"86de78cb8a31c13ccb7293bea564a7a4223fa2e3a75363fcb84fabce5c390626"} Jul 10 20:27:30.376179 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:30.375760 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e47f868-95c9-4fa6-ab3b-a111da46aa4b","Type":"ContainerStarted","Data":"0bcbf277d202204f718aba3542a0e4ac8f893cd5cbe3973c3b1b3df7f27de22c"} Jul 10 20:27:30.376179 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:30.375783 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e47f868-95c9-4fa6-ab3b-a111da46aa4b","Type":"ContainerStarted","Data":"f44128d89c8d2be2c1457e25cc734c854080d973d7107f607892132d437542cf"} Jul 10 20:27:30.376179 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:30.375810 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e47f868-95c9-4fa6-ab3b-a111da46aa4b","Type":"ContainerStarted","Data":"e1b55bf1d7fb48745569a7efa038f85ef4571d63403f5d11324032f92cbe0dd2"} Jul 10 20:27:30.376179 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:30.375833 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e47f868-95c9-4fa6-ab3b-a111da46aa4b","Type":"ContainerStarted","Data":"47ecb4e8a2f593dac9d0b3fc880a1fd0d4f647d7a604ab4a8672f0ca1182a519"} Jul 10 20:27:30.404515 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:30.404306 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.381710136 podStartE2EDuration="2.404282612s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.572476ms" isStatefulPod=false podCreationTimestamp="2026-07-10 20:27:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:27:30.40160129 +0000 UTC m=+368.020034308" watchObservedRunningTime="2026-07-10 20:27:30.404282612 +0000 UTC m=+368.022715616" Jul 10 20:27:34.034591 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:34.034558 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:27:39.187594 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:39.187555 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:39.237602 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:39.237573 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:39.292561 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:39.292524 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:39.777171 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:39.777127 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:39.875412 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:39.875375 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:27:42.638624 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:27:42.638590 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:07.944363 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:07.944330 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:08.007299 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:08.007258 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:15.817374 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:15.817319 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:15.916651 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:15.916613 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:29.034247 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:29.034207 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:28:29.050685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:29.050656 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:28:29.629950 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:29.629921 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:28:42.615981 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:42.615902 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:43.625337 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:43.625273 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:46.228986 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:46.228953 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:46.544456 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:46.544374 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:47.726564 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:47.726528 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:47.860331 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:47.860301 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:48.389435 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:48.389398 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:48.623984 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:48.623956 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:50.378645 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:50.378607 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:50.764623 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:50.764591 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:53.049232 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:53.049195 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:53.321488 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:53.321407 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:28:58.979243 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:28:58.979211 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:03.833331 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:03.833294 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:03.938942 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:03.938907 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:10.993586 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:10.993554 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:11.093333 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:11.093296 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:11.207519 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:11.207489 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:11.307373 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:11.307291 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:12.846850 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:12.846821 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:22.398374 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:22.398345 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:22.500230 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:22.500197 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:27.164385 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.164352 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:27.228802 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.228764 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw"] Jul 10 20:29:27.231991 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.231970 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.235946 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.235920 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 20:29:27.235946 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.235940 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 20:29:27.236162 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.235921 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 20:29:27.236162 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.235975 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:29:27.236162 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.235994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r4c2w\"" Jul 10 20:29:27.236162 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.236019 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 20:29:27.242626 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.242603 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:27.243171 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.243152 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw"] Jul 10 20:29:27.288972 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.288939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9415b17e-0700-4d1c-a574-8164a96c8ab9-manager-config\") pod \"lws-controller-manager-5dcfcfbc-xrdnw\" (UID: \"9415b17e-0700-4d1c-a574-8164a96c8ab9\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.289191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.288985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9415b17e-0700-4d1c-a574-8164a96c8ab9-cert\") pod \"lws-controller-manager-5dcfcfbc-xrdnw\" (UID: \"9415b17e-0700-4d1c-a574-8164a96c8ab9\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.289191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.289023 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9415b17e-0700-4d1c-a574-8164a96c8ab9-metrics-cert\") pod \"lws-controller-manager-5dcfcfbc-xrdnw\" (UID: \"9415b17e-0700-4d1c-a574-8164a96c8ab9\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.289191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.289103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6k2w\" (UniqueName: \"kubernetes.io/projected/9415b17e-0700-4d1c-a574-8164a96c8ab9-kube-api-access-b6k2w\") pod \"lws-controller-manager-5dcfcfbc-xrdnw\" (UID: \"9415b17e-0700-4d1c-a574-8164a96c8ab9\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.389852 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.389818 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9415b17e-0700-4d1c-a574-8164a96c8ab9-cert\") pod \"lws-controller-manager-5dcfcfbc-xrdnw\" (UID: \"9415b17e-0700-4d1c-a574-8164a96c8ab9\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.390046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.389869 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9415b17e-0700-4d1c-a574-8164a96c8ab9-metrics-cert\") pod \"lws-controller-manager-5dcfcfbc-xrdnw\" (UID: \"9415b17e-0700-4d1c-a574-8164a96c8ab9\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.390046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.389932 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6k2w\" (UniqueName: \"kubernetes.io/projected/9415b17e-0700-4d1c-a574-8164a96c8ab9-kube-api-access-b6k2w\") pod \"lws-controller-manager-5dcfcfbc-xrdnw\" (UID: \"9415b17e-0700-4d1c-a574-8164a96c8ab9\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.390046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.390034 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9415b17e-0700-4d1c-a574-8164a96c8ab9-manager-config\") pod \"lws-controller-manager-5dcfcfbc-xrdnw\" (UID: \"9415b17e-0700-4d1c-a574-8164a96c8ab9\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.390631 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.390602 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9415b17e-0700-4d1c-a574-8164a96c8ab9-manager-config\") pod \"lws-controller-manager-5dcfcfbc-xrdnw\" (UID: \"9415b17e-0700-4d1c-a574-8164a96c8ab9\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.392677 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.392647 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9415b17e-0700-4d1c-a574-8164a96c8ab9-metrics-cert\") pod \"lws-controller-manager-5dcfcfbc-xrdnw\" (UID: \"9415b17e-0700-4d1c-a574-8164a96c8ab9\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.392776 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.392678 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9415b17e-0700-4d1c-a574-8164a96c8ab9-cert\") pod \"lws-controller-manager-5dcfcfbc-xrdnw\" (UID: \"9415b17e-0700-4d1c-a574-8164a96c8ab9\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.399490 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.399470 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6k2w\" (UniqueName: \"kubernetes.io/projected/9415b17e-0700-4d1c-a574-8164a96c8ab9-kube-api-access-b6k2w\") pod \"lws-controller-manager-5dcfcfbc-xrdnw\" (UID: \"9415b17e-0700-4d1c-a574-8164a96c8ab9\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.541552 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.541509 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:27.684429 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.684398 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw"] Jul 10 20:29:27.686854 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:29:27.686811 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9415b17e_0700_4d1c_a574_8164a96c8ab9.slice/crio-702fb6b578ff36e882418d4074c65015e289b79bd8dd3ab05f8290b619de84d5 WatchSource:0}: Error finding container 702fb6b578ff36e882418d4074c65015e289b79bd8dd3ab05f8290b619de84d5: Status 404 returned error can't find the container with id 702fb6b578ff36e882418d4074c65015e289b79bd8dd3ab05f8290b619de84d5 Jul 10 20:29:27.688880 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.688861 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 20:29:27.843906 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:27.843834 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" event={"ID":"9415b17e-0700-4d1c-a574-8164a96c8ab9","Type":"ContainerStarted","Data":"702fb6b578ff36e882418d4074c65015e289b79bd8dd3ab05f8290b619de84d5"} Jul 10 20:29:28.047887 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:28.047847 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:28.148935 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:28.148827 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:28.641682 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:28.641647 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:28.834536 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:28.834506 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:28.930321 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:28.930292 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:28.970421 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:28.970381 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9"] Jul 10 20:29:28.975820 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:28.975795 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:28.979135 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:28.979111 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 20:29:28.979277 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:28.979112 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 20:29:28.979277 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:28.979158 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 20:29:28.979479 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:28.979464 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 20:29:28.979536 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:28.979513 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zlv5v\"" Jul 10 20:29:29.000445 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.000408 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9"] Jul 10 20:29:29.107222 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.107111 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-tmp\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.107222 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.107164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-manifests\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.107461 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.107237 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.107461 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.107281 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.107461 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.107424 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm7t2\" (UniqueName: \"kubernetes.io/projected/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-kube-api-access-xm7t2\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.188181 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.188042 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:29.208270 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.208231 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-tmp\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.208447 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.208283 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-manifests\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.208447 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.208313 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.208447 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.208337 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.208447 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.208406 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm7t2\" (UniqueName: \"kubernetes.io/projected/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-kube-api-access-xm7t2\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.208736 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.208707 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-manifests\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.210915 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.210886 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-tmp\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.211321 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.211290 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.211485 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.211455 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.223403 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.223374 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm7t2\" (UniqueName: \"kubernetes.io/projected/92ab6c86-ae4e-4b7c-88d5-8d4111628b52-kube-api-access-xm7t2\") pod \"opendatahub-operator-controller-manager-7b6f977c45-bkdr9\" (UID: \"92ab6c86-ae4e-4b7c-88d5-8d4111628b52\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.288653 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.288620 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:29.289681 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.289648 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:29.388215 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.388178 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:29.488349 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.488259 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:29.577647 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.577613 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:29.639232 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:29.639186 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:30.102088 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:30.102044 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9"] Jul 10 20:29:30.103292 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:29:30.103268 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ab6c86_ae4e_4b7c_88d5_8d4111628b52.slice/crio-1b567654632b2c21b3950e6f417a664c0400d065319a0bac58d132891b15c803 WatchSource:0}: Error finding container 1b567654632b2c21b3950e6f417a664c0400d065319a0bac58d132891b15c803: Status 404 returned error can't find the container with id 1b567654632b2c21b3950e6f417a664c0400d065319a0bac58d132891b15c803 Jul 10 20:29:30.860856 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:30.860808 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" event={"ID":"9415b17e-0700-4d1c-a574-8164a96c8ab9","Type":"ContainerStarted","Data":"111eb6799cb46058568318419b4009376fe5582e7b40df9726fd2ce7904bcf32"} Jul 10 20:29:30.861048 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:30.861018 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:30.862672 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:30.862640 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" event={"ID":"92ab6c86-ae4e-4b7c-88d5-8d4111628b52","Type":"ContainerStarted","Data":"1b567654632b2c21b3950e6f417a664c0400d065319a0bac58d132891b15c803"} Jul 10 20:29:30.895070 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:30.894981 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" podStartSLOduration=1.556691512 podStartE2EDuration="3.894960678s" totalImagesPullingTime="2.338269166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:29:30.894262749 +0000 UTC m=+488.512695753" watchObservedRunningTime="2026-07-10 20:29:30.894960678 +0000 UTC m=+488.513393681" Jul 10 20:29:30.923493 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:30.923459 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:31.021172 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:31.021133 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:33.884010 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:33.883976 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" event={"ID":"92ab6c86-ae4e-4b7c-88d5-8d4111628b52","Type":"ContainerStarted","Data":"ddb4b5ce211bb12983c59a695bf7ff86f568f0caad51b368fa1ddac42db14efc"} Jul 10 20:29:34.890358 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:34.890324 2566 generic.go:356] "Generic (PLEG): container finished" podID="92ab6c86-ae4e-4b7c-88d5-8d4111628b52" containerID="ddb4b5ce211bb12983c59a695bf7ff86f568f0caad51b368fa1ddac42db14efc" exitCode=0 Jul 10 20:29:34.890720 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:34.890369 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" event={"ID":"92ab6c86-ae4e-4b7c-88d5-8d4111628b52","Type":"ContainerDied","Data":"ddb4b5ce211bb12983c59a695bf7ff86f568f0caad51b368fa1ddac42db14efc"} Jul 10 20:29:35.896431 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:35.896395 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" event={"ID":"92ab6c86-ae4e-4b7c-88d5-8d4111628b52","Type":"ContainerStarted","Data":"c71c486291707c9d1ce436e98756aefbca59afbbc8a89a87d9b279f56805032a"} Jul 10 20:29:35.896812 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:35.896527 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:35.921066 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:35.921009 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" podStartSLOduration=3.499654468 podStartE2EDuration="7.920991621s" totalImagesPullingTime="3.335887934s" totalInitContainerRuntime="1.085449219s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:29:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:29:35.917583833 +0000 UTC m=+493.536016854" watchObservedRunningTime="2026-07-10 20:29:35.920991621 +0000 UTC m=+493.539424626" Jul 10 20:29:41.875169 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:41.875138 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-xrdnw" Jul 10 20:29:46.903167 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:46.903138 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-bkdr9" Jul 10 20:29:48.578463 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:48.578425 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:48.740138 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:48.740103 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:49.258360 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:49.258325 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:49.485233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:49.485199 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:49.657266 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:49.657181 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:49.762562 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:49.762527 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:49.838155 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:49.838124 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:50.323699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:50.323664 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:50.404198 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:50.404166 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:50.556870 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:50.556830 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:50.832716 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:50.832686 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:50.972886 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:50.972853 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:52.049810 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:52.049776 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:55.791590 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:55.791556 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:55.892731 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:55.892696 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:56.505674 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.505640 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm"] Jul 10 20:29:56.513625 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.513600 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.520441 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.520414 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8pdzw\"" Jul 10 20:29:56.520600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.520567 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 20:29:56.530772 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.530740 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm"] Jul 10 20:29:56.555457 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.555418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljmj8\" (UniqueName: \"kubernetes.io/projected/129ab305-1a83-439c-a418-71c27e57eb82-kube-api-access-ljmj8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.555617 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.555473 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.555617 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.555526 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/129ab305-1a83-439c-a418-71c27e57eb82-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.555716 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.555662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/129ab305-1a83-439c-a418-71c27e57eb82-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.555716 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.555702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.555813 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.555787 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.555868 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.555837 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.555918 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.555868 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.555973 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.555933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/129ab305-1a83-439c-a418-71c27e57eb82-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.567295 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.567257 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:56.657303 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.657270 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/129ab305-1a83-439c-a418-71c27e57eb82-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.657303 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.657308 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.657561 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.657341 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.657561 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.657377 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.657561 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.657402 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.657561 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.657457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/129ab305-1a83-439c-a418-71c27e57eb82-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.657561 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.657487 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljmj8\" (UniqueName: \"kubernetes.io/projected/129ab305-1a83-439c-a418-71c27e57eb82-kube-api-access-ljmj8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.657561 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.657517 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.657561 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.657541 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/129ab305-1a83-439c-a418-71c27e57eb82-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.657903 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.657741 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.657960 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.657924 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.658014 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.657992 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.658266 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.658250 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/129ab305-1a83-439c-a418-71c27e57eb82-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.658331 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.658200 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.659917 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.659897 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/129ab305-1a83-439c-a418-71c27e57eb82-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.660156 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.660133 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/129ab305-1a83-439c-a418-71c27e57eb82-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.665715 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.665682 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljmj8\" (UniqueName: \"kubernetes.io/projected/129ab305-1a83-439c-a418-71c27e57eb82-kube-api-access-ljmj8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.665826 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.665779 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/129ab305-1a83-439c-a418-71c27e57eb82-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tqvjm\" (UID: \"129ab305-1a83-439c-a418-71c27e57eb82\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.736764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.736726 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:56.826119 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.826006 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:29:56.841188 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.841156 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:29:56.947130 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.947092 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt"] Jul 10 20:29:56.950270 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.950214 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:56.956984 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.956947 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 20:29:56.957186 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.956947 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 20:29:56.957639 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.957619 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 20:29:56.958045 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.957933 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9th5z\"" Jul 10 20:29:56.974368 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:56.974337 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt"] Jul 10 20:29:57.001724 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.001702 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm"] Jul 10 20:29:57.004453 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:29:57.004418 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod129ab305_1a83_439c_a418_71c27e57eb82.slice/crio-816726cc39c6403614a5f045b6f81a06fa1d332b8f83a2c2294a32d39f225b92 WatchSource:0}: Error finding container 816726cc39c6403614a5f045b6f81a06fa1d332b8f83a2c2294a32d39f225b92: Status 404 returned error can't find the container with id 816726cc39c6403614a5f045b6f81a06fa1d332b8f83a2c2294a32d39f225b92 Jul 10 20:29:57.060261 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.060223 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/34910d66-9e44-47cb-afb8-4a89a5ed1155-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.060475 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.060288 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34910d66-9e44-47cb-afb8-4a89a5ed1155-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.060475 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.060307 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/34910d66-9e44-47cb-afb8-4a89a5ed1155-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.060475 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.060382 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/34910d66-9e44-47cb-afb8-4a89a5ed1155-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.060475 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.060425 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34910d66-9e44-47cb-afb8-4a89a5ed1155-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.060475 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.060449 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnlqf\" (UniqueName: \"kubernetes.io/projected/34910d66-9e44-47cb-afb8-4a89a5ed1155-kube-api-access-bnlqf\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.060686 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.060491 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/34910d66-9e44-47cb-afb8-4a89a5ed1155-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.161764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.161674 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/34910d66-9e44-47cb-afb8-4a89a5ed1155-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.161764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.161715 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34910d66-9e44-47cb-afb8-4a89a5ed1155-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.161764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.161735 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnlqf\" (UniqueName: \"kubernetes.io/projected/34910d66-9e44-47cb-afb8-4a89a5ed1155-kube-api-access-bnlqf\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.161764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.161768 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/34910d66-9e44-47cb-afb8-4a89a5ed1155-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.162104 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.161831 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/34910d66-9e44-47cb-afb8-4a89a5ed1155-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.162104 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.161898 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34910d66-9e44-47cb-afb8-4a89a5ed1155-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.162104 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.161920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/34910d66-9e44-47cb-afb8-4a89a5ed1155-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.162520 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.162493 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/34910d66-9e44-47cb-afb8-4a89a5ed1155-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.164350 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.164328 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/34910d66-9e44-47cb-afb8-4a89a5ed1155-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.164427 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.164401 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34910d66-9e44-47cb-afb8-4a89a5ed1155-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.164638 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.164618 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/34910d66-9e44-47cb-afb8-4a89a5ed1155-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.164770 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.164752 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/34910d66-9e44-47cb-afb8-4a89a5ed1155-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.178914 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.178893 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnlqf\" (UniqueName: \"kubernetes.io/projected/34910d66-9e44-47cb-afb8-4a89a5ed1155-kube-api-access-bnlqf\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.190002 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.189976 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34910d66-9e44-47cb-afb8-4a89a5ed1155-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dfwxt\" (UID: \"34910d66-9e44-47cb-afb8-4a89a5ed1155\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.261747 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.261719 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:29:57.398232 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.398205 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt"] Jul 10 20:29:57.398358 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:29:57.398322 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34910d66_9e44_47cb_afb8_4a89a5ed1155.slice/crio-faa95fa5cad6c025ed336c299917e99b6a5c8b9d4e39a868b73c8047ecf5f073 WatchSource:0}: Error finding container faa95fa5cad6c025ed336c299917e99b6a5c8b9d4e39a868b73c8047ecf5f073: Status 404 returned error can't find the container with id faa95fa5cad6c025ed336c299917e99b6a5c8b9d4e39a868b73c8047ecf5f073 Jul 10 20:29:57.998471 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.998429 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" event={"ID":"129ab305-1a83-439c-a418-71c27e57eb82","Type":"ContainerStarted","Data":"816726cc39c6403614a5f045b6f81a06fa1d332b8f83a2c2294a32d39f225b92"} Jul 10 20:29:58.000015 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:29:57.999981 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" event={"ID":"34910d66-9e44-47cb-afb8-4a89a5ed1155","Type":"ContainerStarted","Data":"faa95fa5cad6c025ed336c299917e99b6a5c8b9d4e39a868b73c8047ecf5f073"} Jul 10 20:30:00.181827 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:00.181768 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:30:00.340621 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:00.340571 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:30:00.449758 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:00.449666 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:30:00.658921 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:00.658883 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:30:00.708808 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:00.708765 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:30:00.708903 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:00.708847 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:30:00.708903 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:00.708881 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:30:00.709600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:00.709574 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:30:00.709677 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:00.709653 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:30:00.782555 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:00.782526 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:30:01.023900 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:01.023808 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" event={"ID":"129ab305-1a83-439c-a418-71c27e57eb82","Type":"ContainerStarted","Data":"b9df14c0f5adafe5fed1583dd94314c00d489a25e589e119dbaeefe3b565528d"} Jul 10 20:30:01.025678 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:01.025645 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" event={"ID":"34910d66-9e44-47cb-afb8-4a89a5ed1155","Type":"ContainerStarted","Data":"0ead3f8488853173fb19bca9fda18dfacff7ce79184ea4824a9661cd6e194c26"} Jul 10 20:30:01.025914 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:01.025764 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:30:01.027654 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:01.027632 2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-dfwxt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 20:30:01.027777 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:01.027690 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" podUID="34910d66-9e44-47cb-afb8-4a89a5ed1155" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 20:30:01.050915 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:01.050859 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" podStartSLOduration=1.348872107 podStartE2EDuration="5.050840731s" totalImagesPullingTime="3.701968624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:30:01.050416355 +0000 UTC m=+518.668849385" watchObservedRunningTime="2026-07-10 20:30:01.050840731 +0000 UTC m=+518.669273738" Jul 10 20:30:01.075040 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:01.074989 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" podStartSLOduration=1.765966889 podStartE2EDuration="5.074973904s" totalImagesPullingTime="3.309007015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:30:01.073167778 +0000 UTC m=+518.691600784" watchObservedRunningTime="2026-07-10 20:30:01.074973904 +0000 UTC m=+518.693406904" Jul 10 20:30:01.826290 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:01.826250 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:30:01.830898 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:01.830871 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:30:02.031668 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:02.031633 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:30:02.032186 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:02.032160 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfwxt" Jul 10 20:30:02.032597 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:02.032579 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tqvjm" Jul 10 20:30:40.365364 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:40.365324 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:30:40.460280 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:40.460244 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:30:42.304152 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:42.304090 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:30:42.367158 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:42.367126 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:30:49.737759 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:49.737726 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:30:49.939005 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:49.938956 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:30:50.034553 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:50.034431 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:30:50.266897 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:30:50.266849 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:06.286415 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:06.286374 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:08.707000 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:08.706962 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:08.775177 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:08.775142 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:17.777316 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:17.777277 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:19.408325 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:19.408280 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:19.587515 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:19.587478 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:19.687163 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:19.687127 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:19.853491 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:19.853456 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:22.854526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:22.854498 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:31:22.854980 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:22.854745 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:31:22.859134 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:22.859110 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:31:22.859320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:22.859308 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:31:23.301932 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:23.301890 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:25.309134 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:25.309098 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:26.853260 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:26.853224 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:27.157515 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:27.157436 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:27.261949 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:27.261918 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:30.444200 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:30.444166 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:30.700536 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:30.700451 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:33.764432 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:33.764391 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:34.199126 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:34.199035 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:34.382224 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:34.382183 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:35.033143 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:35.033099 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:35.132095 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:35.132012 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:42.473897 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:42.473861 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:42.574728 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:42.574651 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:48.266824 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:48.266786 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:48.366733 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:48.366695 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:51.269485 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:51.269449 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:51.391143 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:51.391111 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:55.115397 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:55.115356 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:31:55.179726 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:31:55.179696 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:01.378610 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:01.378571 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:01.444093 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:01.444039 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:07.941560 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:07.941525 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:08.042546 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:08.042509 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:11.359922 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:11.359891 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:11.491331 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:11.491291 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:16.344711 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:16.344675 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:16.404015 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:16.403979 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:19.711137 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.711102 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd"] Jul 10 20:32:19.713489 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.713472 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.716032 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.716009 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zf77q\"" Jul 10 20:32:19.724735 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.724707 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd"] Jul 10 20:32:19.740894 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.740859 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:19.794996 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.794960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.795195 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.795002 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.795195 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.795121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.795195 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.795168 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvvc9\" (UniqueName: \"kubernetes.io/projected/4117ef74-7e93-4f6e-9d48-7bce95b540e1-kube-api-access-fvvc9\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.795301 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.795194 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.795301 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.795238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.795301 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.795258 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.795394 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.795310 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.795394 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.795340 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896146 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896102 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvvc9\" (UniqueName: \"kubernetes.io/projected/4117ef74-7e93-4f6e-9d48-7bce95b540e1-kube-api-access-fvvc9\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896349 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896155 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896349 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896207 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896349 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896234 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896349 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896271 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896349 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896302 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896349 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896331 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896643 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896643 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896460 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896732 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896672 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896873 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896846 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896988 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896871 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.896988 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.896961 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.897105 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.897010 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.898959 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.898926 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.899168 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.899147 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.915822 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.912353 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvvc9\" (UniqueName: \"kubernetes.io/projected/4117ef74-7e93-4f6e-9d48-7bce95b540e1-kube-api-access-fvvc9\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.921633 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.921605 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4117ef74-7e93-4f6e-9d48-7bce95b540e1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9h8xd\" (UID: \"4117ef74-7e93-4f6e-9d48-7bce95b540e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:19.949013 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:19.948978 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:20.025210 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:20.025098 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:20.163627 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:20.163593 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd"] Jul 10 20:32:20.166128 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:32:20.166100 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4117ef74_7e93_4f6e_9d48_7bce95b540e1.slice/crio-a58323cad5de8b99c81fc482123ea5750a0e0ebfb088c75845c9a8a6c6383d56 WatchSource:0}: Error finding container a58323cad5de8b99c81fc482123ea5750a0e0ebfb088c75845c9a8a6c6383d56: Status 404 returned error can't find the container with id a58323cad5de8b99c81fc482123ea5750a0e0ebfb088c75845c9a8a6c6383d56 Jul 10 20:32:20.168197 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:20.168159 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:32:20.168275 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:20.168229 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:32:20.168275 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:20.168255 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:32:20.650483 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:20.650449 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" event={"ID":"4117ef74-7e93-4f6e-9d48-7bce95b540e1","Type":"ContainerStarted","Data":"62e808097faf8c91cc3539ea940006cbcabd67f4dc860b21d8b26471596ed901"} Jul 10 20:32:20.650683 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:20.650500 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" event={"ID":"4117ef74-7e93-4f6e-9d48-7bce95b540e1","Type":"ContainerStarted","Data":"a58323cad5de8b99c81fc482123ea5750a0e0ebfb088c75845c9a8a6c6383d56"} Jul 10 20:32:20.672907 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:20.672844 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" podStartSLOduration=1.672828472 podStartE2EDuration="1.672828472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:32:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:32:20.67060681 +0000 UTC m=+658.289039814" watchObservedRunningTime="2026-07-10 20:32:20.672828472 +0000 UTC m=+658.291261475" Jul 10 20:32:21.026314 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:21.026276 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:21.031158 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:21.031130 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:21.655079 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:21.655026 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:21.655910 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:21.655890 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:32:21.764651 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:21.764613 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:21.868376 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:21.868332 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:21.964679 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:21.964641 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:22.656448 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:22.656411 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:22.720118 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:22.720037 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:24.193830 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:24.193797 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:24.251231 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:24.251202 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:27.549316 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:27.549286 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:30.751602 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:30.751573 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:30.851471 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:30.851420 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:33.745596 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:33.745564 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:33.843578 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:33.843542 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:42.863984 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:42.863861 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:42.983091 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:42.983043 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:43.334039 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:43.334004 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:55.672359 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:55.672323 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:32:56.246043 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:32:56.246000 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:02.181707 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:02.181671 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:02.285402 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:02.285371 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:02.366556 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:02.366528 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:02.423220 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:02.423183 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:05.738214 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:05.738175 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:05.835882 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:05.835845 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:13.515393 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:13.515319 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:13.571097 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:13.571040 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:35.754699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:35.754664 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:36.255116 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:36.255028 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:36.372343 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:36.372307 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:36.819993 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:36.819958 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:36.915826 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:36.915787 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w"] Jul 10 20:33:36.918383 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:36.918357 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" Jul 10 20:33:36.920901 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:36.920870 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 10 20:33:36.928223 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:36.928185 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w"] Jul 10 20:33:36.956941 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:36.956910 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-8w27x"] Jul 10 20:33:36.959364 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:36.959347 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" Jul 10 20:33:36.962041 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:36.962019 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wnljj\"" Jul 10 20:33:36.972198 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:36.972170 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-8w27x"] Jul 10 20:33:37.030782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.030736 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39e38031-b529-488f-9194-51443088c93f-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-8w27x\" (UID: \"39e38031-b529-488f-9194-51443088c93f\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" Jul 10 20:33:37.030947 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.030787 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2vtw\" (UniqueName: \"kubernetes.io/projected/39e38031-b529-488f-9194-51443088c93f-kube-api-access-v2vtw\") pod \"payload-processing-f9b8d9b9b-8w27x\" (UID: \"39e38031-b529-488f-9194-51443088c93f\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" Jul 10 20:33:37.030947 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.030894 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbv6n\" (UniqueName: \"kubernetes.io/projected/69359cd4-0550-4560-8921-284a426def90-kube-api-access-tbv6n\") pod \"payload-pre-processing-74584bb9f8-lmn2w\" (UID: \"69359cd4-0550-4560-8921-284a426def90\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" Jul 10 20:33:37.031022 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.030954 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69359cd4-0550-4560-8921-284a426def90-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-lmn2w\" (UID: \"69359cd4-0550-4560-8921-284a426def90\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" Jul 10 20:33:37.067778 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.067742 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:37.131847 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.131765 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69359cd4-0550-4560-8921-284a426def90-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-lmn2w\" (UID: \"69359cd4-0550-4560-8921-284a426def90\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" Jul 10 20:33:37.131847 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.131810 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39e38031-b529-488f-9194-51443088c93f-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-8w27x\" (UID: \"39e38031-b529-488f-9194-51443088c93f\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" Jul 10 20:33:37.131847 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.131833 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2vtw\" (UniqueName: \"kubernetes.io/projected/39e38031-b529-488f-9194-51443088c93f-kube-api-access-v2vtw\") pod \"payload-processing-f9b8d9b9b-8w27x\" (UID: \"39e38031-b529-488f-9194-51443088c93f\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" Jul 10 20:33:37.132210 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.131900 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbv6n\" (UniqueName: \"kubernetes.io/projected/69359cd4-0550-4560-8921-284a426def90-kube-api-access-tbv6n\") pod \"payload-pre-processing-74584bb9f8-lmn2w\" (UID: \"69359cd4-0550-4560-8921-284a426def90\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" Jul 10 20:33:37.132602 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.132579 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39e38031-b529-488f-9194-51443088c93f-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-8w27x\" (UID: \"39e38031-b529-488f-9194-51443088c93f\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" Jul 10 20:33:37.132602 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.132592 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69359cd4-0550-4560-8921-284a426def90-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-lmn2w\" (UID: \"69359cd4-0550-4560-8921-284a426def90\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" Jul 10 20:33:37.139960 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.139936 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2vtw\" (UniqueName: \"kubernetes.io/projected/39e38031-b529-488f-9194-51443088c93f-kube-api-access-v2vtw\") pod \"payload-processing-f9b8d9b9b-8w27x\" (UID: \"39e38031-b529-488f-9194-51443088c93f\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" Jul 10 20:33:37.140095 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.139977 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbv6n\" (UniqueName: \"kubernetes.io/projected/69359cd4-0550-4560-8921-284a426def90-kube-api-access-tbv6n\") pod \"payload-pre-processing-74584bb9f8-lmn2w\" (UID: \"69359cd4-0550-4560-8921-284a426def90\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" Jul 10 20:33:37.229282 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.229244 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" Jul 10 20:33:37.271075 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.271012 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" Jul 10 20:33:37.380635 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.380595 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w"] Jul 10 20:33:37.386416 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:33:37.386361 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69359cd4_0550_4560_8921_284a426def90.slice/crio-f272f8186fb412dffe9dd68b21d41a490386ff66bbbf211eb8f138c0631a5e55 WatchSource:0}: Error finding container f272f8186fb412dffe9dd68b21d41a490386ff66bbbf211eb8f138c0631a5e55: Status 404 returned error can't find the container with id f272f8186fb412dffe9dd68b21d41a490386ff66bbbf211eb8f138c0631a5e55 Jul 10 20:33:37.424572 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.424541 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-8w27x"] Jul 10 20:33:37.425711 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:33:37.425687 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e38031_b529_488f_9194_51443088c93f.slice/crio-54690d6fddb95aa94e5e26266455529eca2fea7ef2ca9060baa600338fbd9adb WatchSource:0}: Error finding container 54690d6fddb95aa94e5e26266455529eca2fea7ef2ca9060baa600338fbd9adb: Status 404 returned error can't find the container with id 54690d6fddb95aa94e5e26266455529eca2fea7ef2ca9060baa600338fbd9adb Jul 10 20:33:37.997212 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.997176 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" event={"ID":"69359cd4-0550-4560-8921-284a426def90","Type":"ContainerStarted","Data":"f272f8186fb412dffe9dd68b21d41a490386ff66bbbf211eb8f138c0631a5e55"} Jul 10 20:33:37.998314 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:37.998289 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" event={"ID":"39e38031-b529-488f-9194-51443088c93f","Type":"ContainerStarted","Data":"54690d6fddb95aa94e5e26266455529eca2fea7ef2ca9060baa600338fbd9adb"} Jul 10 20:33:40.009804 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:40.009768 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" event={"ID":"69359cd4-0550-4560-8921-284a426def90","Type":"ContainerStarted","Data":"b38c0456b698f299b309f03ae69e501db0c3f0437e0c3688132397bf31096925"} Jul 10 20:33:40.010257 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:40.009883 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" Jul 10 20:33:40.011338 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:40.011313 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" event={"ID":"39e38031-b529-488f-9194-51443088c93f","Type":"ContainerStarted","Data":"d4e986d7966e54ad8b7c238256e06901197e994f03f16ae2bbb69052965df97d"} Jul 10 20:33:40.011415 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:40.011367 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" Jul 10 20:33:40.025890 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:40.025832 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" podStartSLOduration=2.438698304 podStartE2EDuration="4.02581706s" totalImagesPullingTime="1.587118756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:33:40.025035785 +0000 UTC m=+737.643468802" watchObservedRunningTime="2026-07-10 20:33:40.02581706 +0000 UTC m=+737.644250062" Jul 10 20:33:40.041507 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:40.041450 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" podStartSLOduration=2.504879667 podStartE2EDuration="4.041427412s" totalImagesPullingTime="1.536547745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:33:40.040005264 +0000 UTC m=+737.658438271" watchObservedRunningTime="2026-07-10 20:33:40.041427412 +0000 UTC m=+737.659860418" Jul 10 20:33:45.037437 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:45.037400 2566 generic.go:356] "Generic (PLEG): container finished" podID="4117ef74-7e93-4f6e-9d48-7bce95b540e1" containerID="62e808097faf8c91cc3539ea940006cbcabd67f4dc860b21d8b26471596ed901" exitCode=0 Jul 10 20:33:45.037867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:45.037457 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" event={"ID":"4117ef74-7e93-4f6e-9d48-7bce95b540e1","Type":"ContainerDied","Data":"62e808097faf8c91cc3539ea940006cbcabd67f4dc860b21d8b26471596ed901"} Jul 10 20:33:45.037867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:45.037785 2566 scope.go:117] "RemoveContainer" containerID="62e808097faf8c91cc3539ea940006cbcabd67f4dc860b21d8b26471596ed901" Jul 10 20:33:45.038765 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:45.038724 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:33:45.038872 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:45.038819 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:33:45.038932 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:45.038869 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:33:46.046155 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:46.046103 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" event={"ID":"4117ef74-7e93-4f6e-9d48-7bce95b540e1","Type":"ContainerStarted","Data":"8e8cefabfc5699e7b96ec580d8eab976287c2366aef90db68fafc5e34e8b6788"} Jul 10 20:33:46.582652 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:46.582619 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:46.693764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:46.693722 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:33:47.026276 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:47.026232 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:33:47.026471 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:47.026448 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9h8xd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 10 20:33:47.026528 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:47.026498 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" podUID="4117ef74-7e93-4f6e-9d48-7bce95b540e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 10 20:33:48.025853 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:48.025823 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9h8xd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 10 20:33:48.026239 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:48.025889 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" podUID="4117ef74-7e93-4f6e-9d48-7bce95b540e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 10 20:33:49.025557 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:49.025520 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9h8xd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 10 20:33:49.025734 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:49.025576 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" podUID="4117ef74-7e93-4f6e-9d48-7bce95b540e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 10 20:33:50.026507 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:50.026461 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9h8xd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 10 20:33:50.026932 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:50.026542 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" podUID="4117ef74-7e93-4f6e-9d48-7bce95b540e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 10 20:33:51.018240 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:51.018206 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lmn2w" Jul 10 20:33:51.018408 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:51.018283 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w27x" Jul 10 20:33:51.029191 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:51.029162 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:33:51.029547 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:51.029433 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:33:51.030096 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:51.030080 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9h8xd" Jul 10 20:33:55.829639 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:33:55.829594 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:34:03.835306 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:03.835267 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:34:09.020224 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.020180 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-l862v"] Jul 10 20:34:09.025144 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.025119 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.029110 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.029083 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tmx44\"" Jul 10 20:34:09.029245 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.029119 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 20:34:09.029245 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.029124 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 20:34:09.029245 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.029084 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 10 20:34:09.033470 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.033446 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-l862v"] Jul 10 20:34:09.045927 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.045896 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:34:09.173180 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.173141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bea1e34a-1d13-4260-b86b-b142e91993aa-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.173410 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.173208 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bea1e34a-1d13-4260-b86b-b142e91993aa-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.173410 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.173253 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxqh4\" (UniqueName: \"kubernetes.io/projected/bea1e34a-1d13-4260-b86b-b142e91993aa-kube-api-access-gxqh4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.173410 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.173289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea1e34a-1d13-4260-b86b-b142e91993aa-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.173410 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.173343 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bea1e34a-1d13-4260-b86b-b142e91993aa-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.173410 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.173393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bea1e34a-1d13-4260-b86b-b142e91993aa-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.274372 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.274266 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bea1e34a-1d13-4260-b86b-b142e91993aa-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.274372 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.274309 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqh4\" (UniqueName: \"kubernetes.io/projected/bea1e34a-1d13-4260-b86b-b142e91993aa-kube-api-access-gxqh4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.274372 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.274335 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea1e34a-1d13-4260-b86b-b142e91993aa-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.274372 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.274372 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bea1e34a-1d13-4260-b86b-b142e91993aa-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.274892 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.274398 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bea1e34a-1d13-4260-b86b-b142e91993aa-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.274892 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.274468 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bea1e34a-1d13-4260-b86b-b142e91993aa-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.274892 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.274747 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bea1e34a-1d13-4260-b86b-b142e91993aa-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.274892 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.274845 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bea1e34a-1d13-4260-b86b-b142e91993aa-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.274892 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.274857 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea1e34a-1d13-4260-b86b-b142e91993aa-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.276828 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.276810 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bea1e34a-1d13-4260-b86b-b142e91993aa-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.277198 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.277180 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bea1e34a-1d13-4260-b86b-b142e91993aa-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.282008 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.281981 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxqh4\" (UniqueName: \"kubernetes.io/projected/bea1e34a-1d13-4260-b86b-b142e91993aa-kube-api-access-gxqh4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l862v\" (UID: \"bea1e34a-1d13-4260-b86b-b142e91993aa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.337409 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.337371 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:09.475334 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:09.475297 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-l862v"] Jul 10 20:34:09.478677 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:34:09.478646 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea1e34a_1d13_4260_b86b_b142e91993aa.slice/crio-d26a95c1167a3bee820ccc297ec00efb8e209f23e57cb7f7ddbd50bf374f616a WatchSource:0}: Error finding container d26a95c1167a3bee820ccc297ec00efb8e209f23e57cb7f7ddbd50bf374f616a: Status 404 returned error can't find the container with id d26a95c1167a3bee820ccc297ec00efb8e209f23e57cb7f7ddbd50bf374f616a Jul 10 20:34:10.171556 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:10.171516 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" event={"ID":"bea1e34a-1d13-4260-b86b-b142e91993aa","Type":"ContainerStarted","Data":"d26a95c1167a3bee820ccc297ec00efb8e209f23e57cb7f7ddbd50bf374f616a"} Jul 10 20:34:11.177275 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:11.177170 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" event={"ID":"bea1e34a-1d13-4260-b86b-b142e91993aa","Type":"ContainerStarted","Data":"d440e69af5215965c462c1f3c04477fc7393b025083662d96b21a97f5155e1bd"} Jul 10 20:34:11.194325 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:11.194270 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" podStartSLOduration=0.853609203 podStartE2EDuration="2.194253312s" totalImagesPullingTime="1.340644109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:34:11.193483388 +0000 UTC m=+768.811916384" watchObservedRunningTime="2026-07-10 20:34:11.194253312 +0000 UTC m=+768.812686344" Jul 10 20:34:13.824519 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:13.824481 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql"] Jul 10 20:34:13.828305 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:13.828278 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:13.831656 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:13.831634 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 10 20:34:13.843998 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:13.843924 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql"] Jul 10 20:34:13.902043 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:13.901991 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:34:14.019109 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.019050 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/047adff3-76bb-4954-b5be-03cc567520b9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.019294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.019136 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/047adff3-76bb-4954-b5be-03cc567520b9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.019294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.019162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/047adff3-76bb-4954-b5be-03cc567520b9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.019294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.019211 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/047adff3-76bb-4954-b5be-03cc567520b9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.019294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.019249 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/047adff3-76bb-4954-b5be-03cc567520b9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.019294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.019292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snmqg\" (UniqueName: \"kubernetes.io/projected/047adff3-76bb-4954-b5be-03cc567520b9-kube-api-access-snmqg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.120109 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.119998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/047adff3-76bb-4954-b5be-03cc567520b9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.120109 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.120044 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/047adff3-76bb-4954-b5be-03cc567520b9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.120353 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.120181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snmqg\" (UniqueName: \"kubernetes.io/projected/047adff3-76bb-4954-b5be-03cc567520b9-kube-api-access-snmqg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.120353 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.120263 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/047adff3-76bb-4954-b5be-03cc567520b9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.120353 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.120319 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/047adff3-76bb-4954-b5be-03cc567520b9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.120517 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.120355 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/047adff3-76bb-4954-b5be-03cc567520b9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.120517 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.120382 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/047adff3-76bb-4954-b5be-03cc567520b9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.120517 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.120471 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/047adff3-76bb-4954-b5be-03cc567520b9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.120637 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.120550 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/047adff3-76bb-4954-b5be-03cc567520b9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.122568 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.122548 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/047adff3-76bb-4954-b5be-03cc567520b9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.122740 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.122722 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/047adff3-76bb-4954-b5be-03cc567520b9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.128105 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.128081 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snmqg\" (UniqueName: \"kubernetes.io/projected/047adff3-76bb-4954-b5be-03cc567520b9-kube-api-access-snmqg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql\" (UID: \"047adff3-76bb-4954-b5be-03cc567520b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.138985 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.138955 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:14.281230 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:14.281157 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql"] Jul 10 20:34:14.283754 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:34:14.283724 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047adff3_76bb_4954_b5be_03cc567520b9.slice/crio-5fc805cd34a7ddd447831b99ae9a231f2338a265b980ab4bc6608981bf8e1fd4 WatchSource:0}: Error finding container 5fc805cd34a7ddd447831b99ae9a231f2338a265b980ab4bc6608981bf8e1fd4: Status 404 returned error can't find the container with id 5fc805cd34a7ddd447831b99ae9a231f2338a265b980ab4bc6608981bf8e1fd4 Jul 10 20:34:15.205996 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:15.205956 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" event={"ID":"047adff3-76bb-4954-b5be-03cc567520b9","Type":"ContainerStarted","Data":"d7bf3f2985e4058abf9c3ab827acb6008893cc302a2d7a6e467cdf44b4ee1d7f"} Jul 10 20:34:15.206393 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:15.206021 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" event={"ID":"047adff3-76bb-4954-b5be-03cc567520b9","Type":"ContainerStarted","Data":"5fc805cd34a7ddd447831b99ae9a231f2338a265b980ab4bc6608981bf8e1fd4"} Jul 10 20:34:15.224637 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:15.224585 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" podStartSLOduration=2.04118778 podStartE2EDuration="2.224569629s" totalImagesPullingTime="183.381849ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:34:15.223404728 +0000 UTC m=+772.841837755" watchObservedRunningTime="2026-07-10 20:34:15.224569629 +0000 UTC m=+772.843002632" Jul 10 20:34:18.242280 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:18.242244 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:34:19.337902 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:19.337854 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:19.338371 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:19.337928 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:19.350709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:19.350679 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:20.242785 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:20.242755 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l862v" Jul 10 20:34:24.139658 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:24.139615 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:24.140171 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:24.139682 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:24.152369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:24.152338 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:24.259437 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:24.259401 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql" Jul 10 20:34:29.557131 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:29.557089 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:34:38.097705 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:38.097658 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:34:38.153638 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:34:38.153562 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:35:43.042873 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:35:43.042825 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:35:43.142674 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:35:43.142638 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:35:44.223993 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:35:44.223947 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:35:44.323709 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:35:44.323676 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:35:46.098731 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:35:46.098692 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:35:53.168643 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:35:53.168605 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:35:53.269335 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:35:53.269302 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:36:10.156613 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:36:10.156574 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:36:22.887865 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:36:22.887832 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:36:22.890031 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:36:22.890006 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:36:22.893127 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:36:22.893103 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:36:22.894719 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:36:22.894678 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:36:57.551981 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:36:57.551943 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:36:59.154574 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:36:59.154539 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:37:24.731755 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:37:24.731713 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:37:24.831211 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:37:24.831173 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:37:40.373971 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:37:40.373929 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:37:40.477510 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:37:40.477474 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:37:40.627146 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:37:40.627032 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:37:46.263869 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:37:46.263833 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:37:46.366609 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:37:46.366569 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:37:46.463866 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:37:46.463834 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:37:46.664003 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:37:46.663926 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:37:52.337875 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:37:52.337838 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:37:52.391201 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:37:52.391165 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:38:19.558740 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:38:19.558706 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:41:22.917298 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:41:22.917265 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:41:22.919923 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:41:22.919899 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:41:22.922021 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:41:22.921998 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:41:22.927735 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:41:22.927714 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:43:26.266938 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:43:26.266902 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:43:27.592079 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:43:27.592015 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:44:02.205281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:44:02.205239 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:44:02.305168 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:44:02.305131 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:46:22.950312 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:46:22.950271 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:46:22.955144 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:46:22.955110 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:46:22.955480 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:46:22.955465 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:46:22.960151 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:46:22.960130 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:47:15.012878 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:47:15.012842 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:47:26.124011 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:47:26.123973 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:48:31.465661 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:48:31.465578 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:48:43.066917 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:48:43.066883 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:48:51.311303 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:48:51.311258 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:48:56.366377 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:48:56.366337 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:48:59.043108 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:48:59.043045 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:48:59.134814 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:48:59.134777 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:48:59.435535 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:48:59.435495 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:05.039486 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.039451 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:05.097132 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.097099 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:05.211071 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.211022 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq"] Jul 10 20:49:05.214550 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.214526 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.217266 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.217243 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-34b69dd3-openshift-default-dockercfg-vzgp6\"" Jul 10 20:49:05.239110 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.239071 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq"] Jul 10 20:49:05.243549 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.243516 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:05.312083 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.311974 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:05.314149 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.314120 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-envoy\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.314287 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.314169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-data\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.314287 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.314195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smqmp\" (UniqueName: \"kubernetes.io/projected/2b3c9ee5-7016-4447-a524-bd0e5bd37157-kube-api-access-smqmp\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.314411 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.314297 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istiod-ca-cert\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.314411 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.314384 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-workload-socket\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.314511 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.314415 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-credential-socket\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.314511 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.314454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-podinfo\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.314511 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.314506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-token\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.314647 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.314531 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-workload-certs\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.415548 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.415504 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-token\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.415548 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.415550 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-workload-certs\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.415758 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.415600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-envoy\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.415758 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.415645 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-data\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.415877 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.415847 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smqmp\" (UniqueName: \"kubernetes.io/projected/2b3c9ee5-7016-4447-a524-bd0e5bd37157-kube-api-access-smqmp\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.415966 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.415937 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istiod-ca-cert\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.416121 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.416027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-workload-socket\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.416121 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.416074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-credential-socket\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.416281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.416131 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-workload-certs\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.416281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.416187 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-podinfo\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.416281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.416193 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-data\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.416442 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.416393 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-workload-socket\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.416503 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.416445 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-credential-socket\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.416572 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.416553 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istiod-ca-cert\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.418244 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.418218 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-envoy\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.418784 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.418755 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-podinfo\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.424913 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.424892 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-token\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.425138 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.425115 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smqmp\" (UniqueName: \"kubernetes.io/projected/2b3c9ee5-7016-4447-a524-bd0e5bd37157-kube-api-access-smqmp\") pod \"e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.525981 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.525937 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:05.671325 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.671298 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq"] Jul 10 20:49:05.673726 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:49:05.673698 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3c9ee5_7016_4447_a524_bd0e5bd37157.slice/crio-cdd5b0aedd8f36113f5e3e364f27bf161e92da69f7d55fd1c71ae0df283efa90 WatchSource:0}: Error finding container cdd5b0aedd8f36113f5e3e364f27bf161e92da69f7d55fd1c71ae0df283efa90: Status 404 returned error can't find the container with id cdd5b0aedd8f36113f5e3e364f27bf161e92da69f7d55fd1c71ae0df283efa90 Jul 10 20:49:05.675934 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.675895 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:49:05.676031 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.675966 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:49:05.676031 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:05.675998 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:49:06.442179 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:06.442120 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:06.444707 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:06.444669 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" event={"ID":"2b3c9ee5-7016-4447-a524-bd0e5bd37157","Type":"ContainerStarted","Data":"30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6"} Jul 10 20:49:06.444963 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:06.444934 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" event={"ID":"2b3c9ee5-7016-4447-a524-bd0e5bd37157","Type":"ContainerStarted","Data":"cdd5b0aedd8f36113f5e3e364f27bf161e92da69f7d55fd1c71ae0df283efa90"} Jul 10 20:49:06.468874 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:06.468822 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" podStartSLOduration=1.468806502 podStartE2EDuration="1.468806502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:49:06.467678216 +0000 UTC m=+1664.086111222" watchObservedRunningTime="2026-07-10 20:49:06.468806502 +0000 UTC m=+1664.087239504" Jul 10 20:49:06.526366 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:06.526316 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:06.531741 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:06.531713 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:06.534547 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:06.534511 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:06.616267 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:06.616234 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:07.208355 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:07.208312 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:07.324107 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:07.324043 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:07.450012 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:07.449979 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:07.450928 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:07.450909 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:07.493650 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:07.493563 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:09.326161 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:09.326132 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:11.531913 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:11.531878 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:11.677746 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:11.677706 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq"] Jul 10 20:49:11.677972 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:11.677947 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" podUID="2b3c9ee5-7016-4447-a524-bd0e5bd37157" containerName="istio-proxy" containerID="cri-o://30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6" gracePeriod=30 Jul 10 20:49:11.721809 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:11.721769 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:11.836030 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:11.835948 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:12.135384 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:12.135305 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:13.131863 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:13.131809 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:16.944918 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:16.944856 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:17.038832 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.038798 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-token\") pod \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " Jul 10 20:49:17.039001 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.038863 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-workload-certs\") pod \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " Jul 10 20:49:17.039001 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.038925 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-podinfo\") pod \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " Jul 10 20:49:17.039001 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.038989 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-credential-socket\") pod \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " Jul 10 20:49:17.039154 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039019 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-data\") pod \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " Jul 10 20:49:17.039154 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039107 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smqmp\" (UniqueName: \"kubernetes.io/projected/2b3c9ee5-7016-4447-a524-bd0e5bd37157-kube-api-access-smqmp\") pod \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " Jul 10 20:49:17.039154 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039137 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-workload-socket\") pod \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " Jul 10 20:49:17.039307 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039214 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istiod-ca-cert\") pod \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " Jul 10 20:49:17.039307 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039246 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-envoy\") pod \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\" (UID: \"2b3c9ee5-7016-4447-a524-bd0e5bd37157\") " Jul 10 20:49:17.039408 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039282 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2b3c9ee5-7016-4447-a524-bd0e5bd37157" (UID: "2b3c9ee5-7016-4447-a524-bd0e5bd37157"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:17.039408 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039341 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-data" (OuterVolumeSpecName: "istio-data") pod "2b3c9ee5-7016-4447-a524-bd0e5bd37157" (UID: "2b3c9ee5-7016-4447-a524-bd0e5bd37157"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:17.039506 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039458 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2b3c9ee5-7016-4447-a524-bd0e5bd37157" (UID: "2b3c9ee5-7016-4447-a524-bd0e5bd37157"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:17.039553 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039500 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2b3c9ee5-7016-4447-a524-bd0e5bd37157" (UID: "2b3c9ee5-7016-4447-a524-bd0e5bd37157"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:17.039684 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039646 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-workload-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:17.039684 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039671 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-workload-certs\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:17.039786 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039686 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-credential-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:17.039786 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039699 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-data\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:17.039873 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.039782 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2b3c9ee5-7016-4447-a524-bd0e5bd37157" (UID: "2b3c9ee5-7016-4447-a524-bd0e5bd37157"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:49:17.041638 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.041608 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2b3c9ee5-7016-4447-a524-bd0e5bd37157" (UID: "2b3c9ee5-7016-4447-a524-bd0e5bd37157"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 20:49:17.041977 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.041954 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2b3c9ee5-7016-4447-a524-bd0e5bd37157" (UID: "2b3c9ee5-7016-4447-a524-bd0e5bd37157"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:17.042086 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.042018 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3c9ee5-7016-4447-a524-bd0e5bd37157-kube-api-access-smqmp" (OuterVolumeSpecName: "kube-api-access-smqmp") pod "2b3c9ee5-7016-4447-a524-bd0e5bd37157" (UID: "2b3c9ee5-7016-4447-a524-bd0e5bd37157"). InnerVolumeSpecName "kube-api-access-smqmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:49:17.042086 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.042039 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-token" (OuterVolumeSpecName: "istio-token") pod "2b3c9ee5-7016-4447-a524-bd0e5bd37157" (UID: "2b3c9ee5-7016-4447-a524-bd0e5bd37157"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:49:17.140640 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.140593 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smqmp\" (UniqueName: \"kubernetes.io/projected/2b3c9ee5-7016-4447-a524-bd0e5bd37157-kube-api-access-smqmp\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:17.140640 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.140639 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istiod-ca-cert\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:17.140640 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.140652 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-envoy\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:17.140936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.140663 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-token\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:17.140936 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.140675 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b3c9ee5-7016-4447-a524-bd0e5bd37157-istio-podinfo\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:17.499625 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.499590 2566 generic.go:356] "Generic (PLEG): container finished" podID="2b3c9ee5-7016-4447-a524-bd0e5bd37157" containerID="30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6" exitCode=0 Jul 10 20:49:17.499807 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.499632 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" event={"ID":"2b3c9ee5-7016-4447-a524-bd0e5bd37157","Type":"ContainerDied","Data":"30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6"} Jul 10 20:49:17.499807 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.499638 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" Jul 10 20:49:17.499807 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.499674 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq" event={"ID":"2b3c9ee5-7016-4447-a524-bd0e5bd37157","Type":"ContainerDied","Data":"cdd5b0aedd8f36113f5e3e364f27bf161e92da69f7d55fd1c71ae0df283efa90"} Jul 10 20:49:17.499807 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.499694 2566 scope.go:117] "RemoveContainer" containerID="30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6" Jul 10 20:49:17.512694 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.512666 2566 scope.go:117] "RemoveContainer" containerID="30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6" Jul 10 20:49:17.513000 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:49:17.512979 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6\": container with ID starting with 30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6 not found: ID does not exist" containerID="30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6" Jul 10 20:49:17.513085 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.513007 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6"} err="failed to get container status \"30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6\": rpc error: code = NotFound desc = could not find container \"30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6\": container with ID starting with 30f339838670a4d6380a71ff341b7eee31b802a901bfd8890b5302a9af3b2ce6 not found: ID does not exist" Jul 10 20:49:17.530727 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.530684 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq"] Jul 10 20:49:17.535841 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:17.535807 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-34b69dd3-openshift-default-86c4d56b77-svhgq"] Jul 10 20:49:18.346937 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.346892 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:18.452035 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.451998 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:18.590092 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.590044 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd"] Jul 10 20:49:18.590529 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.590516 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3c9ee5-7016-4447-a524-bd0e5bd37157" containerName="istio-proxy" Jul 10 20:49:18.590573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.590532 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3c9ee5-7016-4447-a524-bd0e5bd37157" containerName="istio-proxy" Jul 10 20:49:18.590604 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.590595 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3c9ee5-7016-4447-a524-bd0e5bd37157" containerName="istio-proxy" Jul 10 20:49:18.595036 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.595016 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.607909 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.607886 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-412320a5-openshift-default-dockercfg-55kg6\"" Jul 10 20:49:18.627178 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.627147 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd"] Jul 10 20:49:18.641149 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.641115 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:18.656469 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.656440 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-podinfo\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.656644 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.656482 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-data\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.656644 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.656572 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-workload-certs\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.656644 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.656611 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-workload-socket\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.656644 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.656641 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79cae5a5-29df-4440-a7dc-2d801cdf4010-istiod-ca-cert\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.656867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.656663 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-envoy\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.656867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.656744 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-token\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.656867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.656772 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-credential-socket\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.656867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.656821 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh6mw\" (UniqueName: \"kubernetes.io/projected/79cae5a5-29df-4440-a7dc-2d801cdf4010-kube-api-access-mh6mw\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.757635 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.757590 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-token\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.757635 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.757642 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-credential-socket\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.757899 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.757708 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh6mw\" (UniqueName: \"kubernetes.io/projected/79cae5a5-29df-4440-a7dc-2d801cdf4010-kube-api-access-mh6mw\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.757899 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.757737 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-podinfo\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.757899 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.757767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-data\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.757899 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.757820 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-workload-certs\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.757899 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.757857 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-workload-socket\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.757899 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.757894 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79cae5a5-29df-4440-a7dc-2d801cdf4010-istiod-ca-cert\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.758238 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.757928 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-envoy\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.758238 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.758174 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-credential-socket\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.758355 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.758233 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-data\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.758355 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.758281 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-workload-socket\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.758355 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.758323 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-workload-certs\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.758654 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.758634 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79cae5a5-29df-4440-a7dc-2d801cdf4010-istiod-ca-cert\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.760284 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.760264 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-envoy\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.760353 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.760337 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-podinfo\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.778061 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.778020 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-token\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.792968 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.792934 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh6mw\" (UniqueName: \"kubernetes.io/projected/79cae5a5-29df-4440-a7dc-2d801cdf4010-kube-api-access-mh6mw\") pod \"e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.839907 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.839866 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:18.905978 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.905879 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:18.970504 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:18.970471 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b3c9ee5-7016-4447-a524-bd0e5bd37157" path="/var/lib/kubelet/pods/2b3c9ee5-7016-4447-a524-bd0e5bd37157/volumes" Jul 10 20:49:19.057823 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:19.057720 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd"] Jul 10 20:49:19.060703 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:49:19.060670 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79cae5a5_29df_4440_a7dc_2d801cdf4010.slice/crio-30966acb08cac5b114f07ace1aa145b55adc56dabf86334341194c3d00aebdb6 WatchSource:0}: Error finding container 30966acb08cac5b114f07ace1aa145b55adc56dabf86334341194c3d00aebdb6: Status 404 returned error can't find the container with id 30966acb08cac5b114f07ace1aa145b55adc56dabf86334341194c3d00aebdb6 Jul 10 20:49:19.062878 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:19.062846 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:49:19.062967 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:19.062910 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:49:19.062967 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:19.062944 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:49:19.512038 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:19.512000 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" event={"ID":"79cae5a5-29df-4440-a7dc-2d801cdf4010","Type":"ContainerStarted","Data":"eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c"} Jul 10 20:49:19.512435 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:19.512098 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" event={"ID":"79cae5a5-29df-4440-a7dc-2d801cdf4010","Type":"ContainerStarted","Data":"30966acb08cac5b114f07ace1aa145b55adc56dabf86334341194c3d00aebdb6"} Jul 10 20:49:19.541554 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:19.541502 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" podStartSLOduration=1.541484909 podStartE2EDuration="1.541484909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:49:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:49:19.537215813 +0000 UTC m=+1677.155648816" watchObservedRunningTime="2026-07-10 20:49:19.541484909 +0000 UTC m=+1677.159917912" Jul 10 20:49:19.816471 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:19.816381 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:19.906364 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:19.906319 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:19.929468 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:19.929434 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:20.060787 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:20.060749 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:20.202315 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:20.202279 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:20.743601 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:20.743570 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:20.849262 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:20.849226 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:20.924974 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:20.924940 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:21.522215 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:21.522183 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:21.523366 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:21.523344 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:22.188897 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:22.188845 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:22.806002 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:22.805970 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:22.876438 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:22.876407 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:24.781155 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:24.781118 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:25.358925 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:25.358884 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:30.877960 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:30.877923 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd"] Jul 10 20:49:30.878395 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:30.878137 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" podUID="79cae5a5-29df-4440-a7dc-2d801cdf4010" containerName="istio-proxy" containerID="cri-o://eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c" gracePeriod=30 Jul 10 20:49:30.911362 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:30.911318 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:31.011219 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.011189 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:31.736101 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.736049 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:31.793331 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.793301 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-data\") pod \"79cae5a5-29df-4440-a7dc-2d801cdf4010\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " Jul 10 20:49:31.793331 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.793334 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-workload-socket\") pod \"79cae5a5-29df-4440-a7dc-2d801cdf4010\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " Jul 10 20:49:31.793567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.793385 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-workload-certs\") pod \"79cae5a5-29df-4440-a7dc-2d801cdf4010\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " Jul 10 20:49:31.793567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.793417 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-podinfo\") pod \"79cae5a5-29df-4440-a7dc-2d801cdf4010\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " Jul 10 20:49:31.793567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.793470 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh6mw\" (UniqueName: \"kubernetes.io/projected/79cae5a5-29df-4440-a7dc-2d801cdf4010-kube-api-access-mh6mw\") pod \"79cae5a5-29df-4440-a7dc-2d801cdf4010\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " Jul 10 20:49:31.793567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.793490 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-token\") pod \"79cae5a5-29df-4440-a7dc-2d801cdf4010\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " Jul 10 20:49:31.793567 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.793526 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-credential-socket\") pod \"79cae5a5-29df-4440-a7dc-2d801cdf4010\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " Jul 10 20:49:31.793834 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.793594 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79cae5a5-29df-4440-a7dc-2d801cdf4010" (UID: "79cae5a5-29df-4440-a7dc-2d801cdf4010"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:31.793834 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.793650 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-envoy\") pod \"79cae5a5-29df-4440-a7dc-2d801cdf4010\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " Jul 10 20:49:31.793834 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.793683 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79cae5a5-29df-4440-a7dc-2d801cdf4010-istiod-ca-cert\") pod \"79cae5a5-29df-4440-a7dc-2d801cdf4010\" (UID: \"79cae5a5-29df-4440-a7dc-2d801cdf4010\") " Jul 10 20:49:31.793985 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.793834 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79cae5a5-29df-4440-a7dc-2d801cdf4010" (UID: "79cae5a5-29df-4440-a7dc-2d801cdf4010"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:31.794493 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.794113 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-workload-certs\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:31.794493 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.794134 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-workload-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:31.794493 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.794209 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-data" (OuterVolumeSpecName: "istio-data") pod "79cae5a5-29df-4440-a7dc-2d801cdf4010" (UID: "79cae5a5-29df-4440-a7dc-2d801cdf4010"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:31.794493 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.794453 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79cae5a5-29df-4440-a7dc-2d801cdf4010-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79cae5a5-29df-4440-a7dc-2d801cdf4010" (UID: "79cae5a5-29df-4440-a7dc-2d801cdf4010"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:49:31.794493 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.794477 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79cae5a5-29df-4440-a7dc-2d801cdf4010" (UID: "79cae5a5-29df-4440-a7dc-2d801cdf4010"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:31.796610 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.796575 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79cae5a5-29df-4440-a7dc-2d801cdf4010-kube-api-access-mh6mw" (OuterVolumeSpecName: "kube-api-access-mh6mw") pod "79cae5a5-29df-4440-a7dc-2d801cdf4010" (UID: "79cae5a5-29df-4440-a7dc-2d801cdf4010"). InnerVolumeSpecName "kube-api-access-mh6mw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:49:31.796610 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.796581 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-token" (OuterVolumeSpecName: "istio-token") pod "79cae5a5-29df-4440-a7dc-2d801cdf4010" (UID: "79cae5a5-29df-4440-a7dc-2d801cdf4010"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:49:31.796793 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.796774 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79cae5a5-29df-4440-a7dc-2d801cdf4010" (UID: "79cae5a5-29df-4440-a7dc-2d801cdf4010"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 20:49:31.796869 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.796852 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79cae5a5-29df-4440-a7dc-2d801cdf4010" (UID: "79cae5a5-29df-4440-a7dc-2d801cdf4010"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:31.895329 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.895282 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-envoy\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:31.895329 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.895319 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79cae5a5-29df-4440-a7dc-2d801cdf4010-istiod-ca-cert\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:31.895329 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.895332 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-data\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:31.895780 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.895343 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-podinfo\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:31.895780 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.895355 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh6mw\" (UniqueName: \"kubernetes.io/projected/79cae5a5-29df-4440-a7dc-2d801cdf4010-kube-api-access-mh6mw\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:31.895780 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.895366 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79cae5a5-29df-4440-a7dc-2d801cdf4010-istio-token\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:31.895780 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:31.895377 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79cae5a5-29df-4440-a7dc-2d801cdf4010-credential-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:32.581737 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:32.581697 2566 generic.go:356] "Generic (PLEG): container finished" podID="79cae5a5-29df-4440-a7dc-2d801cdf4010" containerID="eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c" exitCode=0 Jul 10 20:49:32.581922 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:32.581750 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" event={"ID":"79cae5a5-29df-4440-a7dc-2d801cdf4010","Type":"ContainerDied","Data":"eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c"} Jul 10 20:49:32.581922 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:32.581795 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" event={"ID":"79cae5a5-29df-4440-a7dc-2d801cdf4010","Type":"ContainerDied","Data":"30966acb08cac5b114f07ace1aa145b55adc56dabf86334341194c3d00aebdb6"} Jul 10 20:49:32.581922 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:32.581756 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd" Jul 10 20:49:32.581922 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:32.581816 2566 scope.go:117] "RemoveContainer" containerID="eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c" Jul 10 20:49:32.591224 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:32.591201 2566 scope.go:117] "RemoveContainer" containerID="eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c" Jul 10 20:49:32.591487 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:49:32.591467 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c\": container with ID starting with eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c not found: ID does not exist" containerID="eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c" Jul 10 20:49:32.591549 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:32.591496 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c"} err="failed to get container status \"eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c\": rpc error: code = NotFound desc = could not find container \"eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c\": container with ID starting with eec46410730f0df9d0ce8c6856a576cea8e76530a591ad31ff3c07055f57200c not found: ID does not exist" Jul 10 20:49:32.604323 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:32.604298 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd"] Jul 10 20:49:32.608537 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:32.608511 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-412320a5-openshift-default-546b55cfd7-d6gvd"] Jul 10 20:49:32.930495 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:32.930460 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:32.967885 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:32.967849 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79cae5a5-29df-4440-a7dc-2d801cdf4010" path="/var/lib/kubelet/pods/79cae5a5-29df-4440-a7dc-2d801cdf4010/volumes" Jul 10 20:49:37.031769 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.031729 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:37.129659 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.129618 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:37.215268 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.215231 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw"] Jul 10 20:49:37.215852 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.215827 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79cae5a5-29df-4440-a7dc-2d801cdf4010" containerName="istio-proxy" Jul 10 20:49:37.215852 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.215853 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="79cae5a5-29df-4440-a7dc-2d801cdf4010" containerName="istio-proxy" Jul 10 20:49:37.216046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.215944 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="79cae5a5-29df-4440-a7dc-2d801cdf4010" containerName="istio-proxy" Jul 10 20:49:37.219144 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.219121 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.222130 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.222109 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a405bf62-openshift-default-dockercfg-l859t\"" Jul 10 20:49:37.236555 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.236524 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw"] Jul 10 20:49:37.263361 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.263323 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:37.348300 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.348206 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-workload-certs\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.348300 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.348267 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-token\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.348490 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.348307 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-data\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.348490 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.348356 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-envoy\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.348490 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.348393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-workload-socket\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.348490 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.348414 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-credential-socket\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.348490 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.348438 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-podinfo\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.348490 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.348485 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvkb4\" (UniqueName: \"kubernetes.io/projected/9fade092-e75f-4e36-b1b8-28776aee04d1-kube-api-access-fvkb4\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.348677 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.348523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fade092-e75f-4e36-b1b8-28776aee04d1-istiod-ca-cert\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.376262 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.376229 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:37.450016 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.449972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-credential-socket\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450256 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450026 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-podinfo\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450256 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450124 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvkb4\" (UniqueName: \"kubernetes.io/projected/9fade092-e75f-4e36-b1b8-28776aee04d1-kube-api-access-fvkb4\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450256 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fade092-e75f-4e36-b1b8-28776aee04d1-istiod-ca-cert\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450256 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450209 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-workload-certs\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450256 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450249 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-token\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450523 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450286 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-data\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450523 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450351 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-envoy\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450523 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450387 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-workload-socket\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450704 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450660 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-workload-certs\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450704 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450682 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-credential-socket\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450805 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450716 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-workload-socket\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450805 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450781 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-data\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.450951 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.450931 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fade092-e75f-4e36-b1b8-28776aee04d1-istiod-ca-cert\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.452694 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.452671 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-podinfo\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.452694 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.452687 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-envoy\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.460381 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.460356 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvkb4\" (UniqueName: \"kubernetes.io/projected/9fade092-e75f-4e36-b1b8-28776aee04d1-kube-api-access-fvkb4\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.460510 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.460467 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-token\") pod \"e2e-derive-a405bf62-openshift-default-697c645475-7f4jw\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.529554 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.529518 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:37.675634 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.675606 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw"] Jul 10 20:49:37.677654 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:49:37.677619 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fade092_e75f_4e36_b1b8_28776aee04d1.slice/crio-23c4e6320d068f35a2b9216925f6557b8cca9f8e7d877f9ffe2d8d555738a7b3 WatchSource:0}: Error finding container 23c4e6320d068f35a2b9216925f6557b8cca9f8e7d877f9ffe2d8d555738a7b3: Status 404 returned error can't find the container with id 23c4e6320d068f35a2b9216925f6557b8cca9f8e7d877f9ffe2d8d555738a7b3 Jul 10 20:49:37.679705 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.679674 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:49:37.679792 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.679737 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:49:37.679792 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:37.679763 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:49:38.460651 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:38.460609 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:38.564153 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:38.564087 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:38.614557 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:38.614516 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" event={"ID":"9fade092-e75f-4e36-b1b8-28776aee04d1","Type":"ContainerStarted","Data":"e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c"} Jul 10 20:49:38.614716 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:38.614574 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" event={"ID":"9fade092-e75f-4e36-b1b8-28776aee04d1","Type":"ContainerStarted","Data":"23c4e6320d068f35a2b9216925f6557b8cca9f8e7d877f9ffe2d8d555738a7b3"} Jul 10 20:49:38.652645 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:38.652591 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" podStartSLOduration=1.652571788 podStartE2EDuration="1.652571788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:49:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:49:38.650049936 +0000 UTC m=+1696.268482959" watchObservedRunningTime="2026-07-10 20:49:38.652571788 +0000 UTC m=+1696.271004841" Jul 10 20:49:38.656671 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:38.656640 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:38.905096 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:38.904966 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:39.243716 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:39.243671 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:39.346500 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:39.346465 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:39.530830 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:39.530731 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:39.535340 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:39.535309 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:39.619774 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:39.619740 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:39.620649 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:39.620627 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:40.614334 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:40.614297 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:42.807285 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:42.807203 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:42.973323 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:42.973290 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw"] Jul 10 20:49:42.973524 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:42.973499 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" podUID="9fade092-e75f-4e36-b1b8-28776aee04d1" containerName="istio-proxy" containerID="cri-o://e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c" gracePeriod=30 Jul 10 20:49:42.995931 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:42.995889 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:43.096427 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:43.096340 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:43.372687 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:43.372590 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:44.760689 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:44.760542 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:48.920230 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:48.920200 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:49.076814 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.076725 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-podinfo\") pod \"9fade092-e75f-4e36-b1b8-28776aee04d1\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " Jul 10 20:49:49.076814 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.076768 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-workload-socket\") pod \"9fade092-e75f-4e36-b1b8-28776aee04d1\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " Jul 10 20:49:49.076814 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.076810 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-data\") pod \"9fade092-e75f-4e36-b1b8-28776aee04d1\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " Jul 10 20:49:49.077129 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.076834 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-token\") pod \"9fade092-e75f-4e36-b1b8-28776aee04d1\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " Jul 10 20:49:49.077129 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.076858 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-envoy\") pod \"9fade092-e75f-4e36-b1b8-28776aee04d1\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " Jul 10 20:49:49.077129 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.076900 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fade092-e75f-4e36-b1b8-28776aee04d1-istiod-ca-cert\") pod \"9fade092-e75f-4e36-b1b8-28776aee04d1\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " Jul 10 20:49:49.077129 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.076958 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-credential-socket\") pod \"9fade092-e75f-4e36-b1b8-28776aee04d1\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " Jul 10 20:49:49.077129 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.076983 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvkb4\" (UniqueName: \"kubernetes.io/projected/9fade092-e75f-4e36-b1b8-28776aee04d1-kube-api-access-fvkb4\") pod \"9fade092-e75f-4e36-b1b8-28776aee04d1\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " Jul 10 20:49:49.077129 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.077099 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-workload-certs\") pod \"9fade092-e75f-4e36-b1b8-28776aee04d1\" (UID: \"9fade092-e75f-4e36-b1b8-28776aee04d1\") " Jul 10 20:49:49.077434 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.077126 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9fade092-e75f-4e36-b1b8-28776aee04d1" (UID: "9fade092-e75f-4e36-b1b8-28776aee04d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:49.077434 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.077258 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9fade092-e75f-4e36-b1b8-28776aee04d1" (UID: "9fade092-e75f-4e36-b1b8-28776aee04d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:49.077434 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.077374 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fade092-e75f-4e36-b1b8-28776aee04d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9fade092-e75f-4e36-b1b8-28776aee04d1" (UID: "9fade092-e75f-4e36-b1b8-28776aee04d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:49:49.077596 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.077441 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9fade092-e75f-4e36-b1b8-28776aee04d1" (UID: "9fade092-e75f-4e36-b1b8-28776aee04d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:49.077596 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.077502 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fade092-e75f-4e36-b1b8-28776aee04d1-istiod-ca-cert\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:49.077596 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.077518 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-credential-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:49.077596 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.077531 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-workload-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:49.077791 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.077749 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "9fade092-e75f-4e36-b1b8-28776aee04d1" (UID: "9fade092-e75f-4e36-b1b8-28776aee04d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:49.079361 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.079329 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9fade092-e75f-4e36-b1b8-28776aee04d1" (UID: "9fade092-e75f-4e36-b1b8-28776aee04d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:49:49.079583 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.079561 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "9fade092-e75f-4e36-b1b8-28776aee04d1" (UID: "9fade092-e75f-4e36-b1b8-28776aee04d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:49:49.079676 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.079656 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9fade092-e75f-4e36-b1b8-28776aee04d1" (UID: "9fade092-e75f-4e36-b1b8-28776aee04d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 20:49:49.079721 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.079700 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fade092-e75f-4e36-b1b8-28776aee04d1-kube-api-access-fvkb4" (OuterVolumeSpecName: "kube-api-access-fvkb4") pod "9fade092-e75f-4e36-b1b8-28776aee04d1" (UID: "9fade092-e75f-4e36-b1b8-28776aee04d1"). InnerVolumeSpecName "kube-api-access-fvkb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:49:49.088147 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.088119 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:49.178665 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.178630 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-workload-certs\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:49.178822 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.178660 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-podinfo\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:49.178822 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.178717 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-data\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:49.178822 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.178730 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-token\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:49.178822 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.178738 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fade092-e75f-4e36-b1b8-28776aee04d1-istio-envoy\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:49.178822 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.178746 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvkb4\" (UniqueName: \"kubernetes.io/projected/9fade092-e75f-4e36-b1b8-28776aee04d1-kube-api-access-fvkb4\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:49:49.188408 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.188379 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:49.553993 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.553956 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:49.652482 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.652436 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:49.684010 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.683973 2566 generic.go:356] "Generic (PLEG): container finished" podID="9fade092-e75f-4e36-b1b8-28776aee04d1" containerID="e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c" exitCode=0 Jul 10 20:49:49.684196 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.684016 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" Jul 10 20:49:49.684196 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.684074 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" event={"ID":"9fade092-e75f-4e36-b1b8-28776aee04d1","Type":"ContainerDied","Data":"e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c"} Jul 10 20:49:49.684196 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.684129 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw" event={"ID":"9fade092-e75f-4e36-b1b8-28776aee04d1","Type":"ContainerDied","Data":"23c4e6320d068f35a2b9216925f6557b8cca9f8e7d877f9ffe2d8d555738a7b3"} Jul 10 20:49:49.684196 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.684154 2566 scope.go:117] "RemoveContainer" containerID="e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c" Jul 10 20:49:49.694427 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.694403 2566 scope.go:117] "RemoveContainer" containerID="e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c" Jul 10 20:49:49.694751 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:49:49.694731 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c\": container with ID starting with e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c not found: ID does not exist" containerID="e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c" Jul 10 20:49:49.694829 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.694761 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c"} err="failed to get container status \"e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c\": rpc error: code = NotFound desc = could not find container \"e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c\": container with ID starting with e54b370761afd3b4e7e612309778ab3c7151325bb45c54032abf623108f70c3c not found: ID does not exist" Jul 10 20:49:49.707483 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.707446 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw"] Jul 10 20:49:49.713037 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.713010 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a405bf62-openshift-default-697c645475-7f4jw"] Jul 10 20:49:49.752612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:49.752579 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:50.967594 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:50.967560 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fade092-e75f-4e36-b1b8-28776aee04d1" path="/var/lib/kubelet/pods/9fade092-e75f-4e36-b1b8-28776aee04d1/volumes" Jul 10 20:49:51.075371 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:51.075339 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:58.040974 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:58.040934 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:58.143588 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:58.143552 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:58.292207 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:58.292122 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:58.410263 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:58.410230 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:49:58.800644 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:49:58.800605 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:50:24.734509 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:50:24.734472 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:50:30.593213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:50:30.593168 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:50:30.699967 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:50:30.699929 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:50:30.793229 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:50:30.793174 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:50:39.655823 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:50:39.655778 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:50:46.616918 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:50:46.616885 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:50:52.725933 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:50:52.725895 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:50:52.834120 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:50:52.834047 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:50:52.930370 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:50:52.930337 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:03.458982 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:03.458934 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:04.228368 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:04.228333 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:10.369634 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:10.369598 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:10.477890 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:10.477855 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:10.572004 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:10.571964 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:10.671678 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:10.671582 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:11.400271 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:11.400238 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:11.506905 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:11.506856 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:11.599368 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:11.599321 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:13.162806 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:13.162715 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:18.865365 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:18.865329 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:18.966916 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:18.966880 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:19.505719 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:19.505682 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:22.982750 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:22.982723 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:51:22.986884 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:22.986856 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:51:22.987576 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:22.987553 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:51:22.991175 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:22.991034 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:51:25.326955 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.326922 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:25.402518 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.402487 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:25.569643 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.569612 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:25.850519 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.850485 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6"] Jul 10 20:51:25.850891 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.850875 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fade092-e75f-4e36-b1b8-28776aee04d1" containerName="istio-proxy" Jul 10 20:51:25.850891 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.850890 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fade092-e75f-4e36-b1b8-28776aee04d1" containerName="istio-proxy" Jul 10 20:51:25.851114 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.850962 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fade092-e75f-4e36-b1b8-28776aee04d1" containerName="istio-proxy" Jul 10 20:51:25.853328 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.853303 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:25.856365 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.856339 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3fe963c1-openshift-default-dockercfg-t2fr4\"" Jul 10 20:51:25.865240 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.865217 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:25.879899 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.879865 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6"] Jul 10 20:51:25.953671 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.953637 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/468f94c2-dcce-497b-8a24-6754960de803-istiod-ca-cert\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:25.953859 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.953702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-credential-socket\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:25.953859 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.953724 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-istio-envoy\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:25.953859 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.953769 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-workload-certs\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:25.953859 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.953801 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/468f94c2-dcce-497b-8a24-6754960de803-istio-token\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:25.953859 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.953827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/468f94c2-dcce-497b-8a24-6754960de803-istio-podinfo\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:25.954073 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.953866 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqh5g\" (UniqueName: \"kubernetes.io/projected/468f94c2-dcce-497b-8a24-6754960de803-kube-api-access-hqh5g\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:25.954073 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.953913 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-workload-socket\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:25.954073 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:25.953948 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-istio-data\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055094 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055012 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/468f94c2-dcce-497b-8a24-6754960de803-istiod-ca-cert\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055119 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-credential-socket\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055143 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-istio-envoy\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055182 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-workload-certs\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/468f94c2-dcce-497b-8a24-6754960de803-istio-token\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/468f94c2-dcce-497b-8a24-6754960de803-istio-podinfo\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055255 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqh5g\" (UniqueName: \"kubernetes.io/projected/468f94c2-dcce-497b-8a24-6754960de803-kube-api-access-hqh5g\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055281 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-workload-socket\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055656 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-istio-data\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055656 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055534 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-credential-socket\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055656 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055614 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-workload-certs\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055820 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055681 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-istio-data\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055820 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055770 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/468f94c2-dcce-497b-8a24-6754960de803-istiod-ca-cert\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.055909 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.055833 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-workload-socket\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.057699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.057677 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-istio-envoy\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.058006 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.057988 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/468f94c2-dcce-497b-8a24-6754960de803-istio-podinfo\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.083436 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.083397 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/468f94c2-dcce-497b-8a24-6754960de803-istio-token\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.083602 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.083559 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqh5g\" (UniqueName: \"kubernetes.io/projected/468f94c2-dcce-497b-8a24-6754960de803-kube-api-access-hqh5g\") pod \"e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.085932 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.085890 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:26.165374 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.165273 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:26.313122 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.313091 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6"] Jul 10 20:51:26.315019 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:51:26.314989 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod468f94c2_dcce_497b_8a24_6754960de803.slice/crio-e1a545da6a01b5deabda95967015ab99017386a8239918e492bbeca784074407 WatchSource:0}: Error finding container e1a545da6a01b5deabda95967015ab99017386a8239918e492bbeca784074407: Status 404 returned error can't find the container with id e1a545da6a01b5deabda95967015ab99017386a8239918e492bbeca784074407 Jul 10 20:51:26.317262 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.317226 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:51:26.317346 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.317323 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:51:26.317388 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:26.317361 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:51:27.151231 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:27.151192 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" event={"ID":"468f94c2-dcce-497b-8a24-6754960de803","Type":"ContainerStarted","Data":"359db4635d26b8c95f8d3ff3014282aa15325868399843a3aac679d12a2423ca"} Jul 10 20:51:27.151670 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:27.151254 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" event={"ID":"468f94c2-dcce-497b-8a24-6754960de803","Type":"ContainerStarted","Data":"e1a545da6a01b5deabda95967015ab99017386a8239918e492bbeca784074407"} Jul 10 20:51:27.166471 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:27.166437 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:27.171433 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:27.171405 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:27.175597 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:27.175544 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" podStartSLOduration=2.175528206 podStartE2EDuration="2.175528206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:51:27.172906458 +0000 UTC m=+1804.791339485" watchObservedRunningTime="2026-07-10 20:51:27.175528206 +0000 UTC m=+1804.793961209" Jul 10 20:51:28.155766 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:28.155738 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:28.156867 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:28.156842 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:29.086436 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:29.086401 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:29.172194 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:29.172163 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:29.245351 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:29.245313 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:29.397381 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:29.397298 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:29.767899 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:29.767856 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:29.917561 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:29.917524 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:33.533853 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:33.533812 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:34.168248 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:34.168202 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:34.232773 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:34.232739 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:34.602668 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:34.602637 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:40.245458 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:40.245422 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:40.309270 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:40.309230 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:40.726814 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:40.726754 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:41.141015 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:41.140930 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:41.204996 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:41.204957 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:43.157618 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:43.157578 2566 patch_prober.go:28] interesting pod/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 10 20:51:43.158136 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:43.157654 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" podUID="468f94c2-dcce-497b-8a24-6754960de803" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 10 20:51:43.231587 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:43.231549 2566 generic.go:356] "Generic (PLEG): container finished" podID="468f94c2-dcce-497b-8a24-6754960de803" containerID="359db4635d26b8c95f8d3ff3014282aa15325868399843a3aac679d12a2423ca" exitCode=0 Jul 10 20:51:43.231763 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:43.231624 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" event={"ID":"468f94c2-dcce-497b-8a24-6754960de803","Type":"ContainerDied","Data":"359db4635d26b8c95f8d3ff3014282aa15325868399843a3aac679d12a2423ca"} Jul 10 20:51:43.232087 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:43.232046 2566 scope.go:117] "RemoveContainer" containerID="359db4635d26b8c95f8d3ff3014282aa15325868399843a3aac679d12a2423ca" Jul 10 20:51:43.233149 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:43.233123 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:51:43.233198 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:43.233188 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:51:43.233240 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:43.233218 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:51:44.238117 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:44.238076 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" event={"ID":"468f94c2-dcce-497b-8a24-6754960de803","Type":"ContainerStarted","Data":"bb8cc2af1766e8224c87da754e5aa3fa030f855178bd4706fc9bcdde4a75d1a4"} Jul 10 20:51:45.166046 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:45.165998 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:45.166253 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:45.166170 2566 patch_prober.go:28] interesting pod/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 10 20:51:45.166253 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:45.166221 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" podUID="468f94c2-dcce-497b-8a24-6754960de803" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 10 20:51:46.166627 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:46.166585 2566 patch_prober.go:28] interesting pod/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 10 20:51:46.167086 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:46.166662 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" podUID="468f94c2-dcce-497b-8a24-6754960de803" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 10 20:51:47.031358 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:47.031313 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:47.103742 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:47.103702 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:47.165978 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:47.165938 2566 patch_prober.go:28] interesting pod/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 10 20:51:47.166205 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:47.166168 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" podUID="468f94c2-dcce-497b-8a24-6754960de803" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 10 20:51:47.273083 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:47.273029 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6"] Jul 10 20:51:47.274028 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:47.274000 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" podUID="468f94c2-dcce-497b-8a24-6754960de803" containerName="istio-proxy" containerID="cri-o://bb8cc2af1766e8224c87da754e5aa3fa030f855178bd4706fc9bcdde4a75d1a4" gracePeriod=30 Jul 10 20:51:47.283421 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:47.283329 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:47.492612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:47.492577 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:47.607081 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:47.606986 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:47.709995 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:47.709965 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:47.806612 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:47.806579 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:53.303827 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.303792 2566 generic.go:356] "Generic (PLEG): container finished" podID="468f94c2-dcce-497b-8a24-6754960de803" containerID="bb8cc2af1766e8224c87da754e5aa3fa030f855178bd4706fc9bcdde4a75d1a4" exitCode=0 Jul 10 20:51:53.304312 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.303846 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" event={"ID":"468f94c2-dcce-497b-8a24-6754960de803","Type":"ContainerDied","Data":"bb8cc2af1766e8224c87da754e5aa3fa030f855178bd4706fc9bcdde4a75d1a4"} Jul 10 20:51:53.304312 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.303902 2566 scope.go:117] "RemoveContainer" containerID="359db4635d26b8c95f8d3ff3014282aa15325868399843a3aac679d12a2423ca" Jul 10 20:51:53.352008 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.351981 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:53.445360 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.445326 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-workload-certs\") pod \"468f94c2-dcce-497b-8a24-6754960de803\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " Jul 10 20:51:53.445557 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.445391 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-istio-data\") pod \"468f94c2-dcce-497b-8a24-6754960de803\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " Jul 10 20:51:53.445557 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.445440 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/468f94c2-dcce-497b-8a24-6754960de803-istiod-ca-cert\") pod \"468f94c2-dcce-497b-8a24-6754960de803\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " Jul 10 20:51:53.445557 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.445469 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/468f94c2-dcce-497b-8a24-6754960de803-istio-podinfo\") pod \"468f94c2-dcce-497b-8a24-6754960de803\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " Jul 10 20:51:53.445557 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.445495 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-workload-socket\") pod \"468f94c2-dcce-497b-8a24-6754960de803\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " Jul 10 20:51:53.445557 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.445556 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-credential-socket\") pod \"468f94c2-dcce-497b-8a24-6754960de803\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " Jul 10 20:51:53.445831 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.445584 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-istio-envoy\") pod \"468f94c2-dcce-497b-8a24-6754960de803\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " Jul 10 20:51:53.445831 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.445643 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqh5g\" (UniqueName: \"kubernetes.io/projected/468f94c2-dcce-497b-8a24-6754960de803-kube-api-access-hqh5g\") pod \"468f94c2-dcce-497b-8a24-6754960de803\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " Jul 10 20:51:53.445831 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.445656 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "468f94c2-dcce-497b-8a24-6754960de803" (UID: "468f94c2-dcce-497b-8a24-6754960de803"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:51:53.445831 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.445741 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/468f94c2-dcce-497b-8a24-6754960de803-istio-token\") pod \"468f94c2-dcce-497b-8a24-6754960de803\" (UID: \"468f94c2-dcce-497b-8a24-6754960de803\") " Jul 10 20:51:53.446018 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.445889 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/468f94c2-dcce-497b-8a24-6754960de803-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "468f94c2-dcce-497b-8a24-6754960de803" (UID: "468f94c2-dcce-497b-8a24-6754960de803"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:51:53.446139 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.446119 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-workload-certs\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:51:53.446202 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.446145 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/468f94c2-dcce-497b-8a24-6754960de803-istiod-ca-cert\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:51:53.446267 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.446209 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "468f94c2-dcce-497b-8a24-6754960de803" (UID: "468f94c2-dcce-497b-8a24-6754960de803"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:51:53.446508 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.446486 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-istio-data" (OuterVolumeSpecName: "istio-data") pod "468f94c2-dcce-497b-8a24-6754960de803" (UID: "468f94c2-dcce-497b-8a24-6754960de803"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:51:53.446574 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.446553 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "468f94c2-dcce-497b-8a24-6754960de803" (UID: "468f94c2-dcce-497b-8a24-6754960de803"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:51:53.448011 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.447989 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/468f94c2-dcce-497b-8a24-6754960de803-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "468f94c2-dcce-497b-8a24-6754960de803" (UID: "468f94c2-dcce-497b-8a24-6754960de803"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 20:51:53.448137 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.448004 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/468f94c2-dcce-497b-8a24-6754960de803-kube-api-access-hqh5g" (OuterVolumeSpecName: "kube-api-access-hqh5g") pod "468f94c2-dcce-497b-8a24-6754960de803" (UID: "468f94c2-dcce-497b-8a24-6754960de803"). InnerVolumeSpecName "kube-api-access-hqh5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:51:53.448460 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.448444 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "468f94c2-dcce-497b-8a24-6754960de803" (UID: "468f94c2-dcce-497b-8a24-6754960de803"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:51:53.448574 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.448553 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/468f94c2-dcce-497b-8a24-6754960de803-istio-token" (OuterVolumeSpecName: "istio-token") pod "468f94c2-dcce-497b-8a24-6754960de803" (UID: "468f94c2-dcce-497b-8a24-6754960de803"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:51:53.547334 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.547294 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/468f94c2-dcce-497b-8a24-6754960de803-istio-token\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:51:53.547334 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.547330 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-istio-data\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:51:53.547334 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.547338 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/468f94c2-dcce-497b-8a24-6754960de803-istio-podinfo\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:51:53.547577 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.547347 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-workload-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:51:53.547577 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.547357 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-credential-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:51:53.547577 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.547366 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/468f94c2-dcce-497b-8a24-6754960de803-istio-envoy\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:51:53.547577 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.547374 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqh5g\" (UniqueName: \"kubernetes.io/projected/468f94c2-dcce-497b-8a24-6754960de803-kube-api-access-hqh5g\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:51:53.644459 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.644424 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:53.745920 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.745838 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:53.850779 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.850745 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:53.993038 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:53.993003 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:54.310030 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:54.310001 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" event={"ID":"468f94c2-dcce-497b-8a24-6754960de803","Type":"ContainerDied","Data":"e1a545da6a01b5deabda95967015ab99017386a8239918e492bbeca784074407"} Jul 10 20:51:54.310030 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:54.310033 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6" Jul 10 20:51:54.310544 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:54.310087 2566 scope.go:117] "RemoveContainer" containerID="bb8cc2af1766e8224c87da754e5aa3fa030f855178bd4706fc9bcdde4a75d1a4" Jul 10 20:51:54.331938 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:54.331910 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6"] Jul 10 20:51:54.336563 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:54.336537 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3fe963c1-openshift-default-5976b45b87-bb2t6"] Jul 10 20:51:54.968422 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:54.968384 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="468f94c2-dcce-497b-8a24-6754960de803" path="/var/lib/kubelet/pods/468f94c2-dcce-497b-8a24-6754960de803/volumes" Jul 10 20:51:59.791523 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:59.791488 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:51:59.891499 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:51:59.891461 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:06.400223 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.400184 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:06.685663 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.685627 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2"] Jul 10 20:52:06.686002 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.685990 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="468f94c2-dcce-497b-8a24-6754960de803" containerName="istio-proxy" Jul 10 20:52:06.686048 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.686004 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="468f94c2-dcce-497b-8a24-6754960de803" containerName="istio-proxy" Jul 10 20:52:06.686048 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.686022 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="468f94c2-dcce-497b-8a24-6754960de803" containerName="istio-proxy" Jul 10 20:52:06.686048 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.686028 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="468f94c2-dcce-497b-8a24-6754960de803" containerName="istio-proxy" Jul 10 20:52:06.686167 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.686118 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="468f94c2-dcce-497b-8a24-6754960de803" containerName="istio-proxy" Jul 10 20:52:06.686167 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.686129 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="468f94c2-dcce-497b-8a24-6754960de803" containerName="istio-proxy" Jul 10 20:52:06.689512 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.689495 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.692735 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.692705 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f59cd92e-openshift-default-dockercfg-pfwv5\"" Jul 10 20:52:06.713152 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.713120 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2"] Jul 10 20:52:06.741303 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.741260 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:06.788462 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.788421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-podinfo\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.788659 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.788571 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-workload-certs\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.788721 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.788658 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-credential-socket\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.788721 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.788689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-envoy\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.788832 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.788723 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bc761e9-bab3-4c8b-8096-02e59852450b-istiod-ca-cert\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.788832 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.788774 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-data\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.788832 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.788807 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-workload-socket\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.788980 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.788864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-token\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.788980 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.788921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzmmf\" (UniqueName: \"kubernetes.io/projected/0bc761e9-bab3-4c8b-8096-02e59852450b-kube-api-access-kzmmf\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890044 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890001 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-workload-certs\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890271 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890140 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-credential-socket\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890271 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890179 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-envoy\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890271 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890213 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bc761e9-bab3-4c8b-8096-02e59852450b-istiod-ca-cert\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890271 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890246 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-data\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890489 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890278 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-workload-socket\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890489 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-token\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890489 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890399 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzmmf\" (UniqueName: \"kubernetes.io/projected/0bc761e9-bab3-4c8b-8096-02e59852450b-kube-api-access-kzmmf\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890489 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890439 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-podinfo\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890682 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890519 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-workload-certs\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890682 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890559 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-credential-socket\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890827 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890796 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-workload-socket\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.890887 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.890819 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-data\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.891076 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.891030 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bc761e9-bab3-4c8b-8096-02e59852450b-istiod-ca-cert\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.892704 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.892684 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-envoy\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.892990 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.892970 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-podinfo\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.902242 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.902219 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-token\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.902379 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.902301 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzmmf\" (UniqueName: \"kubernetes.io/projected/0bc761e9-bab3-4c8b-8096-02e59852450b-kube-api-access-kzmmf\") pod \"e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:06.907691 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:06.907663 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:07.006531 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:07.006447 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:07.151833 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:07.151805 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2"] Jul 10 20:52:07.154228 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:52:07.154197 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc761e9_bab3_4c8b_8096_02e59852450b.slice/crio-134ea2bc8abe19cf449a609031095b22789f58c72ed00803a3d4c436a6f12a67 WatchSource:0}: Error finding container 134ea2bc8abe19cf449a609031095b22789f58c72ed00803a3d4c436a6f12a67: Status 404 returned error can't find the container with id 134ea2bc8abe19cf449a609031095b22789f58c72ed00803a3d4c436a6f12a67 Jul 10 20:52:07.156383 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:07.156342 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:52:07.156502 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:07.156427 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:52:07.156564 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:07.156498 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:52:07.374101 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:07.373974 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" event={"ID":"0bc761e9-bab3-4c8b-8096-02e59852450b","Type":"ContainerStarted","Data":"edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc"} Jul 10 20:52:07.374101 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:07.374036 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" event={"ID":"0bc761e9-bab3-4c8b-8096-02e59852450b","Type":"ContainerStarted","Data":"134ea2bc8abe19cf449a609031095b22789f58c72ed00803a3d4c436a6f12a67"} Jul 10 20:52:07.395260 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:07.395205 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" podStartSLOduration=1.395184541 podStartE2EDuration="1.395184541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:52:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:52:07.393176436 +0000 UTC m=+1845.011609465" watchObservedRunningTime="2026-07-10 20:52:07.395184541 +0000 UTC m=+1845.013617543" Jul 10 20:52:08.006959 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:08.006916 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:08.011604 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:08.011579 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:08.378595 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:08.378513 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:08.379445 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:08.379430 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:09.268343 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:09.268309 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:09.348173 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:09.348127 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:09.419582 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:09.419550 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:09.910754 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:09.910705 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:10.018400 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:10.018368 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:13.721134 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:13.721100 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:19.549764 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:19.549689 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:22.444366 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:22.444331 2566 generic.go:356] "Generic (PLEG): container finished" podID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerID="edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc" exitCode=0 Jul 10 20:52:22.444838 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:22.444386 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" event={"ID":"0bc761e9-bab3-4c8b-8096-02e59852450b","Type":"ContainerDied","Data":"edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc"} Jul 10 20:52:22.444838 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:22.444731 2566 scope.go:117] "RemoveContainer" containerID="edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc" Jul 10 20:52:22.445692 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:22.445662 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:52:22.445802 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:22.445727 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:52:22.445802 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:22.445756 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:52:23.256994 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:23.256942 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:23.357710 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:23.357613 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:23.379232 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:23.379198 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:23.461676 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:23.461625 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" event={"ID":"0bc761e9-bab3-4c8b-8096-02e59852450b","Type":"ContainerStarted","Data":"807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229"} Jul 10 20:52:24.007027 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:24.006982 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:24.008021 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:24.007998 2566 patch_prober.go:28] interesting pod/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 10 20:52:24.008120 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:24.008046 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" podUID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 10 20:52:25.007073 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:25.007028 2566 patch_prober.go:28] interesting pod/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 10 20:52:25.007491 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:25.007130 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" podUID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 10 20:52:26.007699 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:26.007661 2566 patch_prober.go:28] interesting pod/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 10 20:52:26.008189 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:26.007718 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" podUID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 10 20:52:27.007169 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:27.007128 2566 patch_prober.go:28] interesting pod/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 10 20:52:27.007355 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:27.007188 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" podUID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 10 20:52:28.011009 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:28.010979 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:28.011483 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:28.011293 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:28.012150 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:28.012132 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:52:31.656152 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:31.656115 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:31.755118 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:31.755077 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:40.918603 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:40.918571 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:41.292018 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:41.291981 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:46.959949 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:46.959913 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:51.990029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:51.989990 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:52:52.379641 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:52:52.379555 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:28.427494 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:28.427454 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:29.338601 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:29.338561 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:34.791553 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:34.791509 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:35.048280 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:35.048199 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2"] Jul 10 20:53:35.048429 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:35.048411 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" podUID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerName="istio-proxy" containerID="cri-o://807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229" gracePeriod=30 Jul 10 20:53:36.261146 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:36.261106 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:36.358138 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:36.358103 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:36.458513 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:36.458472 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:37.214819 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:37.214790 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:37.301071 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:37.301031 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:37.402832 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:37.402797 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:38.729535 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:38.729497 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:40.302807 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.302775 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:53:40.441880 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.441846 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-workload-socket\") pod \"0bc761e9-bab3-4c8b-8096-02e59852450b\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " Jul 10 20:53:40.442093 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.441907 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-token\") pod \"0bc761e9-bab3-4c8b-8096-02e59852450b\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " Jul 10 20:53:40.442093 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.441949 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-podinfo\") pod \"0bc761e9-bab3-4c8b-8096-02e59852450b\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " Jul 10 20:53:40.442093 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.441980 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-data\") pod \"0bc761e9-bab3-4c8b-8096-02e59852450b\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " Jul 10 20:53:40.442093 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442002 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-workload-certs\") pod \"0bc761e9-bab3-4c8b-8096-02e59852450b\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " Jul 10 20:53:40.442323 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442131 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-credential-socket\") pod \"0bc761e9-bab3-4c8b-8096-02e59852450b\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " Jul 10 20:53:40.442323 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442209 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0bc761e9-bab3-4c8b-8096-02e59852450b" (UID: "0bc761e9-bab3-4c8b-8096-02e59852450b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:53:40.442323 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442232 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzmmf\" (UniqueName: \"kubernetes.io/projected/0bc761e9-bab3-4c8b-8096-02e59852450b-kube-api-access-kzmmf\") pod \"0bc761e9-bab3-4c8b-8096-02e59852450b\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " Jul 10 20:53:40.442323 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442279 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bc761e9-bab3-4c8b-8096-02e59852450b-istiod-ca-cert\") pod \"0bc761e9-bab3-4c8b-8096-02e59852450b\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " Jul 10 20:53:40.442530 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442326 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-envoy\") pod \"0bc761e9-bab3-4c8b-8096-02e59852450b\" (UID: \"0bc761e9-bab3-4c8b-8096-02e59852450b\") " Jul 10 20:53:40.442530 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442370 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0bc761e9-bab3-4c8b-8096-02e59852450b" (UID: "0bc761e9-bab3-4c8b-8096-02e59852450b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:53:40.442632 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442523 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0bc761e9-bab3-4c8b-8096-02e59852450b" (UID: "0bc761e9-bab3-4c8b-8096-02e59852450b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:53:40.442722 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442692 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-workload-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:53:40.442787 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442725 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-workload-certs\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:53:40.442787 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442738 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-credential-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:53:40.442787 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442689 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bc761e9-bab3-4c8b-8096-02e59852450b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0bc761e9-bab3-4c8b-8096-02e59852450b" (UID: "0bc761e9-bab3-4c8b-8096-02e59852450b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:53:40.443137 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.442981 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-data" (OuterVolumeSpecName: "istio-data") pod "0bc761e9-bab3-4c8b-8096-02e59852450b" (UID: "0bc761e9-bab3-4c8b-8096-02e59852450b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:53:40.444442 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.444420 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-token" (OuterVolumeSpecName: "istio-token") pod "0bc761e9-bab3-4c8b-8096-02e59852450b" (UID: "0bc761e9-bab3-4c8b-8096-02e59852450b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:53:40.444610 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.444590 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc761e9-bab3-4c8b-8096-02e59852450b-kube-api-access-kzmmf" (OuterVolumeSpecName: "kube-api-access-kzmmf") pod "0bc761e9-bab3-4c8b-8096-02e59852450b" (UID: "0bc761e9-bab3-4c8b-8096-02e59852450b"). InnerVolumeSpecName "kube-api-access-kzmmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:53:40.444954 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.444934 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0bc761e9-bab3-4c8b-8096-02e59852450b" (UID: "0bc761e9-bab3-4c8b-8096-02e59852450b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:53:40.445038 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.444955 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0bc761e9-bab3-4c8b-8096-02e59852450b" (UID: "0bc761e9-bab3-4c8b-8096-02e59852450b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 20:53:40.543435 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.543393 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-data\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:53:40.543435 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.543430 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzmmf\" (UniqueName: \"kubernetes.io/projected/0bc761e9-bab3-4c8b-8096-02e59852450b-kube-api-access-kzmmf\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:53:40.543435 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.543439 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bc761e9-bab3-4c8b-8096-02e59852450b-istiod-ca-cert\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:53:40.543673 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.543450 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-envoy\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:53:40.543673 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.543458 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-token\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:53:40.543673 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.543466 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bc761e9-bab3-4c8b-8096-02e59852450b-istio-podinfo\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:53:40.835510 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.835419 2566 generic.go:356] "Generic (PLEG): container finished" podID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerID="807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229" exitCode=0 Jul 10 20:53:40.835510 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.835473 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" Jul 10 20:53:40.835718 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.835509 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" event={"ID":"0bc761e9-bab3-4c8b-8096-02e59852450b","Type":"ContainerDied","Data":"807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229"} Jul 10 20:53:40.835718 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.835558 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2" event={"ID":"0bc761e9-bab3-4c8b-8096-02e59852450b","Type":"ContainerDied","Data":"134ea2bc8abe19cf449a609031095b22789f58c72ed00803a3d4c436a6f12a67"} Jul 10 20:53:40.835718 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.835580 2566 scope.go:117] "RemoveContainer" containerID="807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229" Jul 10 20:53:40.845283 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.845262 2566 scope.go:117] "RemoveContainer" containerID="edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc" Jul 10 20:53:40.855678 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.855634 2566 scope.go:117] "RemoveContainer" containerID="807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229" Jul 10 20:53:40.856401 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:53:40.856343 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229\": container with ID starting with 807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229 not found: ID does not exist" containerID="807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229" Jul 10 20:53:40.856514 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.856415 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229"} err="failed to get container status \"807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229\": rpc error: code = NotFound desc = could not find container \"807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229\": container with ID starting with 807a292ba4fa6e60e87878161c7cf143aae828f1d72e8789921850cf558e1229 not found: ID does not exist" Jul 10 20:53:40.856514 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.856440 2566 scope.go:117] "RemoveContainer" containerID="edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc" Jul 10 20:53:40.856772 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:53:40.856752 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc\": container with ID starting with edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc not found: ID does not exist" containerID="edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc" Jul 10 20:53:40.856877 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.856778 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc"} err="failed to get container status \"edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc\": rpc error: code = NotFound desc = could not find container \"edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc\": container with ID starting with edca44353758d579618307b2e2f8e9cef68d5bb26ccc3a6f75216bb7e546d4fc not found: ID does not exist" Jul 10 20:53:40.858722 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.858684 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2"] Jul 10 20:53:40.862165 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.862143 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f59cd92e-openshift-default-bfcfbc-lffp2"] Jul 10 20:53:40.969983 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:40.969951 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc761e9-bab3-4c8b-8096-02e59852450b" path="/var/lib/kubelet/pods/0bc761e9-bab3-4c8b-8096-02e59852450b/volumes" Jul 10 20:53:44.485184 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:44.485150 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:44.584273 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:44.584237 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:45.133193 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:45.133160 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:50.994615 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:50.994576 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:51.103614 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:51.103571 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:53:51.195428 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:53:51.195386 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:01.694240 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:01.694196 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:02.000375 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:02.000271 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:22.913565 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:22.913472 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:28.599646 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:28.599607 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:28.699632 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:28.699590 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:28.926416 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:28.926322 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:29.210113 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.210072 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc"] Jul 10 20:54:29.210644 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.210626 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerName="istio-proxy" Jul 10 20:54:29.210707 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.210648 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerName="istio-proxy" Jul 10 20:54:29.210707 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.210660 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerName="istio-proxy" Jul 10 20:54:29.210707 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.210668 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerName="istio-proxy" Jul 10 20:54:29.210810 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.210782 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerName="istio-proxy" Jul 10 20:54:29.210810 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.210793 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc761e9-bab3-4c8b-8096-02e59852450b" containerName="istio-proxy" Jul 10 20:54:29.213762 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.213742 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.216443 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.216423 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-de7153-openshift-default-dockercfg-x2gk2\"" Jul 10 20:54:29.225520 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.225491 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc"] Jul 10 20:54:29.236771 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.236742 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:29.307479 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.304886 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-workload-socket\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.307479 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.304997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-workload-certs\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.308320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.307775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srr56\" (UniqueName: \"kubernetes.io/projected/f712954e-579b-448f-94d1-6542b69eac15-kube-api-access-srr56\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.308320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.307860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-istio-data\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.308320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.307970 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f712954e-579b-448f-94d1-6542b69eac15-istiod-ca-cert\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.308320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.307999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f712954e-579b-448f-94d1-6542b69eac15-istio-token\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.308320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.308026 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-istio-envoy\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.308320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.308072 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-credential-socket\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.308320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.308121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f712954e-579b-448f-94d1-6542b69eac15-istio-podinfo\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409180 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409143 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-istio-data\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409401 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f712954e-579b-448f-94d1-6542b69eac15-istiod-ca-cert\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409401 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f712954e-579b-448f-94d1-6542b69eac15-istio-token\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409401 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409256 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-istio-envoy\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409401 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409275 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-credential-socket\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409401 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f712954e-579b-448f-94d1-6542b69eac15-istio-podinfo\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409401 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409362 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-workload-socket\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409716 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409405 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-workload-certs\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409716 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409445 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srr56\" (UniqueName: \"kubernetes.io/projected/f712954e-579b-448f-94d1-6542b69eac15-kube-api-access-srr56\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409716 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409625 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-istio-data\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409863 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409728 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-credential-socket\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409905 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409880 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-workload-certs\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.409973 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409957 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-workload-socket\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.410019 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.409999 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f712954e-579b-448f-94d1-6542b69eac15-istiod-ca-cert\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.412422 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.412390 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-istio-envoy\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.412531 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.412494 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f712954e-579b-448f-94d1-6542b69eac15-istio-podinfo\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.417210 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.417189 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f712954e-579b-448f-94d1-6542b69eac15-istio-token\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.417654 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.417635 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srr56\" (UniqueName: \"kubernetes.io/projected/f712954e-579b-448f-94d1-6542b69eac15-kube-api-access-srr56\") pod \"e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.425556 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.425523 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:29.526365 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.526274 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:29.673396 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.673368 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc"] Jul 10 20:54:29.676002 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:54:29.675968 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf712954e_579b_448f_94d1_6542b69eac15.slice/crio-aea8c657db1345e0e22d2950a8834d2e0acecec726a478497d6b0ea7771f6259 WatchSource:0}: Error finding container aea8c657db1345e0e22d2950a8834d2e0acecec726a478497d6b0ea7771f6259: Status 404 returned error can't find the container with id aea8c657db1345e0e22d2950a8834d2e0acecec726a478497d6b0ea7771f6259 Jul 10 20:54:29.678579 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.678537 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:54:29.678674 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.678626 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:54:29.678674 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:29.678667 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:54:30.078213 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:30.078174 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" event={"ID":"f712954e-579b-448f-94d1-6542b69eac15","Type":"ContainerStarted","Data":"0cc21ebbfec304ba3baca7f173e8961e41b953c7998a86845ecb8be107ce2a55"} Jul 10 20:54:30.078423 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:30.078237 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" event={"ID":"f712954e-579b-448f-94d1-6542b69eac15","Type":"ContainerStarted","Data":"aea8c657db1345e0e22d2950a8834d2e0acecec726a478497d6b0ea7771f6259"} Jul 10 20:54:30.098585 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:30.098528 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" podStartSLOduration=1.0985044 podStartE2EDuration="1.0985044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:54:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:54:30.097569256 +0000 UTC m=+1987.716002272" watchObservedRunningTime="2026-07-10 20:54:30.0985044 +0000 UTC m=+1987.716937418" Jul 10 20:54:30.527362 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:30.527323 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:30.529106 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:30.529048 2566 patch_prober.go:28] interesting pod/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 10 20:54:30.529249 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:30.529139 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 10 20:54:31.531525 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:31.531491 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:31.982199 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:31.982165 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:32.088390 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:32.088353 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:32.089381 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:32.089357 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:32.385938 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:32.385833 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:32.489379 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:32.489339 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:32.656226 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:32.656129 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:32.758766 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:32.758734 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:36.451830 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:36.451798 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:36.766788 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:36.766690 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:37.050204 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.050112 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp"] Jul 10 20:54:37.054163 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.054130 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.056721 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.056692 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-0b0cab-openshift-default-dockercfg-vjvdv\"" Jul 10 20:54:37.066584 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.066548 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp"] Jul 10 20:54:37.073694 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.073651 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:37.086552 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.086507 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822d0876-c879-4a0f-8480-61900cce8fde-istio-podinfo\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.086552 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.086557 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-istio-envoy\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.086823 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.086609 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/822d0876-c879-4a0f-8480-61900cce8fde-istiod-ca-cert\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.086823 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.086726 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-workload-certs\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.086944 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.086824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf9qz\" (UniqueName: \"kubernetes.io/projected/822d0876-c879-4a0f-8480-61900cce8fde-kube-api-access-tf9qz\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.086944 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.086879 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-credential-socket\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.086944 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.086919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-istio-data\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.087143 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.086954 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-workload-socket\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.087203 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.087151 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/822d0876-c879-4a0f-8480-61900cce8fde-istio-token\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.188010 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.187968 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/822d0876-c879-4a0f-8480-61900cce8fde-istio-token\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.188206 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.188021 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822d0876-c879-4a0f-8480-61900cce8fde-istio-podinfo\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.188294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.188268 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-istio-envoy\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.188346 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.188326 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/822d0876-c879-4a0f-8480-61900cce8fde-istiod-ca-cert\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.188409 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.188369 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-workload-certs\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.188409 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.188396 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf9qz\" (UniqueName: \"kubernetes.io/projected/822d0876-c879-4a0f-8480-61900cce8fde-kube-api-access-tf9qz\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.188510 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.188437 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-credential-socket\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.188510 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.188474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-istio-data\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.188605 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.188506 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-workload-socket\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.188835 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.188797 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-workload-certs\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.188931 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.188870 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-istio-data\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.188931 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.188900 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-workload-socket\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.189095 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.189075 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-credential-socket\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.189219 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.189202 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/822d0876-c879-4a0f-8480-61900cce8fde-istiod-ca-cert\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.190871 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.190844 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-istio-envoy\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.191272 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.191253 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822d0876-c879-4a0f-8480-61900cce8fde-istio-podinfo\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.201253 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.201227 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/822d0876-c879-4a0f-8480-61900cce8fde-istio-token\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.201497 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.201474 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf9qz\" (UniqueName: \"kubernetes.io/projected/822d0876-c879-4a0f-8480-61900cce8fde-kube-api-access-tf9qz\") pod \"e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.367779 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.367678 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:37.523889 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.523733 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:37.525909 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.525873 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp"] Jul 10 20:54:37.534490 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:54:37.534460 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822d0876_c879_4a0f_8480_61900cce8fde.slice/crio-fafa86ef482ec609dcad34b73456ceb4d55b53cac3fd143ded29320e7709a003 WatchSource:0}: Error finding container fafa86ef482ec609dcad34b73456ceb4d55b53cac3fd143ded29320e7709a003: Status 404 returned error can't find the container with id fafa86ef482ec609dcad34b73456ceb4d55b53cac3fd143ded29320e7709a003 Jul 10 20:54:37.536681 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.536644 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:54:37.536796 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.536725 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:54:37.536796 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:37.536770 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:54:38.119621 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:38.119585 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" event={"ID":"822d0876-c879-4a0f-8480-61900cce8fde","Type":"ContainerStarted","Data":"84a5bdcbe256783811c9aa038ce4f0e79fa007e4213ab594aa5d0dd91e4ede66"} Jul 10 20:54:38.119850 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:38.119642 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" event={"ID":"822d0876-c879-4a0f-8480-61900cce8fde","Type":"ContainerStarted","Data":"fafa86ef482ec609dcad34b73456ceb4d55b53cac3fd143ded29320e7709a003"} Jul 10 20:54:38.140392 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:38.140337 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" podStartSLOduration=1.140318521 podStartE2EDuration="1.140318521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:54:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:54:38.138894734 +0000 UTC m=+1995.757327758" watchObservedRunningTime="2026-07-10 20:54:38.140318521 +0000 UTC m=+1995.758751523" Jul 10 20:54:38.368337 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:38.368298 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:38.373562 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:38.373486 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:39.125355 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:39.125324 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:39.126301 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:39.126281 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:40.019488 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:40.019436 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:40.108990 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:40.108955 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:40.215784 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:40.215727 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:40.359778 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:40.359676 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:40.689544 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:40.689503 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:40.794202 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:40.794168 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:44.499069 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:44.499013 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:48.130274 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:48.130228 2566 patch_prober.go:28] interesting pod/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 20:54:48.130644 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:48.130326 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 20:54:49.196632 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:49.196598 2566 generic.go:356] "Generic (PLEG): container finished" podID="f712954e-579b-448f-94d1-6542b69eac15" containerID="0cc21ebbfec304ba3baca7f173e8961e41b953c7998a86845ecb8be107ce2a55" exitCode=0 Jul 10 20:54:49.197049 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:49.196670 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" event={"ID":"f712954e-579b-448f-94d1-6542b69eac15","Type":"ContainerDied","Data":"0cc21ebbfec304ba3baca7f173e8961e41b953c7998a86845ecb8be107ce2a55"} Jul 10 20:54:49.197167 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:49.197151 2566 scope.go:117] "RemoveContainer" containerID="0cc21ebbfec304ba3baca7f173e8961e41b953c7998a86845ecb8be107ce2a55" Jul 10 20:54:49.198314 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:49.198285 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:54:49.198392 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:49.198361 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:54:49.198432 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:49.198392 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:54:50.203800 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:50.203767 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" event={"ID":"f712954e-579b-448f-94d1-6542b69eac15","Type":"ContainerStarted","Data":"c092a2f69626d1a43ae4d379cad51848a9d17646b065d336bfaa2fabc8a7e787"} Jul 10 20:54:50.526910 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:50.526812 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:50.527095 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:50.526926 2566 patch_prober.go:28] interesting pod/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 10 20:54:50.527095 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:50.526962 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 10 20:54:51.527708 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:51.527666 2566 patch_prober.go:28] interesting pod/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 10 20:54:51.528137 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:51.527724 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 10 20:54:52.527050 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:52.527008 2566 patch_prober.go:28] interesting pod/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 10 20:54:52.527245 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:52.527100 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 10 20:54:53.527148 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:53.527103 2566 patch_prober.go:28] interesting pod/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 10 20:54:53.527678 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:53.527162 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 10 20:54:53.646369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:53.646334 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:53.758028 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:53.757984 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:54.531116 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:54.531081 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:54.531526 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:54.531367 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:54.532102 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:54.532086 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:54:54.905354 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:54.904769 2566 patch_prober.go:28] interesting pod/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": read tcp 10.134.0.2:45986->10.134.0.38:15021: read: connection reset by peer" start-of-body= Jul 10 20:54:54.905354 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:54.904836 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" podUID="822d0876-c879-4a0f-8480-61900cce8fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": read tcp 10.134.0.2:45986->10.134.0.38:15021: read: connection reset by peer" Jul 10 20:54:55.231225 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:55.231190 2566 generic.go:356] "Generic (PLEG): container finished" podID="822d0876-c879-4a0f-8480-61900cce8fde" containerID="84a5bdcbe256783811c9aa038ce4f0e79fa007e4213ab594aa5d0dd91e4ede66" exitCode=0 Jul 10 20:54:55.231424 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:55.231264 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" event={"ID":"822d0876-c879-4a0f-8480-61900cce8fde","Type":"ContainerDied","Data":"84a5bdcbe256783811c9aa038ce4f0e79fa007e4213ab594aa5d0dd91e4ede66"} Jul 10 20:54:55.231826 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:55.231804 2566 scope.go:117] "RemoveContainer" containerID="84a5bdcbe256783811c9aa038ce4f0e79fa007e4213ab594aa5d0dd91e4ede66" Jul 10 20:54:55.232820 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:55.232791 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:54:55.232914 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:55.232879 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:54:55.232976 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:55.232931 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:54:56.238749 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:56.238714 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" event={"ID":"822d0876-c879-4a0f-8480-61900cce8fde","Type":"ContainerStarted","Data":"d786afe06fa38e37f298426e0962a5c82fe16980d3edcf52c7192ef3bfe35cb5"} Jul 10 20:54:56.368917 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:56.368875 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:54:56.369178 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:56.369156 2566 patch_prober.go:28] interesting pod/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 10 20:54:56.369229 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:56.369207 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" podUID="822d0876-c879-4a0f-8480-61900cce8fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 10 20:54:57.368330 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:57.368291 2566 patch_prober.go:28] interesting pod/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 10 20:54:57.368728 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:57.368354 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" podUID="822d0876-c879-4a0f-8480-61900cce8fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 10 20:54:57.871797 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:57.871746 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:54:58.369012 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:58.368977 2566 patch_prober.go:28] interesting pod/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 10 20:54:58.369421 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:58.369031 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" podUID="822d0876-c879-4a0f-8480-61900cce8fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 10 20:54:59.369031 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:59.368990 2566 patch_prober.go:28] interesting pod/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 10 20:54:59.369430 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:54:59.369082 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" podUID="822d0876-c879-4a0f-8480-61900cce8fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 10 20:55:00.371817 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:00.371786 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:55:00.372295 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:00.372096 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:55:00.372890 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:00.372871 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:55:02.538317 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:02.538277 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:02.639665 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:02.639631 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:20.944450 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:20.944417 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:27.103488 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:27.103451 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:27.161651 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:27.161620 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:42.165327 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:42.165293 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:42.219619 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:42.219580 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:43.025586 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:43.025507 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:43.823457 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:43.823428 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:43.984137 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:43.984106 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:44.372707 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:44.372673 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:44.473332 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:44.473298 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:44.574375 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:44.574341 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:44.726218 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:44.726185 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:49.446994 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:49.446956 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:55:57.966983 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:55:57.966939 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:23.018035 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:23.017998 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:56:23.020881 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:23.020856 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 20:56:23.022443 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:23.022423 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:56:23.025604 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:23.025583 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 20:56:26.353862 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:26.353820 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:26.594832 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:26.594792 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc"] Jul 10 20:56:26.595120 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:26.595091 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" containerID="cri-o://c092a2f69626d1a43ae4d379cad51848a9d17646b065d336bfaa2fabc8a7e787" gracePeriod=30 Jul 10 20:56:26.619661 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:26.619575 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:26.881703 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:26.881600 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:27.156956 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:27.156877 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:27.569407 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:27.569365 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:27.693251 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:27.693218 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:27.790913 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:27.790879 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:27.963750 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:27.963715 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:31.737687 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.737651 2566 generic.go:356] "Generic (PLEG): container finished" podID="f712954e-579b-448f-94d1-6542b69eac15" containerID="c092a2f69626d1a43ae4d379cad51848a9d17646b065d336bfaa2fabc8a7e787" exitCode=0 Jul 10 20:56:31.738135 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.737716 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" event={"ID":"f712954e-579b-448f-94d1-6542b69eac15","Type":"ContainerDied","Data":"c092a2f69626d1a43ae4d379cad51848a9d17646b065d336bfaa2fabc8a7e787"} Jul 10 20:56:31.738135 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.737785 2566 scope.go:117] "RemoveContainer" containerID="0cc21ebbfec304ba3baca7f173e8961e41b953c7998a86845ecb8be107ce2a55" Jul 10 20:56:31.856275 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.856249 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:56:31.992404 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.992369 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-istio-data\") pod \"f712954e-579b-448f-94d1-6542b69eac15\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " Jul 10 20:56:31.992617 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.992421 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f712954e-579b-448f-94d1-6542b69eac15-istio-podinfo\") pod \"f712954e-579b-448f-94d1-6542b69eac15\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " Jul 10 20:56:31.992617 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.992457 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-workload-certs\") pod \"f712954e-579b-448f-94d1-6542b69eac15\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " Jul 10 20:56:31.992617 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.992509 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-credential-socket\") pod \"f712954e-579b-448f-94d1-6542b69eac15\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " Jul 10 20:56:31.992617 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.992530 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f712954e-579b-448f-94d1-6542b69eac15-istiod-ca-cert\") pod \"f712954e-579b-448f-94d1-6542b69eac15\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " Jul 10 20:56:31.992617 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.992587 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f712954e-579b-448f-94d1-6542b69eac15-istio-token\") pod \"f712954e-579b-448f-94d1-6542b69eac15\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " Jul 10 20:56:31.992617 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.992610 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-istio-envoy\") pod \"f712954e-579b-448f-94d1-6542b69eac15\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " Jul 10 20:56:31.992946 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.992663 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-workload-socket\") pod \"f712954e-579b-448f-94d1-6542b69eac15\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " Jul 10 20:56:31.992946 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.992695 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srr56\" (UniqueName: \"kubernetes.io/projected/f712954e-579b-448f-94d1-6542b69eac15-kube-api-access-srr56\") pod \"f712954e-579b-448f-94d1-6542b69eac15\" (UID: \"f712954e-579b-448f-94d1-6542b69eac15\") " Jul 10 20:56:31.992946 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.992807 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f712954e-579b-448f-94d1-6542b69eac15" (UID: "f712954e-579b-448f-94d1-6542b69eac15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:56:31.992946 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.992826 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f712954e-579b-448f-94d1-6542b69eac15" (UID: "f712954e-579b-448f-94d1-6542b69eac15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:56:31.993185 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.993013 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f712954e-579b-448f-94d1-6542b69eac15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f712954e-579b-448f-94d1-6542b69eac15" (UID: "f712954e-579b-448f-94d1-6542b69eac15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:56:31.993740 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.993555 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-istio-data" (OuterVolumeSpecName: "istio-data") pod "f712954e-579b-448f-94d1-6542b69eac15" (UID: "f712954e-579b-448f-94d1-6542b69eac15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:56:31.994029 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.993971 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f712954e-579b-448f-94d1-6542b69eac15" (UID: "f712954e-579b-448f-94d1-6542b69eac15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:56:31.994294 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.994273 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-workload-certs\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:31.994356 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.994302 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-credential-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:31.995511 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.995372 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f712954e-579b-448f-94d1-6542b69eac15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f712954e-579b-448f-94d1-6542b69eac15" (UID: "f712954e-579b-448f-94d1-6542b69eac15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 20:56:32.001711 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.995774 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f712954e-579b-448f-94d1-6542b69eac15-istio-token" (OuterVolumeSpecName: "istio-token") pod "f712954e-579b-448f-94d1-6542b69eac15" (UID: "f712954e-579b-448f-94d1-6542b69eac15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:56:32.001711 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:31.995901 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f712954e-579b-448f-94d1-6542b69eac15-kube-api-access-srr56" (OuterVolumeSpecName: "kube-api-access-srr56") pod "f712954e-579b-448f-94d1-6542b69eac15" (UID: "f712954e-579b-448f-94d1-6542b69eac15"). InnerVolumeSpecName "kube-api-access-srr56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:56:32.002137 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.002108 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f712954e-579b-448f-94d1-6542b69eac15" (UID: "f712954e-579b-448f-94d1-6542b69eac15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:56:32.095182 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.095142 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-workload-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:32.095182 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.095179 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srr56\" (UniqueName: \"kubernetes.io/projected/f712954e-579b-448f-94d1-6542b69eac15-kube-api-access-srr56\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:32.095182 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.095189 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-istio-data\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:32.095435 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.095197 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f712954e-579b-448f-94d1-6542b69eac15-istio-podinfo\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:32.095435 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.095205 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f712954e-579b-448f-94d1-6542b69eac15-istiod-ca-cert\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:32.095435 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.095214 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f712954e-579b-448f-94d1-6542b69eac15-istio-token\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:32.095435 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.095221 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f712954e-579b-448f-94d1-6542b69eac15-istio-envoy\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:32.743863 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.743837 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" Jul 10 20:56:32.743863 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.743853 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc" event={"ID":"f712954e-579b-448f-94d1-6542b69eac15","Type":"ContainerDied","Data":"aea8c657db1345e0e22d2950a8834d2e0acecec726a478497d6b0ea7771f6259"} Jul 10 20:56:32.744368 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.743939 2566 scope.go:117] "RemoveContainer" containerID="c092a2f69626d1a43ae4d379cad51848a9d17646b065d336bfaa2fabc8a7e787" Jul 10 20:56:32.765381 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.765352 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc"] Jul 10 20:56:32.769419 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.769391 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-de7153-openshift-default-85fc88bc55-gz7tc"] Jul 10 20:56:32.967569 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:32.967526 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f712954e-579b-448f-94d1-6542b69eac15" path="/var/lib/kubelet/pods/f712954e-579b-448f-94d1-6542b69eac15/volumes" Jul 10 20:56:33.336007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:33.335970 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:33.401456 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:33.401419 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:33.574418 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:33.574384 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp"] Jul 10 20:56:33.574641 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:33.574601 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" podUID="822d0876-c879-4a0f-8480-61900cce8fde" containerName="istio-proxy" containerID="cri-o://d786afe06fa38e37f298426e0962a5c82fe16980d3edcf52c7192ef3bfe35cb5" gracePeriod=30 Jul 10 20:56:33.595909 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:33.595827 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:33.904071 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:33.903960 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:34.163614 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.163528 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:34.428716 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.428684 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6"] Jul 10 20:56:34.429166 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.429147 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" Jul 10 20:56:34.429166 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.429165 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" Jul 10 20:56:34.429320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.429176 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" Jul 10 20:56:34.429320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.429183 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" Jul 10 20:56:34.429320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.429252 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" Jul 10 20:56:34.429320 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.429260 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f712954e-579b-448f-94d1-6542b69eac15" containerName="istio-proxy" Jul 10 20:56:34.432258 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.432237 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.435018 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.434994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ec0f24-openshift-default-dockercfg-dw7ww\"" Jul 10 20:56:34.445255 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.445233 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6"] Jul 10 20:56:34.458946 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.458912 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:34.578826 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.578795 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:34.619552 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.619513 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-podinfo\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.619552 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.619554 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nddk\" (UniqueName: \"kubernetes.io/projected/45e3aff3-61ba-4af0-9694-69966ef5e7ae-kube-api-access-6nddk\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.619806 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.619627 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-workload-socket\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.619806 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.619660 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-credential-socket\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.619806 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.619703 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istiod-ca-cert\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.619806 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.619778 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-workload-certs\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.619806 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.619803 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-envoy\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.620001 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.619831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-token\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.620001 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.619895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-data\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.721223 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.721111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-podinfo\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.721223 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.721166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nddk\" (UniqueName: \"kubernetes.io/projected/45e3aff3-61ba-4af0-9694-69966ef5e7ae-kube-api-access-6nddk\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.721223 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.721203 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-workload-socket\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.721223 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.721222 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-credential-socket\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.721568 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.721255 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istiod-ca-cert\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.721568 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.721328 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-workload-certs\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.721568 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.721356 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-envoy\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.721568 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.721376 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-token\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.721782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.721672 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-credential-socket\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.721782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.721712 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-workload-socket\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.721782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.721751 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-data\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.721924 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.721799 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-workload-certs\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.722101 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.722021 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-data\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.722261 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.722121 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istiod-ca-cert\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.723848 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.723826 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-envoy\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.724048 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.724030 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-podinfo\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.729653 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.729633 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-token\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.729746 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.729687 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nddk\" (UniqueName: \"kubernetes.io/projected/45e3aff3-61ba-4af0-9694-69966ef5e7ae-kube-api-access-6nddk\") pod \"e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.746692 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.746655 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:34.893713 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.893674 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6"] Jul 10 20:56:34.896089 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:56:34.896045 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e3aff3_61ba_4af0_9694_69966ef5e7ae.slice/crio-85a9079afa2bee10db2cb320079737be19eff52b6715fc989edc93e3cd1e9287 WatchSource:0}: Error finding container 85a9079afa2bee10db2cb320079737be19eff52b6715fc989edc93e3cd1e9287: Status 404 returned error can't find the container with id 85a9079afa2bee10db2cb320079737be19eff52b6715fc989edc93e3cd1e9287 Jul 10 20:56:34.898216 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.898182 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:56:34.898271 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.898253 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:56:34.898319 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:34.898284 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:56:35.764277 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:35.764235 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" event={"ID":"45e3aff3-61ba-4af0-9694-69966ef5e7ae","Type":"ContainerStarted","Data":"cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f"} Jul 10 20:56:35.764788 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:35.764304 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" event={"ID":"45e3aff3-61ba-4af0-9694-69966ef5e7ae","Type":"ContainerStarted","Data":"85a9079afa2bee10db2cb320079737be19eff52b6715fc989edc93e3cd1e9287"} Jul 10 20:56:35.786148 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:35.786091 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" podStartSLOduration=1.786073062 podStartE2EDuration="1.786073062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:56:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:56:35.78418504 +0000 UTC m=+2113.402618057" watchObservedRunningTime="2026-07-10 20:56:35.786073062 +0000 UTC m=+2113.404506056" Jul 10 20:56:36.747011 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:36.746969 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:36.751998 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:36.751969 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:36.769427 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:36.769398 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:36.770260 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:36.770240 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:37.683369 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:37.683319 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:37.781795 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:37.781759 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:37.854353 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:37.854318 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:38.230304 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.230252 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:38.330837 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.330803 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:38.430977 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.430939 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:38.782969 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.782932 2566 generic.go:356] "Generic (PLEG): container finished" podID="822d0876-c879-4a0f-8480-61900cce8fde" containerID="d786afe06fa38e37f298426e0962a5c82fe16980d3edcf52c7192ef3bfe35cb5" exitCode=0 Jul 10 20:56:38.783546 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.782995 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" event={"ID":"822d0876-c879-4a0f-8480-61900cce8fde","Type":"ContainerDied","Data":"d786afe06fa38e37f298426e0962a5c82fe16980d3edcf52c7192ef3bfe35cb5"} Jul 10 20:56:38.783546 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.783104 2566 scope.go:117] "RemoveContainer" containerID="84a5bdcbe256783811c9aa038ce4f0e79fa007e4213ab594aa5d0dd91e4ede66" Jul 10 20:56:38.842934 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.842858 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:56:38.861553 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.861520 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf9qz\" (UniqueName: \"kubernetes.io/projected/822d0876-c879-4a0f-8480-61900cce8fde-kube-api-access-tf9qz\") pod \"822d0876-c879-4a0f-8480-61900cce8fde\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " Jul 10 20:56:38.861717 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.861582 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822d0876-c879-4a0f-8480-61900cce8fde-istio-podinfo\") pod \"822d0876-c879-4a0f-8480-61900cce8fde\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " Jul 10 20:56:38.861717 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.861622 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/822d0876-c879-4a0f-8480-61900cce8fde-istiod-ca-cert\") pod \"822d0876-c879-4a0f-8480-61900cce8fde\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " Jul 10 20:56:38.861717 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.861647 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-credential-socket\") pod \"822d0876-c879-4a0f-8480-61900cce8fde\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " Jul 10 20:56:38.861717 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.861687 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-istio-envoy\") pod \"822d0876-c879-4a0f-8480-61900cce8fde\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " Jul 10 20:56:38.862865 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.861740 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/822d0876-c879-4a0f-8480-61900cce8fde-istio-token\") pod \"822d0876-c879-4a0f-8480-61900cce8fde\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " Jul 10 20:56:38.862865 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.861781 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-istio-data\") pod \"822d0876-c879-4a0f-8480-61900cce8fde\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " Jul 10 20:56:38.862865 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.861812 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-workload-certs\") pod \"822d0876-c879-4a0f-8480-61900cce8fde\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " Jul 10 20:56:38.862865 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.861851 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-workload-socket\") pod \"822d0876-c879-4a0f-8480-61900cce8fde\" (UID: \"822d0876-c879-4a0f-8480-61900cce8fde\") " Jul 10 20:56:38.862865 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.862098 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "822d0876-c879-4a0f-8480-61900cce8fde" (UID: "822d0876-c879-4a0f-8480-61900cce8fde"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:56:38.862865 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.862228 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/822d0876-c879-4a0f-8480-61900cce8fde-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "822d0876-c879-4a0f-8480-61900cce8fde" (UID: "822d0876-c879-4a0f-8480-61900cce8fde"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:56:38.862865 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.862379 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/822d0876-c879-4a0f-8480-61900cce8fde-istiod-ca-cert\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:38.862865 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.862401 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-credential-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:38.863882 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.863465 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-istio-data" (OuterVolumeSpecName: "istio-data") pod "822d0876-c879-4a0f-8480-61900cce8fde" (UID: "822d0876-c879-4a0f-8480-61900cce8fde"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:56:38.863882 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.863589 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "822d0876-c879-4a0f-8480-61900cce8fde" (UID: "822d0876-c879-4a0f-8480-61900cce8fde"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:56:38.863882 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.863599 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "822d0876-c879-4a0f-8480-61900cce8fde" (UID: "822d0876-c879-4a0f-8480-61900cce8fde"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:56:38.865128 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.865091 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/822d0876-c879-4a0f-8480-61900cce8fde-kube-api-access-tf9qz" (OuterVolumeSpecName: "kube-api-access-tf9qz") pod "822d0876-c879-4a0f-8480-61900cce8fde" (UID: "822d0876-c879-4a0f-8480-61900cce8fde"). InnerVolumeSpecName "kube-api-access-tf9qz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:56:38.865979 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.865950 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "822d0876-c879-4a0f-8480-61900cce8fde" (UID: "822d0876-c879-4a0f-8480-61900cce8fde"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:56:38.866304 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.866281 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/822d0876-c879-4a0f-8480-61900cce8fde-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "822d0876-c879-4a0f-8480-61900cce8fde" (UID: "822d0876-c879-4a0f-8480-61900cce8fde"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 20:56:38.866391 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.866339 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/822d0876-c879-4a0f-8480-61900cce8fde-istio-token" (OuterVolumeSpecName: "istio-token") pod "822d0876-c879-4a0f-8480-61900cce8fde" (UID: "822d0876-c879-4a0f-8480-61900cce8fde"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:56:38.963592 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.963554 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-istio-envoy\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:38.963592 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.963584 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/822d0876-c879-4a0f-8480-61900cce8fde-istio-token\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:38.963592 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.963593 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-istio-data\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:38.963592 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.963601 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-workload-certs\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:38.963863 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.963611 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/822d0876-c879-4a0f-8480-61900cce8fde-workload-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:38.963863 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.963619 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf9qz\" (UniqueName: \"kubernetes.io/projected/822d0876-c879-4a0f-8480-61900cce8fde-kube-api-access-tf9qz\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:38.963863 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:38.963630 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822d0876-c879-4a0f-8480-61900cce8fde-istio-podinfo\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:56:39.789100 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:39.789066 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" Jul 10 20:56:39.789100 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:39.789076 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp" event={"ID":"822d0876-c879-4a0f-8480-61900cce8fde","Type":"ContainerDied","Data":"fafa86ef482ec609dcad34b73456ceb4d55b53cac3fd143ded29320e7709a003"} Jul 10 20:56:39.789582 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:39.789141 2566 scope.go:117] "RemoveContainer" containerID="d786afe06fa38e37f298426e0962a5c82fe16980d3edcf52c7192ef3bfe35cb5" Jul 10 20:56:39.807140 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:39.807112 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp"] Jul 10 20:56:39.811012 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:39.810984 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-0b0cab-openshift-default-744c496c79-jjggp"] Jul 10 20:56:40.967520 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:40.967483 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="822d0876-c879-4a0f-8480-61900cce8fde" path="/var/lib/kubelet/pods/822d0876-c879-4a0f-8480-61900cce8fde/volumes" Jul 10 20:56:42.134257 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.134221 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:42.598760 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.598729 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:42.839624 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.839587 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b"] Jul 10 20:56:42.840135 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.840114 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="822d0876-c879-4a0f-8480-61900cce8fde" containerName="istio-proxy" Jul 10 20:56:42.840135 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.840134 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="822d0876-c879-4a0f-8480-61900cce8fde" containerName="istio-proxy" Jul 10 20:56:42.840322 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.840150 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="822d0876-c879-4a0f-8480-61900cce8fde" containerName="istio-proxy" Jul 10 20:56:42.840322 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.840159 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="822d0876-c879-4a0f-8480-61900cce8fde" containerName="istio-proxy" Jul 10 20:56:42.840322 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.840247 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="822d0876-c879-4a0f-8480-61900cce8fde" containerName="istio-proxy" Jul 10 20:56:42.840322 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.840261 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="822d0876-c879-4a0f-8480-61900cce8fde" containerName="istio-proxy" Jul 10 20:56:42.844993 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.844968 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:42.847582 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.847560 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-00c974-openshift-default-dockercfg-lb29b\"" Jul 10 20:56:42.856140 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.856106 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b"] Jul 10 20:56:42.866512 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.866480 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:42.901785 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.901743 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istiod-ca-cert\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:42.901785 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.901798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-credential-socket\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:42.902109 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.901886 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-podinfo\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:42.902109 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.901957 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-workload-certs\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:42.902109 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.901987 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-envoy\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:42.902109 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.902025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-workload-socket\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:42.902256 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.902105 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-data\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:42.902256 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.902136 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdq8q\" (UniqueName: \"kubernetes.io/projected/70fd4707-4ee0-4aa3-9320-c808b9006fcd-kube-api-access-rdq8q\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:42.902256 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:42.902191 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-token\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.003230 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.003177 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istiod-ca-cert\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.003230 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.003228 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-credential-socket\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.003481 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.003259 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-podinfo\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.003481 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.003289 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-workload-certs\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.003481 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.003315 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-envoy\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.003481 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.003348 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-workload-socket\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.003481 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.003388 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-data\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.003481 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.003415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdq8q\" (UniqueName: \"kubernetes.io/projected/70fd4707-4ee0-4aa3-9320-c808b9006fcd-kube-api-access-rdq8q\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.003481 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.003461 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-token\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.003945 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.003918 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-workload-socket\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.004019 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.003928 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-data\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.004152 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.004126 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-credential-socket\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.004323 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.004267 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-workload-certs\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.004658 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.004598 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istiod-ca-cert\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.006214 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.006168 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-podinfo\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.006214 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.006187 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-envoy\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.012806 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.012772 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-token\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.013271 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.013249 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdq8q\" (UniqueName: \"kubernetes.io/projected/70fd4707-4ee0-4aa3-9320-c808b9006fcd-kube-api-access-rdq8q\") pod \"e2e-api-b-00c974-openshift-default-694689859-k2j8b\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.159739 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.159643 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:43.310618 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.310586 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b"] Jul 10 20:56:43.312547 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:56:43.312519 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70fd4707_4ee0_4aa3_9320_c808b9006fcd.slice/crio-7326f7f42b134fc7301aedfb67fb807f3578c68de81bea14ab56c6c57916aa67 WatchSource:0}: Error finding container 7326f7f42b134fc7301aedfb67fb807f3578c68de81bea14ab56c6c57916aa67: Status 404 returned error can't find the container with id 7326f7f42b134fc7301aedfb67fb807f3578c68de81bea14ab56c6c57916aa67 Jul 10 20:56:43.314761 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.314715 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:56:43.314865 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.314815 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:56:43.314922 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.314869 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:56:43.427471 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.427370 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:43.811871 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.811771 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" event={"ID":"70fd4707-4ee0-4aa3-9320-c808b9006fcd","Type":"ContainerStarted","Data":"729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52"} Jul 10 20:56:43.811871 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.811839 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" event={"ID":"70fd4707-4ee0-4aa3-9320-c808b9006fcd","Type":"ContainerStarted","Data":"7326f7f42b134fc7301aedfb67fb807f3578c68de81bea14ab56c6c57916aa67"} Jul 10 20:56:43.835472 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:43.835410 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" podStartSLOduration=1.835389497 podStartE2EDuration="1.835389497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:56:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:56:43.832464361 +0000 UTC m=+2121.450897365" watchObservedRunningTime="2026-07-10 20:56:43.835389497 +0000 UTC m=+2121.453822500" Jul 10 20:56:44.160584 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:44.160491 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:44.165714 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:44.165686 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:44.817412 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:44.817382 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:44.818367 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:44.818345 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:56:45.721907 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:45.721861 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:45.817483 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:45.817450 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:45.968274 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:45.968242 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:46.267798 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:46.267755 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:46.517378 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:46.517342 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:46.620216 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:46.620128 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:50.177915 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:50.177877 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:52.811287 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:52.811233 2566 patch_prober.go:28] interesting pod/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 20:56:52.811714 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:52.811315 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 20:56:53.865351 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:53.865234 2566 generic.go:356] "Generic (PLEG): container finished" podID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerID="cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f" exitCode=0 Jul 10 20:56:53.865351 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:53.865317 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" event={"ID":"45e3aff3-61ba-4af0-9694-69966ef5e7ae","Type":"ContainerDied","Data":"cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f"} Jul 10 20:56:53.865850 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:53.865756 2566 scope.go:117] "RemoveContainer" containerID="cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f" Jul 10 20:56:53.866766 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:53.866740 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:56:53.866820 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:53.866806 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:56:53.866860 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:53.866838 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:56:54.880261 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:54.880216 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" event={"ID":"45e3aff3-61ba-4af0-9694-69966ef5e7ae","Type":"ContainerStarted","Data":"6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad"} Jul 10 20:56:55.747672 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:55.747625 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:55.747896 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:55.747764 2566 patch_prober.go:28] interesting pod/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 10 20:56:55.747896 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:55.747809 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 10 20:56:56.748069 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:56.748007 2566 patch_prober.go:28] interesting pod/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 10 20:56:56.748581 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:56.748100 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 10 20:56:57.747768 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:57.747723 2566 patch_prober.go:28] interesting pod/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 10 20:56:57.748108 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:57.748046 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 10 20:56:58.032863 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:58.032769 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:58.409482 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:58.409399 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:58.585082 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:58.584285 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:58.680689 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:58.680647 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:58.747608 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:58.747134 2566 patch_prober.go:28] interesting pod/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 10 20:56:58.747608 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:58.747203 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 10 20:56:58.853826 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:58.853785 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:56:59.753233 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:59.753199 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:59.753600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:59.753567 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:56:59.754474 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:56:59.754452 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:57:00.858283 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:00.858231 2566 patch_prober.go:28] interesting pod/e2e-api-b-00c974-openshift-default-694689859-k2j8b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 20:57:00.858793 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:00.858291 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 20:57:01.923360 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:01.923259 2566 generic.go:356] "Generic (PLEG): container finished" podID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerID="729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52" exitCode=0 Jul 10 20:57:01.923360 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:01.923327 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" event={"ID":"70fd4707-4ee0-4aa3-9320-c808b9006fcd","Type":"ContainerDied","Data":"729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52"} Jul 10 20:57:01.923916 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:01.923894 2566 scope.go:117] "RemoveContainer" containerID="729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52" Jul 10 20:57:01.925010 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:01.924976 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:01.925135 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:01.925081 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:01.925135 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:01.925119 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:02.930814 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:02.930782 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" event={"ID":"70fd4707-4ee0-4aa3-9320-c808b9006fcd","Type":"ContainerStarted","Data":"e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185"} Jul 10 20:57:03.161282 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:03.161240 2566 patch_prober.go:28] interesting pod/e2e-api-b-00c974-openshift-default-694689859-k2j8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 10 20:57:03.161593 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:03.161561 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 10 20:57:03.162151 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:03.162130 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:57:04.160570 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:04.160523 2566 patch_prober.go:28] interesting pod/e2e-api-b-00c974-openshift-default-694689859-k2j8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 10 20:57:04.161107 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:04.160606 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 10 20:57:04.374385 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:04.374339 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:04.475318 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:04.475273 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:04.608392 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:04.608354 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6"] Jul 10 20:57:04.608637 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:04.608612 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerName="istio-proxy" containerID="cri-o://6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad" gracePeriod=30 Jul 10 20:57:04.625201 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:04.625163 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:04.829394 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:04.829305 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:04.983689 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:04.983658 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:05.160814 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:05.160245 2566 patch_prober.go:28] interesting pod/e2e-api-b-00c974-openshift-default-694689859-k2j8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 10 20:57:05.160814 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:05.160352 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 10 20:57:05.376970 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:05.376927 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:05.477952 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:05.477919 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:05.577514 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:05.577478 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:05.754678 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:05.754579 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:06.160448 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:06.160347 2566 patch_prober.go:28] interesting pod/e2e-api-b-00c974-openshift-default-694689859-k2j8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 10 20:57:06.160748 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:06.160714 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 10 20:57:07.164307 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:07.164274 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:57:07.164786 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:07.164671 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:57:07.165323 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:07.165307 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:57:09.888836 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.888809 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:57:09.917570 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.917534 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-envoy\") pod \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " Jul 10 20:57:09.917773 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.917601 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istiod-ca-cert\") pod \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " Jul 10 20:57:09.917773 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.917640 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-token\") pod \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " Jul 10 20:57:09.917907 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.917809 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-workload-certs\") pod \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " Jul 10 20:57:09.917907 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.917882 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-data\") pod \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " Jul 10 20:57:09.918012 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.917935 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-workload-socket\") pod \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " Jul 10 20:57:09.918012 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.917967 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-credential-socket\") pod \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " Jul 10 20:57:09.918172 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.918098 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-podinfo\") pod \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " Jul 10 20:57:09.918172 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.918124 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nddk\" (UniqueName: \"kubernetes.io/projected/45e3aff3-61ba-4af0-9694-69966ef5e7ae-kube-api-access-6nddk\") pod \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\" (UID: \"45e3aff3-61ba-4af0-9694-69966ef5e7ae\") " Jul 10 20:57:09.918837 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.918354 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "45e3aff3-61ba-4af0-9694-69966ef5e7ae" (UID: "45e3aff3-61ba-4af0-9694-69966ef5e7ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:57:09.918837 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.918524 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-workload-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:09.918837 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.918601 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "45e3aff3-61ba-4af0-9694-69966ef5e7ae" (UID: "45e3aff3-61ba-4af0-9694-69966ef5e7ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:57:09.918837 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.918656 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "45e3aff3-61ba-4af0-9694-69966ef5e7ae" (UID: "45e3aff3-61ba-4af0-9694-69966ef5e7ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:57:09.918837 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.918805 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "45e3aff3-61ba-4af0-9694-69966ef5e7ae" (UID: "45e3aff3-61ba-4af0-9694-69966ef5e7ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:57:09.919225 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.918926 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-data" (OuterVolumeSpecName: "istio-data") pod "45e3aff3-61ba-4af0-9694-69966ef5e7ae" (UID: "45e3aff3-61ba-4af0-9694-69966ef5e7ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:57:09.920455 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.920428 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "45e3aff3-61ba-4af0-9694-69966ef5e7ae" (UID: "45e3aff3-61ba-4af0-9694-69966ef5e7ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:57:09.920694 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.920666 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e3aff3-61ba-4af0-9694-69966ef5e7ae-kube-api-access-6nddk" (OuterVolumeSpecName: "kube-api-access-6nddk") pod "45e3aff3-61ba-4af0-9694-69966ef5e7ae" (UID: "45e3aff3-61ba-4af0-9694-69966ef5e7ae"). InnerVolumeSpecName "kube-api-access-6nddk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:57:09.920902 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.920886 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "45e3aff3-61ba-4af0-9694-69966ef5e7ae" (UID: "45e3aff3-61ba-4af0-9694-69966ef5e7ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:57:09.921039 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.921017 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "45e3aff3-61ba-4af0-9694-69966ef5e7ae" (UID: "45e3aff3-61ba-4af0-9694-69966ef5e7ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 20:57:09.969334 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.969301 2566 generic.go:356] "Generic (PLEG): container finished" podID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerID="6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad" exitCode=0 Jul 10 20:57:09.969509 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.969346 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" event={"ID":"45e3aff3-61ba-4af0-9694-69966ef5e7ae","Type":"ContainerDied","Data":"6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad"} Jul 10 20:57:09.969509 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.969357 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" Jul 10 20:57:09.969509 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.969390 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6" event={"ID":"45e3aff3-61ba-4af0-9694-69966ef5e7ae","Type":"ContainerDied","Data":"85a9079afa2bee10db2cb320079737be19eff52b6715fc989edc93e3cd1e9287"} Jul 10 20:57:09.969509 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.969411 2566 scope.go:117] "RemoveContainer" containerID="6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad" Jul 10 20:57:09.979040 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.979014 2566 scope.go:117] "RemoveContainer" containerID="cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f" Jul 10 20:57:09.990748 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.990714 2566 scope.go:117] "RemoveContainer" containerID="6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad" Jul 10 20:57:09.992727 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:57:09.992366 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad\": container with ID starting with 6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad not found: ID does not exist" containerID="6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad" Jul 10 20:57:09.992727 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.992416 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad"} err="failed to get container status \"6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad\": rpc error: code = NotFound desc = could not find container \"6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad\": container with ID starting with 6a238a0cd680ffbef60363813048cc1b7ccf48d6152c4bf66217bf96765789ad not found: ID does not exist" Jul 10 20:57:09.992727 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.992441 2566 scope.go:117] "RemoveContainer" containerID="cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f" Jul 10 20:57:09.993361 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:57:09.993331 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f\": container with ID starting with cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f not found: ID does not exist" containerID="cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f" Jul 10 20:57:09.993491 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.993367 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f"} err="failed to get container status \"cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f\": rpc error: code = NotFound desc = could not find container \"cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f\": container with ID starting with cbd2797e8ca2bd1a413ee51a9995ab56755460d225eb66b07a71d219df1f103f not found: ID does not exist" Jul 10 20:57:09.997922 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:09.997892 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6"] Jul 10 20:57:10.000835 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:10.000802 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ec0f24-openshift-default-649b99fcf5-dmpb6"] Jul 10 20:57:10.019963 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:10.019926 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-credential-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:10.019963 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:10.019960 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-podinfo\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:10.019963 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:10.019972 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nddk\" (UniqueName: \"kubernetes.io/projected/45e3aff3-61ba-4af0-9694-69966ef5e7ae-kube-api-access-6nddk\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:10.020222 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:10.019980 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-envoy\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:10.020222 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:10.019991 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istiod-ca-cert\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:10.020222 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:10.019998 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-token\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:10.020222 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:10.020005 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-workload-certs\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:10.020222 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:10.020013 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e3aff3-61ba-4af0-9694-69966ef5e7ae-istio-data\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:10.968311 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:10.968278 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" path="/var/lib/kubelet/pods/45e3aff3-61ba-4af0-9694-69966ef5e7ae/volumes" Jul 10 20:57:11.180634 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:11.180599 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:11.281959 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:11.281870 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:11.409081 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:11.408704 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b"] Jul 10 20:57:11.409081 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:11.408940 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerName="istio-proxy" containerID="cri-o://e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185" gracePeriod=30 Jul 10 20:57:11.432394 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:11.432342 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:11.652196 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:11.652096 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:11.975688 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:11.975657 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:12.243208 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.243047 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv"] Jul 10 20:57:12.243525 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.243509 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerName="istio-proxy" Jul 10 20:57:12.243587 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.243528 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerName="istio-proxy" Jul 10 20:57:12.243640 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.243620 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerName="istio-proxy" Jul 10 20:57:12.243640 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.243628 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerName="istio-proxy" Jul 10 20:57:12.246837 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.246816 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.250205 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.250181 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-e560d0-openshift-default-dockercfg-zxkqq\"" Jul 10 20:57:12.263887 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.263853 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv"] Jul 10 20:57:12.274718 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.274679 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:12.343196 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.343142 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca18871-631b-4561-a381-30888f6cb31c-istio-token\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.343388 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.343231 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-istio-envoy\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.343388 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.343278 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-workload-certs\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.343388 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.343339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-istio-data\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.343388 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.343366 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-workload-socket\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.343618 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.343425 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca18871-631b-4561-a381-30888f6cb31c-istiod-ca-cert\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.343618 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.343451 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca18871-631b-4561-a381-30888f6cb31c-istio-podinfo\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.343618 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.343502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b6dp\" (UniqueName: \"kubernetes.io/projected/eca18871-631b-4561-a381-30888f6cb31c-kube-api-access-5b6dp\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.343618 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.343540 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-credential-socket\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.444760 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.444718 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-workload-certs\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.444961 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.444781 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-istio-data\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.444961 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.444806 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-workload-socket\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.444961 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.444842 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca18871-631b-4561-a381-30888f6cb31c-istiod-ca-cert\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.444961 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.444858 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca18871-631b-4561-a381-30888f6cb31c-istio-podinfo\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.444961 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.444889 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b6dp\" (UniqueName: \"kubernetes.io/projected/eca18871-631b-4561-a381-30888f6cb31c-kube-api-access-5b6dp\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.444961 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.444918 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-credential-socket\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.445329 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.444974 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca18871-631b-4561-a381-30888f6cb31c-istio-token\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.445329 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.445012 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-istio-envoy\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.445329 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.445260 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-istio-data\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.445488 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.445322 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-workload-certs\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.445488 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.445389 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-workload-socket\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.445600 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.445513 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-credential-socket\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.445656 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.445598 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca18871-631b-4561-a381-30888f6cb31c-istiod-ca-cert\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.447559 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.447531 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-istio-envoy\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.447688 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.447671 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca18871-631b-4561-a381-30888f6cb31c-istio-podinfo\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.453402 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.453376 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca18871-631b-4561-a381-30888f6cb31c-istio-token\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.453402 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.453399 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b6dp\" (UniqueName: \"kubernetes.io/projected/eca18871-631b-4561-a381-30888f6cb31c-kube-api-access-5b6dp\") pod \"e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.557763 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.557652 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:12.705633 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.705601 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv"] Jul 10 20:57:12.707292 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:57:12.707261 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca18871_631b_4561_a381_30888f6cb31c.slice/crio-052bb7491303dd64599787da26821c9c77e02a0ec05b6c1c4b17242755bead1b WatchSource:0}: Error finding container 052bb7491303dd64599787da26821c9c77e02a0ec05b6c1c4b17242755bead1b: Status 404 returned error can't find the container with id 052bb7491303dd64599787da26821c9c77e02a0ec05b6c1c4b17242755bead1b Jul 10 20:57:12.709968 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.709937 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:12.710041 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.710005 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:12.710041 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.710034 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:12.831318 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.831215 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:12.986533 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.986487 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" event={"ID":"eca18871-631b-4561-a381-30888f6cb31c","Type":"ContainerStarted","Data":"735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f"} Jul 10 20:57:12.987009 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:12.986547 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" event={"ID":"eca18871-631b-4561-a381-30888f6cb31c","Type":"ContainerStarted","Data":"052bb7491303dd64599787da26821c9c77e02a0ec05b6c1c4b17242755bead1b"} Jul 10 20:57:13.008367 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:13.008304 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" podStartSLOduration=1.0082879 podStartE2EDuration="1.0082879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:57:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:57:13.005783396 +0000 UTC m=+2150.624216424" watchObservedRunningTime="2026-07-10 20:57:13.0082879 +0000 UTC m=+2150.626720988" Jul 10 20:57:13.558315 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:13.558276 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:13.563499 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:13.563469 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:13.830457 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:13.830366 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:13.991828 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:13.991791 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:13.992770 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:13.992751 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:15.020901 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:15.020860 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:15.123787 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:15.123756 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:15.277588 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:15.277504 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:15.588379 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:15.588293 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:15.690448 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:15.690412 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:16.678797 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.678770 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:57:16.791184 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791090 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-data\") pod \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " Jul 10 20:57:16.791184 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791156 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-workload-socket\") pod \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " Jul 10 20:57:16.791416 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791189 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istiod-ca-cert\") pod \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " Jul 10 20:57:16.791416 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791217 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-token\") pod \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " Jul 10 20:57:16.791416 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791347 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdq8q\" (UniqueName: \"kubernetes.io/projected/70fd4707-4ee0-4aa3-9320-c808b9006fcd-kube-api-access-rdq8q\") pod \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " Jul 10 20:57:16.791416 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791403 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-credential-socket\") pod \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " Jul 10 20:57:16.791635 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791433 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70fd4707-4ee0-4aa3-9320-c808b9006fcd" (UID: "70fd4707-4ee0-4aa3-9320-c808b9006fcd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:57:16.791635 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791519 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-workload-certs\") pod \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " Jul 10 20:57:16.791635 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791555 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-envoy\") pod \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " Jul 10 20:57:16.791635 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791595 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-podinfo\") pod \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\" (UID: \"70fd4707-4ee0-4aa3-9320-c808b9006fcd\") " Jul 10 20:57:16.791635 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791608 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70fd4707-4ee0-4aa3-9320-c808b9006fcd" (UID: "70fd4707-4ee0-4aa3-9320-c808b9006fcd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:57:16.791903 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791641 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70fd4707-4ee0-4aa3-9320-c808b9006fcd" (UID: "70fd4707-4ee0-4aa3-9320-c808b9006fcd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:57:16.791903 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791748 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70fd4707-4ee0-4aa3-9320-c808b9006fcd" (UID: "70fd4707-4ee0-4aa3-9320-c808b9006fcd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:57:16.792008 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.791958 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-data" (OuterVolumeSpecName: "istio-data") pod "70fd4707-4ee0-4aa3-9320-c808b9006fcd" (UID: "70fd4707-4ee0-4aa3-9320-c808b9006fcd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:57:16.792118 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.792098 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-workload-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:16.792183 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.792124 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istiod-ca-cert\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:16.792183 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.792139 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-credential-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:16.792183 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.792154 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-workload-certs\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:16.792183 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.792168 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-data\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:16.793808 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.793780 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70fd4707-4ee0-4aa3-9320-c808b9006fcd-kube-api-access-rdq8q" (OuterVolumeSpecName: "kube-api-access-rdq8q") pod "70fd4707-4ee0-4aa3-9320-c808b9006fcd" (UID: "70fd4707-4ee0-4aa3-9320-c808b9006fcd"). InnerVolumeSpecName "kube-api-access-rdq8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:57:16.794095 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.794024 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-token" (OuterVolumeSpecName: "istio-token") pod "70fd4707-4ee0-4aa3-9320-c808b9006fcd" (UID: "70fd4707-4ee0-4aa3-9320-c808b9006fcd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:57:16.794244 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.794224 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70fd4707-4ee0-4aa3-9320-c808b9006fcd" (UID: "70fd4707-4ee0-4aa3-9320-c808b9006fcd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:57:16.794411 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.794391 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70fd4707-4ee0-4aa3-9320-c808b9006fcd" (UID: "70fd4707-4ee0-4aa3-9320-c808b9006fcd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 20:57:16.892999 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.892957 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-podinfo\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:16.892999 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.892992 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-token\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:16.892999 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.893001 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdq8q\" (UniqueName: \"kubernetes.io/projected/70fd4707-4ee0-4aa3-9320-c808b9006fcd-kube-api-access-rdq8q\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:16.892999 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:16.893009 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70fd4707-4ee0-4aa3-9320-c808b9006fcd-istio-envoy\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 20:57:17.008385 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:17.008350 2566 generic.go:356] "Generic (PLEG): container finished" podID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerID="e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185" exitCode=0 Jul 10 20:57:17.008552 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:17.008402 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" Jul 10 20:57:17.008552 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:17.008435 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" event={"ID":"70fd4707-4ee0-4aa3-9320-c808b9006fcd","Type":"ContainerDied","Data":"e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185"} Jul 10 20:57:17.008552 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:17.008489 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b" event={"ID":"70fd4707-4ee0-4aa3-9320-c808b9006fcd","Type":"ContainerDied","Data":"7326f7f42b134fc7301aedfb67fb807f3578c68de81bea14ab56c6c57916aa67"} Jul 10 20:57:17.008552 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:17.008511 2566 scope.go:117] "RemoveContainer" containerID="e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185" Jul 10 20:57:17.017782 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:17.017766 2566 scope.go:117] "RemoveContainer" containerID="729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52" Jul 10 20:57:17.026971 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:17.026948 2566 scope.go:117] "RemoveContainer" containerID="e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185" Jul 10 20:57:17.027339 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:57:17.027312 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185\": container with ID starting with e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185 not found: ID does not exist" containerID="e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185" Jul 10 20:57:17.027449 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:17.027347 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185"} err="failed to get container status \"e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185\": rpc error: code = NotFound desc = could not find container \"e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185\": container with ID starting with e585129de76a6e919f28a1d93e5ae8bbd02562758ce12bc54ea18b7c4fc3c185 not found: ID does not exist" Jul 10 20:57:17.027449 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:17.027368 2566 scope.go:117] "RemoveContainer" containerID="729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52" Jul 10 20:57:17.027604 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:17.027586 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b"] Jul 10 20:57:17.027653 ip-10-0-130-138 kubenswrapper[2566]: E0710 20:57:17.027594 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52\": container with ID starting with 729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52 not found: ID does not exist" containerID="729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52" Jul 10 20:57:17.027653 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:17.027638 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52"} err="failed to get container status \"729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52\": rpc error: code = NotFound desc = could not find container \"729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52\": container with ID starting with 729fd133edbd32af32970614e065d8315403d53fb0d411f260c2bbe331f98f52 not found: ID does not exist" Jul 10 20:57:17.033282 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:17.033252 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-00c974-openshift-default-694689859-k2j8b"] Jul 10 20:57:18.968330 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:18.968292 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" path="/var/lib/kubelet/pods/70fd4707-4ee0-4aa3-9320-c808b9006fcd/volumes" Jul 10 20:57:19.349798 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.349653 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:19.661212 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.661111 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:19.926313 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.926228 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh"] Jul 10 20:57:19.926865 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.926847 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerName="istio-proxy" Jul 10 20:57:19.926908 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.926870 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerName="istio-proxy" Jul 10 20:57:19.926908 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.926889 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerName="istio-proxy" Jul 10 20:57:19.926908 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.926897 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e3aff3-61ba-4af0-9694-69966ef5e7ae" containerName="istio-proxy" Jul 10 20:57:19.927007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.926909 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerName="istio-proxy" Jul 10 20:57:19.927007 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.926919 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerName="istio-proxy" Jul 10 20:57:19.927082 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.927035 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerName="istio-proxy" Jul 10 20:57:19.927082 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.927048 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="70fd4707-4ee0-4aa3-9320-c808b9006fcd" containerName="istio-proxy" Jul 10 20:57:19.930628 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.930593 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:19.933573 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.933551 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-28db1d-openshift-default-dockercfg-xjbgc\"" Jul 10 20:57:19.942880 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:19.942854 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh"] Jul 10 20:57:20.007197 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.007162 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:20.026399 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.026356 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7ssv\" (UniqueName: \"kubernetes.io/projected/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-kube-api-access-l7ssv\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.026574 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.026414 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istiod-ca-cert\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.026574 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.026450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-envoy\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.026574 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.026481 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-workload-certs\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.026574 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.026521 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-workload-socket\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.026888 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.026604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-token\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.026888 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.026644 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-data\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.026888 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.026695 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-credential-socket\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.026888 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.026760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-podinfo\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.127877 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.127829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-data\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128119 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.127894 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-credential-socket\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128119 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.127922 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-podinfo\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128119 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.127956 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7ssv\" (UniqueName: \"kubernetes.io/projected/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-kube-api-access-l7ssv\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128119 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.127987 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istiod-ca-cert\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128119 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.128017 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-envoy\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128119 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.128049 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-workload-certs\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128451 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.128331 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-data\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128451 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.128410 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-workload-certs\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128527 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.128446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-workload-socket\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128576 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.128559 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-token\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128614 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.128590 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-credential-socket\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128747 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.128728 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-workload-socket\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.128811 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.128794 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istiod-ca-cert\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.130646 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.130610 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-podinfo\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.130819 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.130796 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-envoy\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.143714 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.143676 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-token\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.143884 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.143790 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7ssv\" (UniqueName: \"kubernetes.io/projected/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-kube-api-access-l7ssv\") pod \"e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.236634 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.236596 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:20.243425 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.243394 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:20.392411 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.392380 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh"] Jul 10 20:57:20.394536 ip-10-0-130-138 kubenswrapper[2566]: W0710 20:57:20.394513 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e6ba65_5c7e_4cf6_b703_b1a9432a78f0.slice/crio-0e0a8563734cd84cf167fe5a752b97102043afaf6bda43a901f41035c22be3ba WatchSource:0}: Error finding container 0e0a8563734cd84cf167fe5a752b97102043afaf6bda43a901f41035c22be3ba: Status 404 returned error can't find the container with id 0e0a8563734cd84cf167fe5a752b97102043afaf6bda43a901f41035c22be3ba Jul 10 20:57:20.396618 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.396586 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:20.396685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.396653 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:20.396685 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:20.396680 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:21.035203 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:21.035168 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" event={"ID":"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0","Type":"ContainerStarted","Data":"efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0"} Jul 10 20:57:21.035614 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:21.035218 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" event={"ID":"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0","Type":"ContainerStarted","Data":"0e0a8563734cd84cf167fe5a752b97102043afaf6bda43a901f41035c22be3ba"} Jul 10 20:57:21.056264 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:21.056210 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" podStartSLOduration=2.056194724 podStartE2EDuration="2.056194724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:57:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:57:21.053880422 +0000 UTC m=+2158.672313426" watchObservedRunningTime="2026-07-10 20:57:21.056194724 +0000 UTC m=+2158.674627726" Jul 10 20:57:21.243781 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:21.243738 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:21.248793 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:21.248766 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:22.040639 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:22.040606 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:22.041702 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:22.041681 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:22.920461 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:22.920425 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:23.021017 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:23.020986 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:23.155938 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:23.155901 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:23.360817 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:23.360783 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:23.608959 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:23.608921 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:23.710410 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:23.710378 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:24.446103 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:24.446046 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:24.546650 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:24.546599 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:25.191734 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:25.191698 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:25.293353 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:25.293314 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:27.400481 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:27.400445 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:29.307025 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:29.306992 2566 patch_prober.go:28] interesting pod/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:35930->10.134.0.41:15021: read: connection reset by peer" start-of-body= Jul 10 20:57:29.307442 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:29.307106 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" podUID="eca18871-631b-4561-a381-30888f6cb31c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:35930->10.134.0.41:15021: read: connection reset by peer" Jul 10 20:57:30.091446 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:30.091409 2566 generic.go:356] "Generic (PLEG): container finished" podID="eca18871-631b-4561-a381-30888f6cb31c" containerID="735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f" exitCode=0 Jul 10 20:57:30.091618 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:30.091464 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" event={"ID":"eca18871-631b-4561-a381-30888f6cb31c","Type":"ContainerDied","Data":"735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f"} Jul 10 20:57:30.091888 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:30.091874 2566 scope.go:117] "RemoveContainer" containerID="735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f" Jul 10 20:57:30.092964 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:30.092933 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:30.093042 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:30.093024 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:30.093119 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:30.093104 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:31.099391 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:31.099347 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" event={"ID":"eca18871-631b-4561-a381-30888f6cb31c","Type":"ContainerStarted","Data":"0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844"} Jul 10 20:57:31.558957 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:31.558904 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:31.559222 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:31.558982 2566 patch_prober.go:28] interesting pod/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 10 20:57:31.559222 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:31.559037 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" podUID="eca18871-631b-4561-a381-30888f6cb31c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 10 20:57:32.558788 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:32.558753 2566 patch_prober.go:28] interesting pod/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 10 20:57:32.559415 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:32.559373 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" podUID="eca18871-631b-4561-a381-30888f6cb31c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 10 20:57:33.559146 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:33.559096 2566 patch_prober.go:28] interesting pod/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 10 20:57:33.559651 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:33.559186 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" podUID="eca18871-631b-4561-a381-30888f6cb31c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 10 20:57:34.558195 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:34.558147 2566 patch_prober.go:28] interesting pod/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 10 20:57:34.558389 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:34.558219 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" podUID="eca18871-631b-4561-a381-30888f6cb31c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 10 20:57:35.562203 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:35.562170 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:35.562580 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:35.562559 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:35.563303 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:35.563286 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 20:57:36.432887 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:36.432849 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:36.533098 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:36.533037 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:37.042207 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:37.042128 2566 patch_prober.go:28] interesting pod/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 10 20:57:37.042207 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:37.042182 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 10 20:57:37.135037 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:37.134946 2566 generic.go:356] "Generic (PLEG): container finished" podID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerID="efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0" exitCode=0 Jul 10 20:57:37.135232 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:37.135028 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" event={"ID":"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0","Type":"ContainerDied","Data":"efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0"} Jul 10 20:57:37.135538 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:37.135519 2566 scope.go:117] "RemoveContainer" containerID="efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0" Jul 10 20:57:37.136525 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:37.136498 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:37.136587 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:37.136566 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:37.136625 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:37.136598 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 20:57:38.141793 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:38.141752 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" event={"ID":"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0","Type":"ContainerStarted","Data":"66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36"} Jul 10 20:57:38.244093 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:38.244037 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:38.244459 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:38.244436 2566 patch_prober.go:28] interesting pod/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 10 20:57:38.244623 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:38.244596 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 10 20:57:38.654288 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:38.654194 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:39.245228 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:39.244729 2566 patch_prober.go:28] interesting pod/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 10 20:57:39.245228 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:39.244806 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 10 20:57:40.244646 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:40.244192 2566 patch_prober.go:28] interesting pod/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 10 20:57:40.244646 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:40.244258 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 10 20:57:41.244513 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:41.244465 2566 patch_prober.go:28] interesting pod/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 10 20:57:41.245067 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:41.244557 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 10 20:57:42.247791 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:42.247760 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:42.248316 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:42.248083 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:42.248908 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:42.248888 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 20:57:44.444777 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:44.444738 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:57:44.546133 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:57:44.546102 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:58:13.964796 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:58:13.964757 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 20:58:38.650036 ip-10-0-130-138 kubenswrapper[2566]: I0710 20:58:38.650001 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:00:33.896493 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:00:33.896393 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:00:34.724066 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:00:34.724034 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:00:55.151953 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:00:55.151918 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:01:03.574362 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:01:03.574326 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:01:15.011014 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:01:15.010972 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:01:23.053263 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:01:23.053231 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 21:01:23.057764 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:01:23.057740 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 21:01:23.058243 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:01:23.058222 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 21:01:23.062956 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:01:23.062935 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4g59x_f0e45ba7-808c-4c30-a59f-254878e2da4c/ovn-acl-logging/0.log" Jul 10 21:02:04.235703 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:02:04.235644 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:02:05.037517 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:02:05.037483 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:02:10.551852 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:02:10.551812 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:02:25.155035 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:02:25.154997 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:02:25.255296 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:02:25.255253 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:02:37.344649 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:02:37.344614 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:02:37.450169 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:02:37.450135 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:02:44.343079 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:02:44.343015 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:02:45.202324 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:02:45.202266 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:02:45.299307 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:02:45.299269 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:02:55.412525 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:02:55.412481 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:02:55.529483 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:02:55.529446 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:03:07.551493 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:07.551459 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:03:28.025727 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:28.025642 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:03:28.816217 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:28.816184 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:03:48.279707 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:48.279666 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:03:50.602496 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:50.602464 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:03:55.027798 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:55.027767 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv"] Jul 10 21:03:55.028248 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:55.027982 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" podUID="eca18871-631b-4561-a381-30888f6cb31c" containerName="istio-proxy" containerID="cri-o://0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844" gracePeriod=30 Jul 10 21:03:55.232675 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:55.232638 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:03:55.333420 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:55.333337 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:03:55.433897 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:55.433847 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:03:55.801916 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:55.801879 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:03:55.902604 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:55.902568 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:03:56.007985 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:56.007950 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:03:56.214740 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:03:56.214705 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:04:00.296903 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.296828 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 21:04:00.376964 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.376927 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-workload-socket\") pod \"eca18871-631b-4561-a381-30888f6cb31c\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " Jul 10 21:04:00.376964 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.376984 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-istio-envoy\") pod \"eca18871-631b-4561-a381-30888f6cb31c\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " Jul 10 21:04:00.377262 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377036 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-workload-certs\") pod \"eca18871-631b-4561-a381-30888f6cb31c\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " Jul 10 21:04:00.377262 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377080 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b6dp\" (UniqueName: \"kubernetes.io/projected/eca18871-631b-4561-a381-30888f6cb31c-kube-api-access-5b6dp\") pod \"eca18871-631b-4561-a381-30888f6cb31c\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " Jul 10 21:04:00.377262 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377109 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-istio-data\") pod \"eca18871-631b-4561-a381-30888f6cb31c\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " Jul 10 21:04:00.377262 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377183 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca18871-631b-4561-a381-30888f6cb31c-istio-podinfo\") pod \"eca18871-631b-4561-a381-30888f6cb31c\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " Jul 10 21:04:00.377470 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377302 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca18871-631b-4561-a381-30888f6cb31c-istio-token\") pod \"eca18871-631b-4561-a381-30888f6cb31c\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " Jul 10 21:04:00.377470 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377304 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eca18871-631b-4561-a381-30888f6cb31c" (UID: "eca18871-631b-4561-a381-30888f6cb31c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:04:00.377470 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377357 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca18871-631b-4561-a381-30888f6cb31c-istiod-ca-cert\") pod \"eca18871-631b-4561-a381-30888f6cb31c\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " Jul 10 21:04:00.377470 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377364 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eca18871-631b-4561-a381-30888f6cb31c" (UID: "eca18871-631b-4561-a381-30888f6cb31c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:04:00.377470 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377401 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-credential-socket\") pod \"eca18871-631b-4561-a381-30888f6cb31c\" (UID: \"eca18871-631b-4561-a381-30888f6cb31c\") " Jul 10 21:04:00.377731 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377675 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eca18871-631b-4561-a381-30888f6cb31c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eca18871-631b-4561-a381-30888f6cb31c" (UID: "eca18871-631b-4561-a381-30888f6cb31c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:04:00.377731 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377681 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eca18871-631b-4561-a381-30888f6cb31c" (UID: "eca18871-631b-4561-a381-30888f6cb31c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:04:00.377854 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377833 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca18871-631b-4561-a381-30888f6cb31c-istiod-ca-cert\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:00.377917 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377857 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-credential-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:00.377917 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377871 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-workload-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:00.377917 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.377886 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-workload-certs\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:00.378086 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.378041 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-istio-data" (OuterVolumeSpecName: "istio-data") pod "eca18871-631b-4561-a381-30888f6cb31c" (UID: "eca18871-631b-4561-a381-30888f6cb31c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:04:00.379451 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.379410 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eca18871-631b-4561-a381-30888f6cb31c" (UID: "eca18871-631b-4561-a381-30888f6cb31c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:04:00.379830 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.379806 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca18871-631b-4561-a381-30888f6cb31c-kube-api-access-5b6dp" (OuterVolumeSpecName: "kube-api-access-5b6dp") pod "eca18871-631b-4561-a381-30888f6cb31c" (UID: "eca18871-631b-4561-a381-30888f6cb31c"). InnerVolumeSpecName "kube-api-access-5b6dp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:04:00.380092 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.380074 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eca18871-631b-4561-a381-30888f6cb31c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eca18871-631b-4561-a381-30888f6cb31c" (UID: "eca18871-631b-4561-a381-30888f6cb31c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 21:04:00.380214 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.380199 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca18871-631b-4561-a381-30888f6cb31c-istio-token" (OuterVolumeSpecName: "istio-token") pod "eca18871-631b-4561-a381-30888f6cb31c" (UID: "eca18871-631b-4561-a381-30888f6cb31c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:04:00.479143 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.479106 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b6dp\" (UniqueName: \"kubernetes.io/projected/eca18871-631b-4561-a381-30888f6cb31c-kube-api-access-5b6dp\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:00.479143 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.479136 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-istio-data\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:00.479143 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.479145 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca18871-631b-4561-a381-30888f6cb31c-istio-podinfo\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:00.479143 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.479153 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca18871-631b-4561-a381-30888f6cb31c-istio-token\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:00.479400 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:00.479161 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca18871-631b-4561-a381-30888f6cb31c-istio-envoy\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:01.062790 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.062752 2566 generic.go:356] "Generic (PLEG): container finished" podID="eca18871-631b-4561-a381-30888f6cb31c" containerID="0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844" exitCode=0 Jul 10 21:04:01.062957 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.062830 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" Jul 10 21:04:01.062957 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.062840 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" event={"ID":"eca18871-631b-4561-a381-30888f6cb31c","Type":"ContainerDied","Data":"0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844"} Jul 10 21:04:01.062957 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.062925 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv" event={"ID":"eca18871-631b-4561-a381-30888f6cb31c","Type":"ContainerDied","Data":"052bb7491303dd64599787da26821c9c77e02a0ec05b6c1c4b17242755bead1b"} Jul 10 21:04:01.062957 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.062953 2566 scope.go:117] "RemoveContainer" containerID="0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844" Jul 10 21:04:01.072528 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.072508 2566 scope.go:117] "RemoveContainer" containerID="735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f" Jul 10 21:04:01.083931 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.083894 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv"] Jul 10 21:04:01.084163 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.084128 2566 scope.go:117] "RemoveContainer" containerID="0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844" Jul 10 21:04:01.084945 ip-10-0-130-138 kubenswrapper[2566]: E0710 21:04:01.084660 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844\": container with ID starting with 0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844 not found: ID does not exist" containerID="0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844" Jul 10 21:04:01.084945 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.084747 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844"} err="failed to get container status \"0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844\": rpc error: code = NotFound desc = could not find container \"0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844\": container with ID starting with 0d727a0b68d154cee062d66e5d3cc91412759a9ac1a4cfb4db0adcd52a0d1844 not found: ID does not exist" Jul 10 21:04:01.084945 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.084774 2566 scope.go:117] "RemoveContainer" containerID="735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f" Jul 10 21:04:01.085542 ip-10-0-130-138 kubenswrapper[2566]: E0710 21:04:01.085461 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f\": container with ID starting with 735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f not found: ID does not exist" containerID="735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f" Jul 10 21:04:01.085542 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.085510 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f"} err="failed to get container status \"735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f\": rpc error: code = NotFound desc = could not find container \"735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f\": container with ID starting with 735f10da0276648d2e8cd400815bf3f3dee42d669922ce353b521511bc59b74f not found: ID does not exist" Jul 10 21:04:01.087205 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.087172 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-e560d0-openshift-default-dd6c74cf5-fcjsv"] Jul 10 21:04:01.633717 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.633683 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:04:01.733743 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.733714 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:04:01.816689 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.816654 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh"] Jul 10 21:04:01.816989 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.816950 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerName="istio-proxy" containerID="cri-o://66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36" gracePeriod=30 Jul 10 21:04:01.880915 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:01.880878 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:04:02.067530 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:02.067496 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:04:02.968948 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:02.968918 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eca18871-631b-4561-a381-30888f6cb31c" path="/var/lib/kubelet/pods/eca18871-631b-4561-a381-30888f6cb31c/volumes" Jul 10 21:04:07.079649 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.079622 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 21:04:07.095095 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.094995 2566 generic.go:356] "Generic (PLEG): container finished" podID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerID="66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36" exitCode=0 Jul 10 21:04:07.095095 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.095040 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" Jul 10 21:04:07.095282 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.095033 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" event={"ID":"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0","Type":"ContainerDied","Data":"66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36"} Jul 10 21:04:07.095282 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.095178 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh" event={"ID":"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0","Type":"ContainerDied","Data":"0e0a8563734cd84cf167fe5a752b97102043afaf6bda43a901f41035c22be3ba"} Jul 10 21:04:07.095282 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.095203 2566 scope.go:117] "RemoveContainer" containerID="66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36" Jul 10 21:04:07.106255 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.106233 2566 scope.go:117] "RemoveContainer" containerID="efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0" Jul 10 21:04:07.115343 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.115321 2566 scope.go:117] "RemoveContainer" containerID="66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36" Jul 10 21:04:07.115680 ip-10-0-130-138 kubenswrapper[2566]: E0710 21:04:07.115651 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36\": container with ID starting with 66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36 not found: ID does not exist" containerID="66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36" Jul 10 21:04:07.115754 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.115696 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36"} err="failed to get container status \"66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36\": rpc error: code = NotFound desc = could not find container \"66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36\": container with ID starting with 66454f9db1588ffb70d2227445d8634756330e26196ea765a9801e0eed80dc36 not found: ID does not exist" Jul 10 21:04:07.115754 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.115725 2566 scope.go:117] "RemoveContainer" containerID="efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0" Jul 10 21:04:07.116047 ip-10-0-130-138 kubenswrapper[2566]: E0710 21:04:07.116019 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0\": container with ID starting with efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0 not found: ID does not exist" containerID="efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0" Jul 10 21:04:07.116161 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.116072 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0"} err="failed to get container status \"efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0\": rpc error: code = NotFound desc = could not find container \"efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0\": container with ID starting with efbcbaeaad733584ea651cdc8d06504c93281c15d09086d31a2695aba74ddaa0 not found: ID does not exist" Jul 10 21:04:07.249319 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.249284 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istiod-ca-cert\") pod \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " Jul 10 21:04:07.249490 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.249383 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-envoy\") pod \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " Jul 10 21:04:07.249490 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.249406 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-workload-socket\") pod \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " Jul 10 21:04:07.249490 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.249445 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-credential-socket\") pod \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " Jul 10 21:04:07.249490 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.249479 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-podinfo\") pod \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " Jul 10 21:04:07.249709 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.249518 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-workload-certs\") pod \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " Jul 10 21:04:07.249709 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.249551 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-token\") pod \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " Jul 10 21:04:07.249709 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.249588 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7ssv\" (UniqueName: \"kubernetes.io/projected/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-kube-api-access-l7ssv\") pod \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " Jul 10 21:04:07.249709 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.249651 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-data\") pod \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\" (UID: \"45e6ba65-5c7e-4cf6-b703-b1a9432a78f0\") " Jul 10 21:04:07.249904 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.249750 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" (UID: "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:04:07.249904 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.249762 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" (UID: "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:04:07.249904 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.249754 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" (UID: "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:04:07.250154 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.250131 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-workload-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:07.250278 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.250145 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" (UID: "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:04:07.250278 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.250159 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-credential-socket\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:07.250278 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.250198 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istiod-ca-cert\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:07.250767 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.250741 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-data" (OuterVolumeSpecName: "istio-data") pod "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" (UID: "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:04:07.251912 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.251876 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-token" (OuterVolumeSpecName: "istio-token") pod "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" (UID: "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:04:07.251912 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.251894 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" (UID: "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:04:07.251912 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.251902 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" (UID: "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 21:04:07.252287 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.251911 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-kube-api-access-l7ssv" (OuterVolumeSpecName: "kube-api-access-l7ssv") pod "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" (UID: "45e6ba65-5c7e-4cf6-b703-b1a9432a78f0"). InnerVolumeSpecName "kube-api-access-l7ssv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:04:07.351643 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.351558 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-workload-certs\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:07.351643 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.351585 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-token\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:07.351643 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.351593 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7ssv\" (UniqueName: \"kubernetes.io/projected/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-kube-api-access-l7ssv\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:07.351643 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.351604 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-data\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:07.351643 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.351612 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-envoy\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:07.351643 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.351619 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0-istio-podinfo\") on node \"ip-10-0-130-138.ec2.internal\" DevicePath \"\"" Jul 10 21:04:07.417644 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.417613 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh"] Jul 10 21:04:07.421425 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.421401 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-28db1d-openshift-default-7c6cf5bb79-vqkvh"] Jul 10 21:04:07.787363 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.787336 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b6f977c45-bkdr9_92ab6c86-ae4e-4b7c-88d5-8d4111628b52/copy-manifests/0.log" Jul 10 21:04:07.798414 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:07.798376 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b6f977c45-bkdr9_92ab6c86-ae4e-4b7c-88d5-8d4111628b52/manager/0.log" Jul 10 21:04:08.967508 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:08.967476 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" path="/var/lib/kubelet/pods/45e6ba65-5c7e-4cf6-b703-b1a9432a78f0/volumes" Jul 10 21:04:10.746839 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:10.746813 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4tqvjm_129ab305-1a83-439c-a418-71c27e57eb82/istio-proxy/0.log" Jul 10 21:04:10.863068 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:10.863009 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dfwxt_34910d66-9e44-47cb-afb8-4a89a5ed1155/discovery/0.log" Jul 10 21:04:11.187071 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:11.187025 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9h8xd_4117ef74-7e93-4f6e-9d48-7bce95b540e1/istio-proxy/1.log" Jul 10 21:04:11.298995 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:11.298949 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-lmn2w_69359cd4-0550-4560-8921-284a426def90/payload-pre-processing/0.log" Jul 10 21:04:11.409771 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:11.409738 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-8w27x_39e38031-b529-488f-9194-51443088c93f/payload-processing/0.log" Jul 10 21:04:11.519615 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:11.519529 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cf6c66c44-5lkdq_76ef5f08-9086-4f3d-a0b7-5115bd070ea8/router/0.log" Jul 10 21:04:12.064836 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:12.064792 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-l862v_bea1e34a-1d13-4260-b86b-b142e91993aa/main/0.log" Jul 10 21:04:12.170359 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:12.170326 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrq7ql_047adff3-76bb-4954-b5be-03cc567520b9/main/0.log" Jul 10 21:04:15.974967 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:15.974929 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:04:16.055614 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:16.055576 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" limit=1024 Jul 10 21:04:19.275814 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:19.275775 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lkpwk_5f44a784-5924-4a01-afa5-1ac2e91aba36/global-pull-secret-syncer/0.log" Jul 10 21:04:19.331596 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:19.331567 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cwrfk_55696fe0-0df3-401d-b9d6-8893f1b05e6f/konnectivity-agent/0.log" Jul 10 21:04:19.439949 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:19.439914 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-138.ec2.internal_be4a4a55f775b92d647c8d6c2a1d68b2/haproxy/0.log" Jul 10 21:04:26.974047 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:26.974018 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-5z4z7_3b98aa11-069e-4e6b-b81c-81d9780dc593/kube-state-metrics/0.log" Jul 10 21:04:26.995883 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:26.995858 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-5z4z7_3b98aa11-069e-4e6b-b81c-81d9780dc593/kube-rbac-proxy-main/0.log" Jul 10 21:04:27.019661 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.019629 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-5z4z7_3b98aa11-069e-4e6b-b81c-81d9780dc593/kube-rbac-proxy-self/0.log" Jul 10 21:04:27.051154 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.051128 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6bd9fdd8b9-wp5kv_e887bce6-4515-44c5-b099-6c317fb743ac/metrics-server/0.log" Jul 10 21:04:27.080825 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.080785 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-xqztp_69cc0da3-1e81-49c8-b68c-dfe126c465e6/monitoring-plugin/0.log" Jul 10 21:04:27.118208 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.118178 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4259l_26bcec1a-a226-4723-b55f-9531478368cc/node-exporter/0.log" Jul 10 21:04:27.142425 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.142398 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4259l_26bcec1a-a226-4723-b55f-9531478368cc/kube-rbac-proxy/0.log" Jul 10 21:04:27.169362 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.169337 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4259l_26bcec1a-a226-4723-b55f-9531478368cc/init-textfile/0.log" Jul 10 21:04:27.450867 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.450840 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e47f868-95c9-4fa6-ab3b-a111da46aa4b/prometheus/0.log" Jul 10 21:04:27.474971 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.474944 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e47f868-95c9-4fa6-ab3b-a111da46aa4b/config-reloader/0.log" Jul 10 21:04:27.498799 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.498770 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e47f868-95c9-4fa6-ab3b-a111da46aa4b/thanos-sidecar/0.log" Jul 10 21:04:27.522298 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.522272 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e47f868-95c9-4fa6-ab3b-a111da46aa4b/kube-rbac-proxy-web/0.log" Jul 10 21:04:27.550042 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.550019 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e47f868-95c9-4fa6-ab3b-a111da46aa4b/kube-rbac-proxy/0.log" Jul 10 21:04:27.578131 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.578100 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e47f868-95c9-4fa6-ab3b-a111da46aa4b/kube-rbac-proxy-thanos/0.log" Jul 10 21:04:27.601202 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.601167 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e47f868-95c9-4fa6-ab3b-a111da46aa4b/init-config-reloader/0.log" Jul 10 21:04:27.629999 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.629969 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-2zrqw_68647829-1c26-4658-ad0f-67945f02e250/prometheus-operator/0.log" Jul 10 21:04:27.650240 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.650214 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-2zrqw_68647829-1c26-4658-ad0f-67945f02e250/kube-rbac-proxy/0.log" Jul 10 21:04:27.712211 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.712128 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66d9859d99-lp7wt_366082b1-cdf0-48d2-ac4f-513cf4c3adff/telemeter-client/0.log" Jul 10 21:04:27.735845 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.735815 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66d9859d99-lp7wt_366082b1-cdf0-48d2-ac4f-513cf4c3adff/reload/0.log" Jul 10 21:04:27.756792 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:27.756767 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66d9859d99-lp7wt_366082b1-cdf0-48d2-ac4f-513cf4c3adff/kube-rbac-proxy/0.log" Jul 10 21:04:29.028701 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:29.028668 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-l52v2_2d8bdeb4-b0c0-4be5-9386-9ba5dc958c9d/networking-console-plugin/0.log" Jul 10 21:04:29.604689 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:29.604655 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/1.log" Jul 10 21:04:29.610483 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:29.610459 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6zqnz_4ad657aa-76f6-400b-b80a-239f6b0aa519/console-operator/2.log" Jul 10 21:04:30.012374 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.012339 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx"] Jul 10 21:04:30.012734 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.012722 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerName="istio-proxy" Jul 10 21:04:30.012779 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.012736 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerName="istio-proxy" Jul 10 21:04:30.012779 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.012746 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eca18871-631b-4561-a381-30888f6cb31c" containerName="istio-proxy" Jul 10 21:04:30.012779 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.012752 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eca18871-631b-4561-a381-30888f6cb31c" containerName="istio-proxy" Jul 10 21:04:30.012779 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.012759 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerName="istio-proxy" Jul 10 21:04:30.012779 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.012766 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerName="istio-proxy" Jul 10 21:04:30.012779 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.012779 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eca18871-631b-4561-a381-30888f6cb31c" containerName="istio-proxy" Jul 10 21:04:30.012968 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.012785 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eca18871-631b-4561-a381-30888f6cb31c" containerName="istio-proxy" Jul 10 21:04:30.012968 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.012836 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="eca18871-631b-4561-a381-30888f6cb31c" containerName="istio-proxy" Jul 10 21:04:30.012968 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.012844 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerName="istio-proxy" Jul 10 21:04:30.012968 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.012853 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e6ba65-5c7e-4cf6-b703-b1a9432a78f0" containerName="istio-proxy" Jul 10 21:04:30.015897 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.015871 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.019325 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.019300 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n2z9x\"/\"openshift-service-ca.crt\"" Jul 10 21:04:30.020890 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.020867 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n2z9x\"/\"kube-root-ca.crt\"" Jul 10 21:04:30.021032 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.021013 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n2z9x\"/\"default-dockercfg-kpjj7\"" Jul 10 21:04:30.030318 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.030284 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx"] Jul 10 21:04:30.070338 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.070302 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-lib-modules\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.070597 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.070370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-proc\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.070597 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.070488 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-podres\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.070710 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.070594 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxvqp\" (UniqueName: \"kubernetes.io/projected/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-kube-api-access-bxvqp\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.070710 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.070622 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-sys\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.171844 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.171806 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-proc\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.172048 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.171867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-podres\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.172048 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.171909 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxvqp\" (UniqueName: \"kubernetes.io/projected/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-kube-api-access-bxvqp\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.172048 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.171926 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-sys\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.172048 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.171948 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-proc\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.172048 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.171958 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-lib-modules\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.172048 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.172015 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-sys\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.172309 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.172105 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-lib-modules\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.172309 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.172107 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-podres\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.180691 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.180659 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxvqp\" (UniqueName: \"kubernetes.io/projected/8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b-kube-api-access-bxvqp\") pod \"perf-node-gather-daemonset-2bjzx\" (UID: \"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.326957 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.326864 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:30.464203 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:30.464134 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx"] Jul 10 21:04:30.466440 ip-10-0-130-138 kubenswrapper[2566]: W0710 21:04:30.466408 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8dc061b7_7ef8_41d0_8ba5_8bd5cb72a87b.slice/crio-b472fbc68180b9e4426ea7867769772234daf9109d005acd47a529fc1a735483 WatchSource:0}: Error finding container b472fbc68180b9e4426ea7867769772234daf9109d005acd47a529fc1a735483: Status 404 returned error can't find the container with id b472fbc68180b9e4426ea7867769772234daf9109d005acd47a529fc1a735483 Jul 10 21:04:31.208250 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:31.208216 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" event={"ID":"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b","Type":"ContainerStarted","Data":"b11f1e70e4b117ee164b1b1c22d9a27bfa4cb7832e83c4bdff8693cd2c823775"} Jul 10 21:04:31.208632 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:31.208270 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" event={"ID":"8dc061b7-7ef8-41d0-8ba5-8bd5cb72a87b","Type":"ContainerStarted","Data":"b472fbc68180b9e4426ea7867769772234daf9109d005acd47a529fc1a735483"} Jul 10 21:04:31.208632 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:31.208491 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:31.226493 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:31.226444 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" podStartSLOduration=2.226427544 podStartE2EDuration="2.226427544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:04:31.225361906 +0000 UTC m=+2588.843794909" watchObservedRunningTime="2026-07-10 21:04:31.226427544 +0000 UTC m=+2588.844860547" Jul 10 21:04:31.976390 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:31.976363 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j9npz_c0418812-8ccc-41ad-9183-9c39907f63ae/dns/0.log" Jul 10 21:04:32.016942 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:32.016915 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j9npz_c0418812-8ccc-41ad-9183-9c39907f63ae/kube-rbac-proxy/0.log" Jul 10 21:04:32.237974 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:32.237896 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gk76z_1bb76bc0-7262-46cf-b492-7ccd2e542fe2/dns-node-resolver/0.log" Jul 10 21:04:32.799881 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:32.799852 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5f79bf796d-s9zzk_20684401-34fd-4f59-8eab-261246fbc840/registry/0.log" Jul 10 21:04:32.808985 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:32.808956 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5f79bf796d-s9zzk_20684401-34fd-4f59-8eab-261246fbc840/registry/1.log" Jul 10 21:04:32.832443 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:32.832422 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bb2fz_e88eed6b-d362-4848-a548-699f174407ee/node-ca/0.log" Jul 10 21:04:33.844517 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:33.844483 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4tqvjm_129ab305-1a83-439c-a418-71c27e57eb82/istio-proxy/0.log" Jul 10 21:04:33.956954 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:33.956915 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dfwxt_34910d66-9e44-47cb-afb8-4a89a5ed1155/discovery/0.log" Jul 10 21:04:34.032685 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:34.032649 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9h8xd_4117ef74-7e93-4f6e-9d48-7bce95b540e1/istio-proxy/0.log" Jul 10 21:04:34.063115 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:34.063078 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9h8xd_4117ef74-7e93-4f6e-9d48-7bce95b540e1/istio-proxy/1.log" Jul 10 21:04:34.099698 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:34.099619 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-lmn2w_69359cd4-0550-4560-8921-284a426def90/payload-pre-processing/0.log" Jul 10 21:04:34.129923 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:34.129888 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-8w27x_39e38031-b529-488f-9194-51443088c93f/payload-processing/0.log" Jul 10 21:04:34.152657 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:34.152626 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cf6c66c44-5lkdq_76ef5f08-9086-4f3d-a0b7-5115bd070ea8/router/0.log" Jul 10 21:04:34.840417 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:34.840387 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6t2bs_19c473d4-be6e-444b-8de4-19962da37958/serve-healthcheck-canary/0.log" Jul 10 21:04:35.344445 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:35.344408 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-9r9sr_ec3ded59-60c6-4116-9c40-a4adaa038b90/insights-operator/0.log" Jul 10 21:04:35.344987 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:35.344970 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-9r9sr_ec3ded59-60c6-4116-9c40-a4adaa038b90/insights-operator/1.log" Jul 10 21:04:35.505642 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:35.505610 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jbtnk_164c5d56-df32-4e1c-b67a-048432926a91/kube-rbac-proxy/0.log" Jul 10 21:04:35.527174 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:35.527142 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jbtnk_164c5d56-df32-4e1c-b67a-048432926a91/exporter/0.log" Jul 10 21:04:35.548275 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:35.548246 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jbtnk_164c5d56-df32-4e1c-b67a-048432926a91/extractor/0.log" Jul 10 21:04:37.222910 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:37.222881 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-2bjzx" Jul 10 21:04:38.364499 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:38.364468 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b6f977c45-bkdr9_92ab6c86-ae4e-4b7c-88d5-8d4111628b52/manager/0.log" Jul 10 21:04:38.386593 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:38.386561 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b6f977c45-bkdr9_92ab6c86-ae4e-4b7c-88d5-8d4111628b52/copy-manifests/0.log" Jul 10 21:04:40.008536 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:40.008506 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5dcfcfbc-xrdnw_9415b17e-0700-4d1c-a574-8164a96c8ab9/manager/0.log" Jul 10 21:04:40.012465 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:40.012433 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4tqvjm_129ab305-1a83-439c-a418-71c27e57eb82/istio-proxy/0.log" Jul 10 21:04:40.120351 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:40.120313 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dfwxt_34910d66-9e44-47cb-afb8-4a89a5ed1155/discovery/0.log" Jul 10 21:04:40.174105 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:40.173997 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9h8xd_4117ef74-7e93-4f6e-9d48-7bce95b540e1/istio-proxy/0.log" Jul 10 21:04:40.204134 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:40.204099 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9h8xd_4117ef74-7e93-4f6e-9d48-7bce95b540e1/istio-proxy/1.log" Jul 10 21:04:40.225493 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:40.225406 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-lmn2w_69359cd4-0550-4560-8921-284a426def90/payload-pre-processing/0.log" Jul 10 21:04:40.254524 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:40.254488 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-8w27x_39e38031-b529-488f-9194-51443088c93f/payload-processing/0.log" Jul 10 21:04:40.269702 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:40.269672 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cf6c66c44-5lkdq_76ef5f08-9086-4f3d-a0b7-5115bd070ea8/router/0.log" Jul 10 21:04:41.429962 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:41.429938 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4tqvjm_129ab305-1a83-439c-a418-71c27e57eb82/istio-proxy/0.log" Jul 10 21:04:41.535764 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:41.535729 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dfwxt_34910d66-9e44-47cb-afb8-4a89a5ed1155/discovery/0.log" Jul 10 21:04:41.592683 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:41.592656 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9h8xd_4117ef74-7e93-4f6e-9d48-7bce95b540e1/istio-proxy/0.log" Jul 10 21:04:41.619863 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:41.619825 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9h8xd_4117ef74-7e93-4f6e-9d48-7bce95b540e1/istio-proxy/1.log" Jul 10 21:04:41.641276 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:41.641243 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-lmn2w_69359cd4-0550-4560-8921-284a426def90/payload-pre-processing/0.log" Jul 10 21:04:41.664924 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:41.664891 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-8w27x_39e38031-b529-488f-9194-51443088c93f/payload-processing/0.log" Jul 10 21:04:41.685944 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:41.685868 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cf6c66c44-5lkdq_76ef5f08-9086-4f3d-a0b7-5115bd070ea8/router/0.log" Jul 10 21:04:46.602449 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:46.602415 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b45xk_dfbcf8ac-64c3-43f1-9830-29ee5390621f/kube-multus-additional-cni-plugins/0.log" Jul 10 21:04:46.624027 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:46.624002 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b45xk_dfbcf8ac-64c3-43f1-9830-29ee5390621f/egress-router-binary-copy/0.log" Jul 10 21:04:46.646263 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:46.646234 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b45xk_dfbcf8ac-64c3-43f1-9830-29ee5390621f/cni-plugins/0.log" Jul 10 21:04:46.667493 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:46.667461 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b45xk_dfbcf8ac-64c3-43f1-9830-29ee5390621f/bond-cni-plugin/0.log" Jul 10 21:04:46.690185 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:46.690157 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b45xk_dfbcf8ac-64c3-43f1-9830-29ee5390621f/routeoverride-cni/0.log" Jul 10 21:04:46.713492 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:46.713464 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b45xk_dfbcf8ac-64c3-43f1-9830-29ee5390621f/whereabouts-cni-bincopy/0.log" Jul 10 21:04:46.736030 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:46.736003 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b45xk_dfbcf8ac-64c3-43f1-9830-29ee5390621f/whereabouts-cni/0.log" Jul 10 21:04:46.924212 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:46.924138 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-blzc9_9a30c286-7732-4e5d-9fdf-baf93eb89e66/kube-multus/0.log" Jul 10 21:04:46.983121 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:46.983091 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2m52m_9300a4a2-82bc-450e-8fe5-c5382a177fa4/network-metrics-daemon/0.log" Jul 10 21:04:47.002740 ip-10-0-130-138 kubenswrapper[2566]: I0710 21:04:47.002714 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2m52m_9300a4a2-82bc-450e-8fe5-c5382a177fa4/kube-rbac-proxy/0.log"