Jul 08 19:01:14.299532 ip-10-0-128-32 systemd[1]: Starting Kubernetes Kubelet... Jul 08 19:01:14.601090 ip-10-0-128-32 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:01:14.601090 ip-10-0-128-32 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 19:01:14.601090 ip-10-0-128-32 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:01:14.601090 ip-10-0-128-32 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 19:01:14.601090 ip-10-0-128-32 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:01:14.602992 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.602904 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 19:01:14.607023 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.606994 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:01:14.607023 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607025 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:01:14.607023 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607031 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607045 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607050 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607054 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607058 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607063 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607067 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607117 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607123 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607127 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607131 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607136 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607139 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607142 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607145 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607147 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607150 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607153 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607156 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:01:14.607206 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607163 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607166 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607169 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607172 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607178 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607188 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607338 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607343 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607348 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607351 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607355 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607357 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607360 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607363 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607365 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607368 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607373 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607376 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607379 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607382 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:01:14.607779 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607385 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607388 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607392 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607395 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607399 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607401 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607405 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607407 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607410 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607413 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607415 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607418 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607421 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607423 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607426 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607429 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607432 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607434 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607437 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607439 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:01:14.608281 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607442 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607444 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607447 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607449 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607452 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607454 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607456 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607459 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607461 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607463 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607466 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607468 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607470 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607473 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607475 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607478 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607481 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607484 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607486 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607488 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:01:14.608859 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607491 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607493 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607496 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607498 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607501 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607503 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607507 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607509 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607515 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607518 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607521 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607524 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607527 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607529 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607533 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607536 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607540 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.607543 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608280 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:01:14.609386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608290 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608295 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608297 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608300 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608304 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608306 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608309 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608311 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608314 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608317 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608319 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608322 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608324 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608326 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608329 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608332 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608336 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608339 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608347 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608350 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:01:14.609831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608353 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608356 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608358 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608361 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608365 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608369 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608372 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608374 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608377 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608380 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608383 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608385 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608388 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608390 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608393 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608395 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608398 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608401 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608403 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:01:14.610350 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608405 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608408 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608410 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608412 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608414 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608417 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608419 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608422 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608424 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608426 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608431 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608433 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608436 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608439 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608442 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608444 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608447 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608449 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608452 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:01:14.610807 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608454 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608458 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608462 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608464 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608467 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608470 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608473 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608475 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608478 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608480 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608482 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608487 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608490 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608493 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608496 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608499 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608503 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608506 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608509 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:01:14.611278 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608512 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608514 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608517 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608519 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608522 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608525 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608528 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608531 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608533 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608536 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608539 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608541 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608544 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608546 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608548 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608551 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608553 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608574 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608578 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608581 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:01:14.611746 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608584 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608956 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608961 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608964 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608966 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608969 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608972 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608976 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608979 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608982 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608985 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608987 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608990 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608993 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608995 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.608998 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609001 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609004 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609006 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609009 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:01:14.612221 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609011 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609014 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609016 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609019 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609021 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609024 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609026 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609029 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609031 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609033 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609036 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609038 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609040 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609043 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609048 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609051 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609053 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609057 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609060 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:01:14.612737 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609063 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609066 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609068 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609070 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609073 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609075 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609078 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609080 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609083 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609086 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609088 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609092 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609094 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609097 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609100 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609103 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609105 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609108 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609110 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609113 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:01:14.613215 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609115 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609117 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609120 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609122 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609125 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609127 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609129 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609133 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609136 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609139 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609141 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609143 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609146 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609148 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609150 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609154 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609156 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609159 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609161 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:01:14.613715 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609163 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609166 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609169 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609171 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609173 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609178 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609182 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609184 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609187 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609190 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609193 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609195 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609198 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609200 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609203 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609205 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609208 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609210 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609212 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609215 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:01:14.614208 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609219 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609221 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609315 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609325 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609333 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609338 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609341 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609344 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609348 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609352 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609355 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609358 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609363 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609367 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609370 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609372 2577 flags.go:64] FLAG: --cgroup-root="" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609375 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609378 2577 flags.go:64] FLAG: --client-ca-file="" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609386 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609389 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609396 2577 flags.go:64] FLAG: --cluster-domain="" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609399 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609402 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609405 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 19:01:14.614681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609408 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609411 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609414 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609417 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609420 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609423 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609426 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609428 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609432 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609435 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609439 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609442 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609444 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609447 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609449 2577 flags.go:64] FLAG: --enable-server="true" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609452 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609458 2577 flags.go:64] FLAG: --event-burst="100" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609461 2577 flags.go:64] FLAG: --event-qps="50" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609464 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609467 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609472 2577 flags.go:64] FLAG: --eviction-hard="" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609475 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609478 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609481 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609484 2577 flags.go:64] FLAG: --eviction-soft="" Jul 08 19:01:14.615243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609487 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609489 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609492 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609495 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609498 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609500 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609503 2577 flags.go:64] FLAG: --feature-gates="" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609506 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609509 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609512 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609515 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609517 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609520 2577 flags.go:64] FLAG: --help="false" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609523 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-128-32.ec2.internal" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609526 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609529 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609531 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609534 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609538 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609541 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609543 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609546 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609548 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 19:01:14.615907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609551 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609554 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609556 2577 flags.go:64] FLAG: --kube-reserved="" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609559 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609563 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609566 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609568 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609571 2577 flags.go:64] FLAG: --lock-file="" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609574 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609577 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609579 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609584 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609587 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609590 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609593 2577 flags.go:64] FLAG: --logging-format="text" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609595 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609598 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609601 2577 flags.go:64] FLAG: --manifest-url="" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609603 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609607 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609610 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609614 2577 flags.go:64] FLAG: --max-pods="110" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609617 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609619 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609622 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 19:01:14.616509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609625 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609628 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609630 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609633 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609640 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609642 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609645 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609648 2577 flags.go:64] FLAG: --pod-cidr="" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609650 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609655 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609658 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609661 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609665 2577 flags.go:64] FLAG: --port="10250" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609668 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609670 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03ce42c2e1bcb4126" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609673 2577 flags.go:64] FLAG: --qos-reserved="" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609676 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609679 2577 flags.go:64] FLAG: --register-node="true" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609681 2577 flags.go:64] FLAG: --register-with-taints="" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609685 2577 flags.go:64] FLAG: --registry-burst="10" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609688 2577 flags.go:64] FLAG: --registry-qps="5" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609690 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609693 2577 flags.go:64] FLAG: --reserved-memory="" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609696 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609699 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 19:01:14.617113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609702 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609705 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609707 2577 flags.go:64] FLAG: --runonce="false" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609710 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609712 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609715 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609718 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609720 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609723 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609726 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609729 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609731 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609734 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609736 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609739 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609741 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609744 2577 flags.go:64] FLAG: --system-cgroups="" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609746 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609752 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609756 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609759 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609767 2577 flags.go:64] FLAG: --tls-min-version="" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609770 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609772 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609775 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 19:01:14.617748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609778 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609780 2577 flags.go:64] FLAG: --v="2" Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609784 2577 flags.go:64] FLAG: --version="false" Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609789 2577 flags.go:64] FLAG: --vmodule="" Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609792 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.609795 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609912 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609916 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609919 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609921 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609924 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609926 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609929 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609932 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609935 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609938 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609940 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609942 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609945 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609948 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609950 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:01:14.618349 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609953 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609956 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609958 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609961 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609964 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609967 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609969 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609973 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609977 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609981 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609985 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609989 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609993 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.609997 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610001 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610004 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610007 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610009 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610012 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610014 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:01:14.618848 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610017 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610019 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610021 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610024 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610028 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610030 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610033 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610035 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610037 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610040 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610042 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610045 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610047 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610050 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610053 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610055 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610057 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610060 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610063 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610065 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:01:14.619378 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610068 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610070 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610073 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610076 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610080 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610083 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610087 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610091 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610094 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610097 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610099 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610102 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610104 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610107 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610109 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610112 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610115 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610117 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610120 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:01:14.619878 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610123 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610126 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610129 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610132 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610134 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610136 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610139 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610141 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610144 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610147 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610149 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610152 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610154 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610157 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610159 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610162 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610164 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610167 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610169 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:01:14.620358 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610171 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610174 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610176 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610179 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610181 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.610183 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.610189 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.616873 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.616887 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.616907 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.616912 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.616966 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.616971 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.616974 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:01:14.620805 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.616977 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.616980 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.616983 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.616985 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.616988 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.616991 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.616994 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.616998 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617001 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617005 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617007 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617010 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617012 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617015 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617018 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617021 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617023 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617026 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617028 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617031 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:01:14.621153 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617033 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617037 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617039 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617042 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617045 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617047 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617051 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617053 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617056 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617058 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617061 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617063 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617066 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617068 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617071 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617073 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617076 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617078 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617081 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:01:14.621702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617084 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617086 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617089 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617091 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617094 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617097 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617099 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617102 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617105 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617107 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617109 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617112 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617114 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617117 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617120 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617123 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617126 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617129 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617132 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617135 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617137 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:01:14.622149 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617140 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617142 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617145 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617147 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617150 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617153 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617155 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617158 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617160 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617163 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617165 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617167 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617172 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617175 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617178 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617181 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617184 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617186 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617189 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:01:14.622656 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617192 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617194 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617197 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617199 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617202 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617206 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617208 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617212 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617216 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617219 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617222 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617225 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617227 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617230 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617232 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617235 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:01:14.623128 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617237 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.617242 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617366 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617371 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617374 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617377 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617380 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617383 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617386 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617388 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617390 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617393 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617395 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617398 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:01:14.623532 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617401 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617403 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617405 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617408 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617410 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617413 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617415 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617418 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617420 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617423 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617425 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617428 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617431 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617434 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617436 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617438 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617441 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617443 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617446 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617448 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:01:14.623880 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617450 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617454 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617457 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617460 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617462 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617465 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617467 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617470 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617472 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617474 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617477 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617479 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617482 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617484 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617486 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617489 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617491 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617493 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617496 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617498 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:01:14.624416 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617500 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617503 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617505 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617508 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617513 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617516 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617519 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617521 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617524 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617527 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617530 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617532 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617535 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617537 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617540 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617542 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617545 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617547 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617549 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:01:14.624967 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617552 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617554 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617556 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617559 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617561 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617564 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617566 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617568 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617571 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617574 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617576 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617579 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617581 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617583 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617586 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617588 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617591 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617594 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617597 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617599 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:01:14.625450 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617602 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617604 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617607 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617609 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617612 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617614 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617617 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:14.617620 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.617625 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.617726 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.619654 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.620794 2577 server.go:1019] "Starting client certificate rotation" Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.620890 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 19:01:14.625927 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.620919 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 19:01:14.626289 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.622726 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 19:01:14.626459 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.626431 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 19:01:14.636415 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.636399 2577 log.go:25] "Validated CRI v1 runtime API" Jul 08 19:01:14.638381 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.638365 2577 log.go:25] "Validated CRI v1 image API" Jul 08 19:01:14.639234 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.639222 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 19:01:14.641696 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.641678 2577 fs.go:135] Filesystem UUIDs: map[710f045a-8760-4627-8285-9c62c2c6a211:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f6754ae0-d5df-464b-b17a-d24d417f0344:/dev/nvme0n1p3] Jul 08 19:01:14.641743 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.641696 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 19:01:14.647217 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.647109 2577 manager.go:216] Machine: {Timestamp:2026-07-08 19:01:14.645937 +0000 UTC m=+0.251850062 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098266 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20aaaf9a8f26ce19b28993c9393dd4 SystemUUID:ec20aaaf-9a8f-26ce-19b2-8993c9393dd4 BootID:feab1cbd-f5e0-4272-858b-c1106f145791 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:88:b8:08:2b:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:88:b8:08:2b:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:b4:50:fc:e2:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 19:01:14.647217 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.647209 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 19:01:14.647351 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.647307 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 19:01:14.649852 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.649818 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 19:01:14.649997 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.649856 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-32.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 19:01:14.650504 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.650494 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 19:01:14.650540 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.650506 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 19:01:14.650540 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.650513 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 19:01:14.650540 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.650527 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 19:01:14.651730 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.651720 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 19:01:14.655355 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.655343 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 08 19:01:14.655476 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.655467 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 19:01:14.656084 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.656074 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 08 19:01:14.656114 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.656092 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 19:01:14.656114 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.656104 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 19:01:14.656114 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.656113 2577 kubelet.go:398] "Adding apiserver pod source" Jul 08 19:01:14.656216 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.656123 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 19:01:14.656490 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.656479 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 19:01:14.656521 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.656498 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 19:01:14.658244 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.658226 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 19:01:14.660065 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.660052 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 19:01:14.660109 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.660085 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 19:01:14.661068 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661056 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 19:01:14.661121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661072 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 19:01:14.661121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661078 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 19:01:14.661121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661083 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 19:01:14.661121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661091 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 19:01:14.661121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661096 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 19:01:14.661121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661104 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 19:01:14.661121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661108 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 19:01:14.661121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661115 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 19:01:14.661121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661121 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 19:01:14.661366 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661129 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 19:01:14.661366 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661135 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 19:01:14.661709 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661696 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 19:01:14.661740 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.661711 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 19:01:14.662538 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.662517 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 19:01:14.665066 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.665054 2577 server.go:1268] "Started kubelet" Jul 08 19:01:14.665168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.665136 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 19:01:14.665286 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.665241 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 19:01:14.665402 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.665350 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 19:01:14.666112 ip-10-0-128-32 systemd[1]: Started Kubernetes Kubelet. Jul 08 19:01:14.667648 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.667597 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 19:01:14.668050 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.668020 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 19:01:14.668630 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.668599 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 19:01:14.668876 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.668852 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-32.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 19:01:14.669557 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.669536 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 08 19:01:14.671670 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.671650 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 19:01:14.673403 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.673386 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 19:01:14.673491 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.673388 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 19:01:14.673546 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.673467 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:14.673978 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.673877 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 19:01:14.673978 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.673910 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 19:01:14.673978 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.673929 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 19:01:14.674157 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.674080 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 08 19:01:14.674157 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.674089 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 08 19:01:14.674316 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.674299 2577 factory.go:55] Registering systemd factory Jul 08 19:01:14.674316 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.674319 2577 factory.go:223] Registration of the systemd container factory successfully Jul 08 19:01:14.674532 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.674520 2577 factory.go:153] Registering CRI-O factory Jul 08 19:01:14.674532 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.674532 2577 factory.go:223] Registration of the crio container factory successfully Jul 08 19:01:14.674640 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.674580 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 19:01:14.674640 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.674601 2577 factory.go:103] Registering Raw factory Jul 08 19:01:14.674640 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.674610 2577 manager.go:1196] Started watching for new ooms in manager Jul 08 19:01:14.675186 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.675174 2577 manager.go:349] Starting recovery of all containers Jul 08 19:01:14.676056 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.676000 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 19:01:14.676454 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.676430 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 19:01:14.676826 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.676045 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-32.ec2.internal.18c065b3a413c85e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-32.ec2.internal,UID:ip-10-0-128-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-32.ec2.internal,},FirstTimestamp:2026-07-08 19:01:14.665027678 +0000 UTC m=+0.270940741,LastTimestamp:2026-07-08 19:01:14.665027678 +0000 UTC m=+0.270940741,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-32.ec2.internal,}" Jul 08 19:01:14.685738 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.685584 2577 manager.go:354] Recovery completed Jul 08 19:01:14.687307 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.687277 2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 08 19:01:14.690335 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.690323 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:14.693064 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.693042 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fzzmg" Jul 08 19:01:14.693480 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.693464 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:14.693525 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.693496 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:14.693525 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.693507 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:14.694117 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.694097 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 19:01:14.694189 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.694131 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:14.694189 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.694153 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 19:01:14.694189 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.694183 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 08 19:01:14.696535 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.696522 2577 policy_none.go:49] "None policy: Start" Jul 08 19:01:14.696587 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.696543 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 19:01:14.696587 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.696555 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 19:01:14.696847 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.696832 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:14.696912 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.696865 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:14.696912 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.696879 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:14.698540 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.698528 2577 policy_none.go:47] "Start" Jul 08 19:01:14.701737 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.701722 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fzzmg" Jul 08 19:01:14.702933 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.702858 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-32.ec2.internal.18c065b3a5c5f3ec default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-32.ec2.internal,UID:ip-10-0-128-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-32.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-32.ec2.internal,},FirstTimestamp:2026-07-08 19:01:14.693481452 +0000 UTC m=+0.299394515,LastTimestamp:2026-07-08 19:01:14.693481452 +0000 UTC m=+0.299394515,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-32.ec2.internal,}" Jul 08 19:01:14.737835 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.737817 2577 manager.go:337] "Starting Device Plugin manager" Jul 08 19:01:14.737955 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.737861 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 19:01:14.737955 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.737871 2577 server.go:87] "Starting device plugin registration server" Jul 08 19:01:14.738133 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.738120 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 19:01:14.738169 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.738138 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 19:01:14.738243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.738228 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 19:01:14.738347 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.738330 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 19:01:14.738347 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.738341 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 19:01:14.738879 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.738843 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 19:01:14.738941 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.738897 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:14.780437 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.780397 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 19:01:14.788400 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.781655 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 19:01:14.788400 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.781685 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 19:01:14.788400 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.781712 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 19:01:14.788400 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.781752 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 19:01:14.788400 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.785862 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:01:14.838434 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.838401 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:14.839462 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.839445 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:14.839561 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.839478 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:14.839561 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.839489 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:14.839561 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.839515 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-32.ec2.internal" Jul 08 19:01:14.849328 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.849314 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-32.ec2.internal" Jul 08 19:01:14.849387 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.849336 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-32.ec2.internal\": node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:14.865693 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.865641 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:14.882687 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.882668 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-32.ec2.internal"] Jul 08 19:01:14.882746 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.882726 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:14.884155 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.884139 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:14.884232 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.884170 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:14.884232 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.884179 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:14.886642 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.886621 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:14.886760 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.886744 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" Jul 08 19:01:14.886797 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.886778 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:14.887398 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.887380 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:14.887464 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.887408 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:14.887464 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.887423 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:14.887464 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.887441 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:14.887464 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.887454 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:14.887607 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.887425 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:14.891062 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.891049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-32.ec2.internal" Jul 08 19:01:14.891106 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.891072 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:14.891791 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.891776 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:14.891869 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.891801 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:14.891869 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.891812 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:14.910836 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.910818 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-32.ec2.internal\" not found" node="ip-10-0-128-32.ec2.internal" Jul 08 19:01:14.915483 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.915467 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-32.ec2.internal\" not found" node="ip-10-0-128-32.ec2.internal" Jul 08 19:01:14.965756 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:14.965732 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:14.976435 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.976406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c16d154b3279b4f9d9e55179eee181c7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal\" (UID: \"c16d154b3279b4f9d9e55179eee181c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" Jul 08 19:01:14.976539 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.976441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c16d154b3279b4f9d9e55179eee181c7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal\" (UID: \"c16d154b3279b4f9d9e55179eee181c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" Jul 08 19:01:14.976539 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:14.976463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c64d84b2ff9c3bb74e9379c477de15a9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-32.ec2.internal\" (UID: \"c64d84b2ff9c3bb74e9379c477de15a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-32.ec2.internal" Jul 08 19:01:15.066425 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:15.066387 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:15.076709 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.076686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c16d154b3279b4f9d9e55179eee181c7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal\" (UID: \"c16d154b3279b4f9d9e55179eee181c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" Jul 08 19:01:15.076771 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.076715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c16d154b3279b4f9d9e55179eee181c7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal\" (UID: \"c16d154b3279b4f9d9e55179eee181c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" Jul 08 19:01:15.076771 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.076733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c64d84b2ff9c3bb74e9379c477de15a9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-32.ec2.internal\" (UID: \"c64d84b2ff9c3bb74e9379c477de15a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-32.ec2.internal" Jul 08 19:01:15.076841 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.076789 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c16d154b3279b4f9d9e55179eee181c7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal\" (UID: \"c16d154b3279b4f9d9e55179eee181c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" Jul 08 19:01:15.076841 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.076787 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c64d84b2ff9c3bb74e9379c477de15a9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-32.ec2.internal\" (UID: \"c64d84b2ff9c3bb74e9379c477de15a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-32.ec2.internal" Jul 08 19:01:15.076841 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.076820 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c16d154b3279b4f9d9e55179eee181c7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal\" (UID: \"c16d154b3279b4f9d9e55179eee181c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" Jul 08 19:01:15.167134 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:15.167063 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:15.213569 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.213527 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" Jul 08 19:01:15.218998 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.218596 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-32.ec2.internal" Jul 08 19:01:15.267676 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:15.267639 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:15.368218 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:15.368189 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:15.468727 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:15.468656 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:15.572557 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:15.572512 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:15.622736 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.622692 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 19:01:15.623225 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.622897 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 19:01:15.673592 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:15.673563 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:15.707388 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.707345 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 18:56:15 +0000 UTC" deadline="2028-01-13 11:09:08.888325598 +0000 UTC" Jul 08 19:01:15.707388 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.707387 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13288h7m53.180943533s" Jul 08 19:01:15.774144 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:15.774065 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:15.846782 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.846745 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:15.848748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.848731 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:15.848842 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.848767 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:15.848842 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.848786 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:15.874431 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:15.874403 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:15.974983 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:15.974951 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:15.993178 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.993152 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:01:15.993926 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:15.993883 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64d84b2ff9c3bb74e9379c477de15a9.slice/crio-d15ed2ae1a3c280752facffb9fe4922050170a0b4925c938f216b84cd90d1c27 WatchSource:0}: Error finding container d15ed2ae1a3c280752facffb9fe4922050170a0b4925c938f216b84cd90d1c27: Status 404 returned error can't find the container with id d15ed2ae1a3c280752facffb9fe4922050170a0b4925c938f216b84cd90d1c27 Jul 08 19:01:15.994177 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:15.994164 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc16d154b3279b4f9d9e55179eee181c7.slice/crio-c70c23082b5e63677032811c0bd82e6bcdffee87a63b10b483cc356b960ccb7c WatchSource:0}: Error finding container c70c23082b5e63677032811c0bd82e6bcdffee87a63b10b483cc356b960ccb7c: Status 404 returned error can't find the container with id c70c23082b5e63677032811c0bd82e6bcdffee87a63b10b483cc356b960ccb7c Jul 08 19:01:15.997584 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:15.997567 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:01:16.016431 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.016410 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:01:16.077287 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.077194 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:16.177394 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.177351 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-32.ec2.internal\" not found" Jul 08 19:01:16.211088 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.211067 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:01:16.278185 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.278136 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" Jul 08 19:01:16.298858 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.298836 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 19:01:16.299738 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.299725 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-32.ec2.internal" Jul 08 19:01:16.315184 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.315164 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 19:01:16.659290 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.659222 2577 apiserver.go:52] "Watching apiserver" Jul 08 19:01:16.667653 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.667629 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 19:01:16.668489 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.668452 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-32.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485","openshift-dns/node-resolver-jf5mb","openshift-image-registry/node-ca-mtzxd","openshift-multus/multus-additional-cni-plugins-g5mjl","openshift-network-diagnostics/network-check-target-8gfm5","openshift-cluster-node-tuning-operator/tuned-q2lxq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal","openshift-multus/multus-bmxct","openshift-multus/network-metrics-daemon-gkpxk","openshift-network-operator/iptables-alerter-d9v78","openshift-ovn-kubernetes/ovnkube-node-jjl58","kube-system/global-pull-secret-syncer-fxx2m","kube-system/konnectivity-agent-7mb8t"] Jul 08 19:01:16.672782 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.672756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.673837 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.673810 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 19:01:16.674985 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.674966 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:16.675076 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.675033 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:16.675714 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.675695 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:01:16.675799 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.675721 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 19:01:16.676137 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.676117 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dkf2w\"" Jul 08 19:01:16.678079 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.678058 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jf5mb" Jul 08 19:01:16.680691 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.680668 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mtzxd" Jul 08 19:01:16.681003 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.680978 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 19:01:16.681335 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.681319 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 19:01:16.681396 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.681366 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gsc9h\"" Jul 08 19:01:16.683221 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.683205 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.684702 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.684686 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 19:01:16.684787 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.684718 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 19:01:16.685526 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685506 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:16.685614 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.685576 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:16.685690 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:16.685728 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-sysconfig\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.685774 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-sysctl-conf\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.685774 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-lib-modules\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.685843 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685776 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/904992b3-8110-4a60-8b7f-e601707754ce-etc-tuned\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.685843 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685792 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-sysctl-d\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.685843 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-sys\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.685843 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-var-lib-kubelet\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.685966 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-host\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.685966 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904992b3-8110-4a60-8b7f-e601707754ce-tmp\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.685966 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685882 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6z4t\" (UniqueName: \"kubernetes.io/projected/904992b3-8110-4a60-8b7f-e601707754ce-kube-api-access-n6z4t\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.685966 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-dbus\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:16.685966 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-kubernetes\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.685966 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-run\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.685966 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-modprobe-d\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.686168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685977 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-systemd\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.686168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685990 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 19:01:16.686168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.686001 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-kubelet-config\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:16.686168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.686023 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 19:01:16.686168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.685978 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 19:01:16.686318 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.686198 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 19:01:16.686488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.686463 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 19:01:16.686551 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.686486 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vsl44\"" Jul 08 19:01:16.686551 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.686543 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 19:01:16.686821 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.686800 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9rgkq\"" Jul 08 19:01:16.687363 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.687339 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 19:01:16.687908 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.687891 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.690397 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.690362 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4dp5p\"" Jul 08 19:01:16.690564 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.690548 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7mb8t" Jul 08 19:01:16.690626 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.690600 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 19:01:16.692952 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.692908 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.693450 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.693433 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 19:01:16.693528 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.693479 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 19:01:16.694095 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.694081 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6s5dl\"" Jul 08 19:01:16.695293 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.695254 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:16.695396 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.695370 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:16.695477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.695460 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 19:01:16.695678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.695663 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9znjg\"" Jul 08 19:01:16.695714 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.695699 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 19:01:16.696141 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.696128 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 19:01:16.697684 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.697662 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d9v78" Jul 08 19:01:16.700324 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.700302 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jx8mk\"" Jul 08 19:01:16.700418 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.700306 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.700617 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.700598 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 19:01:16.700910 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.700894 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:01:16.701183 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.701166 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 19:01:16.703893 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.703875 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 19:01:16.704330 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.704310 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 19:01:16.704426 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.704320 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 19:01:16.706794 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.705999 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-77vqq\"" Jul 08 19:01:16.706794 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.706281 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 19:01:16.706794 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.706436 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 19:01:16.706794 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.706549 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 19:01:16.723301 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.723250 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-97wlz" Jul 08 19:01:16.732496 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.732474 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-97wlz" Jul 08 19:01:16.775414 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.775381 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 19:01:16.789051 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.788810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-sysconfig\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.789051 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.788852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-sysctl-conf\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.789051 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.788880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-lib-modules\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.789051 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.788911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1306beae-2a22-4c5b-a1a3-cf0faf472251-system-cni-dir\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.789051 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.788939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/561fd62e-f32c-4ebc-82da-ffba58319ef2-konnectivity-ca\") pod \"konnectivity-agent-7mb8t\" (UID: \"561fd62e-f32c-4ebc-82da-ffba58319ef2\") " pod="kube-system/konnectivity-agent-7mb8t" Jul 08 19:01:16.789051 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.788966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2slfp\" (UniqueName: \"kubernetes.io/projected/0567a65b-384d-4e96-80cb-2387578db093-kube-api-access-2slfp\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.789051 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.788995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-sys\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.789051 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-host\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.789051 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-ovn-node-metrics-cert\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.789051 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-sysctl-conf\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-os-release\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-kubernetes\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789133 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-sysconfig\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f3fb3fe-6913-4c8e-8497-748fe372a7d3-iptables-alerter-script\") pod \"iptables-alerter-d9v78\" (UID: \"4f3fb3fe-6913-4c8e-8497-748fe372a7d3\") " pod="openshift-network-operator/iptables-alerter-d9v78" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-kubelet-config\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789228 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-sys\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789232 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-host\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-run-netns\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789317 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-kubelet-config\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789335 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-kubernetes\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-var-lib-openvswitch\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzntw\" (UniqueName: \"kubernetes.io/projected/1306beae-2a22-4c5b-a1a3-cf0faf472251-kube-api-access-rzntw\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-var-lib-kubelet\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-multus-conf-dir\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.789674 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/904992b3-8110-4a60-8b7f-e601707754ce-etc-tuned\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-cni-bin\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-run-netns\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-run-multus-certs\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb4r6\" (UniqueName: \"kubernetes.io/projected/5f900e16-5f4a-49c5-b112-8c18d037071e-kube-api-access-mb4r6\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-lib-modules\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789790 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-var-lib-kubelet\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-dbus\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-run-systemd\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789868 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-var-lib-kubelet\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-run-ovn\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789917 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1306beae-2a22-4c5b-a1a3-cf0faf472251-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789928 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s892\" (UniqueName: \"kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892\") pod \"network-check-target-8gfm5\" (UID: \"dca44699-6002-4eb4-a852-5b1e3e3321ca\") " pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.789972 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a16935f-0d0d-481f-b13d-d795748d25a1-tmp-dir\") pod \"node-resolver-jf5mb\" (UID: \"0a16935f-0d0d-481f-b13d-d795748d25a1\") " pod="openshift-dns/node-resolver-jf5mb" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0567a65b-384d-4e96-80cb-2387578db093-cni-binary-copy\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-run\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.790488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-systemd-units\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790094 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1306beae-2a22-4c5b-a1a3-cf0faf472251-cnibin\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsg2p\" (UniqueName: \"kubernetes.io/projected/0a16935f-0d0d-481f-b13d-d795748d25a1-kube-api-access-tsg2p\") pod \"node-resolver-jf5mb\" (UID: \"0a16935f-0d0d-481f-b13d-d795748d25a1\") " pod="openshift-dns/node-resolver-jf5mb" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790143 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-var-lib-cni-bin\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790167 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-var-lib-cni-multus\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-hostroot\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0567a65b-384d-4e96-80cb-2387578db093-multus-daemon-config\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790070 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-dbus\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-slash\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-etc-openvswitch\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-cni-netd\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790415 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4njtc\" (UniqueName: \"kubernetes.io/projected/7578bca4-894d-4728-91c6-58a80610d546-kube-api-access-4njtc\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790384 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-run\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.790443 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790442 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-multus-cni-dir\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.791425 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.790526 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret podName:f961bcd4-9cc9-45fd-bf10-6c82cf845d0a nodeName:}" failed. No retries permitted until 2026-07-08 19:01:17.290494955 +0000 UTC m=+2.896408006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret") pod "global-pull-secret-syncer-fxx2m" (UID: "f961bcd4-9cc9-45fd-bf10-6c82cf845d0a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-system-cni-dir\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-etc-kubernetes\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790617 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6z4t\" (UniqueName: \"kubernetes.io/projected/904992b3-8110-4a60-8b7f-e601707754ce-kube-api-access-n6z4t\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-node-log\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-ovnkube-script-lib\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llggl\" (UniqueName: \"kubernetes.io/projected/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-kube-api-access-llggl\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790935 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1306beae-2a22-4c5b-a1a3-cf0faf472251-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-multus-socket-dir-parent\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.790986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-socket-dir\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-log-socket\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-run-k8s-cni-cncf-io\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-registration-dir\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-sys-fs\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.792266 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-modprobe-d\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-run-openvswitch\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791227 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1306beae-2a22-4c5b-a1a3-cf0faf472251-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/561fd62e-f32c-4ebc-82da-ffba58319ef2-agent-certs\") pod \"konnectivity-agent-7mb8t\" (UID: \"561fd62e-f32c-4ebc-82da-ffba58319ef2\") " pod="kube-system/konnectivity-agent-7mb8t" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-kubelet\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-ovnkube-config\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a16935f-0d0d-481f-b13d-d795748d25a1-hosts-file\") pod \"node-resolver-jf5mb\" (UID: \"0a16935f-0d0d-481f-b13d-d795748d25a1\") " pod="openshift-dns/node-resolver-jf5mb" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791361 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctppp\" (UniqueName: \"kubernetes.io/projected/3a33998b-fe43-48ce-ba28-19cfa98a95df-kube-api-access-ctppp\") pod \"node-ca-mtzxd\" (UID: \"3a33998b-fe43-48ce-ba28-19cfa98a95df\") " pod="openshift-image-registry/node-ca-mtzxd" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-sysctl-d\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904992b3-8110-4a60-8b7f-e601707754ce-tmp\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-modprobe-d\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghx74\" (UniqueName: \"kubernetes.io/projected/4f3fb3fe-6913-4c8e-8497-748fe372a7d3-kube-api-access-ghx74\") pod \"iptables-alerter-d9v78\" (UID: \"4f3fb3fe-6913-4c8e-8497-748fe372a7d3\") " pod="openshift-network-operator/iptables-alerter-d9v78" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1306beae-2a22-4c5b-a1a3-cf0faf472251-os-release\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791520 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a33998b-fe43-48ce-ba28-19cfa98a95df-host\") pod \"node-ca-mtzxd\" (UID: \"3a33998b-fe43-48ce-ba28-19cfa98a95df\") " pod="openshift-image-registry/node-ca-mtzxd" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a33998b-fe43-48ce-ba28-19cfa98a95df-serviceca\") pod \"node-ca-mtzxd\" (UID: \"3a33998b-fe43-48ce-ba28-19cfa98a95df\") " pod="openshift-image-registry/node-ca-mtzxd" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-device-dir\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791581 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-sysctl-d\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.793081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-env-overrides\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.793957 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-systemd\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.793957 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-32.ec2.internal" event={"ID":"c64d84b2ff9c3bb74e9379c477de15a9","Type":"ContainerStarted","Data":"d15ed2ae1a3c280752facffb9fe4922050170a0b4925c938f216b84cd90d1c27"} Jul 08 19:01:16.793957 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f3fb3fe-6913-4c8e-8497-748fe372a7d3-host-slash\") pod \"iptables-alerter-d9v78\" (UID: \"4f3fb3fe-6913-4c8e-8497-748fe372a7d3\") " pod="openshift-network-operator/iptables-alerter-d9v78" Jul 08 19:01:16.793957 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791679 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.793957 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1306beae-2a22-4c5b-a1a3-cf0faf472251-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.793957 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-cnibin\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.793957 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.791764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/904992b3-8110-4a60-8b7f-e601707754ce-etc-systemd\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.793957 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.793819 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" event={"ID":"c16d154b3279b4f9d9e55179eee181c7","Type":"ContainerStarted","Data":"c70c23082b5e63677032811c0bd82e6bcdffee87a63b10b483cc356b960ccb7c"} Jul 08 19:01:16.793957 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.793937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/904992b3-8110-4a60-8b7f-e601707754ce-etc-tuned\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.796445 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.796421 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904992b3-8110-4a60-8b7f-e601707754ce-tmp\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.802204 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.802176 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6z4t\" (UniqueName: \"kubernetes.io/projected/904992b3-8110-4a60-8b7f-e601707754ce-kube-api-access-n6z4t\") pod \"tuned-q2lxq\" (UID: \"904992b3-8110-4a60-8b7f-e601707754ce\") " pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-node-log\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-ovnkube-script-lib\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llggl\" (UniqueName: \"kubernetes.io/projected/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-kube-api-access-llggl\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1306beae-2a22-4c5b-a1a3-cf0faf472251-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-multus-socket-dir-parent\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895647 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-node-log\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-socket-dir\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895710 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-log-socket\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-log-socket\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-run-k8s-cni-cncf-io\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-registration-dir\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-sys-fs\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-run-openvswitch\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1306beae-2a22-4c5b-a1a3-cf0faf472251-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.896477 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895881 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-socket-dir\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/561fd62e-f32c-4ebc-82da-ffba58319ef2-agent-certs\") pod \"konnectivity-agent-7mb8t\" (UID: \"561fd62e-f32c-4ebc-82da-ffba58319ef2\") " pod="kube-system/konnectivity-agent-7mb8t" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-kubelet\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-ovnkube-config\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.895982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a16935f-0d0d-481f-b13d-d795748d25a1-hosts-file\") pod \"node-resolver-jf5mb\" (UID: \"0a16935f-0d0d-481f-b13d-d795748d25a1\") " pod="openshift-dns/node-resolver-jf5mb" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctppp\" (UniqueName: \"kubernetes.io/projected/3a33998b-fe43-48ce-ba28-19cfa98a95df-kube-api-access-ctppp\") pod \"node-ca-mtzxd\" (UID: \"3a33998b-fe43-48ce-ba28-19cfa98a95df\") " pod="openshift-image-registry/node-ca-mtzxd" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghx74\" (UniqueName: \"kubernetes.io/projected/4f3fb3fe-6913-4c8e-8497-748fe372a7d3-kube-api-access-ghx74\") pod \"iptables-alerter-d9v78\" (UID: \"4f3fb3fe-6913-4c8e-8497-748fe372a7d3\") " pod="openshift-network-operator/iptables-alerter-d9v78" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1306beae-2a22-4c5b-a1a3-cf0faf472251-os-release\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a33998b-fe43-48ce-ba28-19cfa98a95df-host\") pod \"node-ca-mtzxd\" (UID: \"3a33998b-fe43-48ce-ba28-19cfa98a95df\") " pod="openshift-image-registry/node-ca-mtzxd" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a33998b-fe43-48ce-ba28-19cfa98a95df-serviceca\") pod \"node-ca-mtzxd\" (UID: \"3a33998b-fe43-48ce-ba28-19cfa98a95df\") " pod="openshift-image-registry/node-ca-mtzxd" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-device-dir\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-env-overrides\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f3fb3fe-6913-4c8e-8497-748fe372a7d3-host-slash\") pod \"iptables-alerter-d9v78\" (UID: \"4f3fb3fe-6913-4c8e-8497-748fe372a7d3\") " pod="openshift-network-operator/iptables-alerter-d9v78" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1306beae-2a22-4c5b-a1a3-cf0faf472251-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-cnibin\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1306beae-2a22-4c5b-a1a3-cf0faf472251-system-cni-dir\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.897058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/561fd62e-f32c-4ebc-82da-ffba58319ef2-konnectivity-ca\") pod \"konnectivity-agent-7mb8t\" (UID: \"561fd62e-f32c-4ebc-82da-ffba58319ef2\") " pod="kube-system/konnectivity-agent-7mb8t" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2slfp\" (UniqueName: \"kubernetes.io/projected/0567a65b-384d-4e96-80cb-2387578db093-kube-api-access-2slfp\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-ovn-node-metrics-cert\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-os-release\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f3fb3fe-6913-4c8e-8497-748fe372a7d3-iptables-alerter-script\") pod \"iptables-alerter-d9v78\" (UID: \"4f3fb3fe-6913-4c8e-8497-748fe372a7d3\") " pod="openshift-network-operator/iptables-alerter-d9v78" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1306beae-2a22-4c5b-a1a3-cf0faf472251-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-run-netns\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-var-lib-openvswitch\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzntw\" (UniqueName: \"kubernetes.io/projected/1306beae-2a22-4c5b-a1a3-cf0faf472251-kube-api-access-rzntw\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896663 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-multus-socket-dir-parent\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-var-lib-kubelet\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896708 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-multus-conf-dir\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896724 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-device-dir\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-cni-bin\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-run-netns\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.897678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896766 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-run-k8s-cni-cncf-io\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-run-multus-certs\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb4r6\" (UniqueName: \"kubernetes.io/projected/5f900e16-5f4a-49c5-b112-8c18d037071e-kube-api-access-mb4r6\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896850 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-run-systemd\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896858 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-sys-fs\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-run-ovn\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896897 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-run-openvswitch\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1306beae-2a22-4c5b-a1a3-cf0faf472251-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s892\" (UniqueName: \"kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892\") pod \"network-check-target-8gfm5\" (UID: \"dca44699-6002-4eb4-a852-5b1e3e3321ca\") " pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a16935f-0d0d-481f-b13d-d795748d25a1-tmp-dir\") pod \"node-resolver-jf5mb\" (UID: \"0a16935f-0d0d-481f-b13d-d795748d25a1\") " pod="openshift-dns/node-resolver-jf5mb" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0567a65b-384d-4e96-80cb-2387578db093-cni-binary-copy\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-systemd-units\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1306beae-2a22-4c5b-a1a3-cf0faf472251-cnibin\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsg2p\" (UniqueName: \"kubernetes.io/projected/0a16935f-0d0d-481f-b13d-d795748d25a1-kube-api-access-tsg2p\") pod \"node-resolver-jf5mb\" (UID: \"0a16935f-0d0d-481f-b13d-d795748d25a1\") " pod="openshift-dns/node-resolver-jf5mb" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897095 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-var-lib-cni-bin\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-var-lib-cni-multus\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-hostroot\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.898257 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0567a65b-384d-4e96-80cb-2387578db093-multus-daemon-config\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-slash\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-etc-openvswitch\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-cni-netd\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897362 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1306beae-2a22-4c5b-a1a3-cf0faf472251-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897385 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4njtc\" (UniqueName: \"kubernetes.io/projected/7578bca4-894d-4728-91c6-58a80610d546-kube-api-access-4njtc\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897460 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1306beae-2a22-4c5b-a1a3-cf0faf472251-cnibin\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-run-netns\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897654 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-var-lib-cni-bin\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897701 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-var-lib-cni-multus\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.896819 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-registration-dir\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897799 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-cni-netd\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897810 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-slash\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-run-multus-certs\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897880 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-kubelet\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.898039 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0567a65b-384d-4e96-80cb-2387578db093-cni-binary-copy\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.898055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-ovnkube-config\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.898829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.898097 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-cni-bin\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.899466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.898179 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1306beae-2a22-4c5b-a1a3-cf0faf472251-os-release\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.899466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.898231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a33998b-fe43-48ce-ba28-19cfa98a95df-host\") pod \"node-ca-mtzxd\" (UID: \"3a33998b-fe43-48ce-ba28-19cfa98a95df\") " pod="openshift-image-registry/node-ca-mtzxd" Jul 08 19:01:16.899466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.898535 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-run-systemd\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.899466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.898591 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-run-ovn\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.899466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.898686 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a33998b-fe43-48ce-ba28-19cfa98a95df-serviceca\") pod \"node-ca-mtzxd\" (UID: \"3a33998b-fe43-48ce-ba28-19cfa98a95df\") " pod="openshift-image-registry/node-ca-mtzxd" Jul 08 19:01:16.899466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.898771 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1306beae-2a22-4c5b-a1a3-cf0faf472251-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.899466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.898794 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-env-overrides\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.899466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.898852 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f3fb3fe-6913-4c8e-8497-748fe372a7d3-host-slash\") pod \"iptables-alerter-d9v78\" (UID: \"4f3fb3fe-6913-4c8e-8497-748fe372a7d3\") " pod="openshift-network-operator/iptables-alerter-d9v78" Jul 08 19:01:16.899466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.898898 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.899466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.897745 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-hostroot\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.899466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899028 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-ovnkube-script-lib\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.899466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899230 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a16935f-0d0d-481f-b13d-d795748d25a1-tmp-dir\") pod \"node-resolver-jf5mb\" (UID: \"0a16935f-0d0d-481f-b13d-d795748d25a1\") " pod="openshift-dns/node-resolver-jf5mb" Jul 08 19:01:16.899891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899581 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a16935f-0d0d-481f-b13d-d795748d25a1-hosts-file\") pod \"node-resolver-jf5mb\" (UID: \"0a16935f-0d0d-481f-b13d-d795748d25a1\") " pod="openshift-dns/node-resolver-jf5mb" Jul 08 19:01:16.899891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0567a65b-384d-4e96-80cb-2387578db093-multus-daemon-config\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.899891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-multus-cni-dir\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.899891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899648 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.899891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899653 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-systemd-units\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.899891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-system-cni-dir\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.899891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899707 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-cnibin\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.899891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899707 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-etc-kubernetes\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.899891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-etc-kubernetes\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.899891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899824 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1306beae-2a22-4c5b-a1a3-cf0faf472251-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.899891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899867 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f900e16-5f4a-49c5-b112-8c18d037071e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.900258 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.899918 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:16.900258 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.899986 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs podName:7578bca4-894d-4728-91c6-58a80610d546 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:17.399963527 +0000 UTC m=+3.005876580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs") pod "network-metrics-daemon-gkpxk" (UID: "7578bca4-894d-4728-91c6-58a80610d546") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:16.900258 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-multus-cni-dir\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.900258 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.900182 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-run-netns\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.900258 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.900236 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-var-lib-openvswitch\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.900484 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.900462 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/561fd62e-f32c-4ebc-82da-ffba58319ef2-konnectivity-ca\") pod \"konnectivity-agent-7mb8t\" (UID: \"561fd62e-f32c-4ebc-82da-ffba58319ef2\") " pod="kube-system/konnectivity-agent-7mb8t" Jul 08 19:01:16.900528 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.900473 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.900563 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.900549 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1306beae-2a22-4c5b-a1a3-cf0faf472251-system-cni-dir\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.900658 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.900637 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-host-var-lib-kubelet\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.900725 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.900687 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f3fb3fe-6913-4c8e-8497-748fe372a7d3-iptables-alerter-script\") pod \"iptables-alerter-d9v78\" (UID: \"4f3fb3fe-6913-4c8e-8497-748fe372a7d3\") " pod="openshift-network-operator/iptables-alerter-d9v78" Jul 08 19:01:16.900725 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.900710 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-multus-conf-dir\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.900725 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.899918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-system-cni-dir\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.900899 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.900869 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0567a65b-384d-4e96-80cb-2387578db093-os-release\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.901032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.901011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-etc-openvswitch\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.903286 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.903257 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/561fd62e-f32c-4ebc-82da-ffba58319ef2-agent-certs\") pod \"konnectivity-agent-7mb8t\" (UID: \"561fd62e-f32c-4ebc-82da-ffba58319ef2\") " pod="kube-system/konnectivity-agent-7mb8t" Jul 08 19:01:16.903530 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.903509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-ovn-node-metrics-cert\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.911991 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.911922 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:16.911991 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.911960 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:16.911991 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.911973 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s892 for pod openshift-network-diagnostics/network-check-target-8gfm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:16.912167 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:16.912042 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892 podName:dca44699-6002-4eb4-a852-5b1e3e3321ca nodeName:}" failed. No retries permitted until 2026-07-08 19:01:17.41202765 +0000 UTC m=+3.017940719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6s892" (UniqueName: "kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892") pod "network-check-target-8gfm5" (UID: "dca44699-6002-4eb4-a852-5b1e3e3321ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:16.915838 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.915811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsg2p\" (UniqueName: \"kubernetes.io/projected/0a16935f-0d0d-481f-b13d-d795748d25a1-kube-api-access-tsg2p\") pod \"node-resolver-jf5mb\" (UID: \"0a16935f-0d0d-481f-b13d-d795748d25a1\") " pod="openshift-dns/node-resolver-jf5mb" Jul 08 19:01:16.915963 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.915946 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctppp\" (UniqueName: \"kubernetes.io/projected/3a33998b-fe43-48ce-ba28-19cfa98a95df-kube-api-access-ctppp\") pod \"node-ca-mtzxd\" (UID: \"3a33998b-fe43-48ce-ba28-19cfa98a95df\") " pod="openshift-image-registry/node-ca-mtzxd" Jul 08 19:01:16.918081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.917627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb4r6\" (UniqueName: \"kubernetes.io/projected/5f900e16-5f4a-49c5-b112-8c18d037071e-kube-api-access-mb4r6\") pod \"aws-ebs-csi-driver-node-8x485\" (UID: \"5f900e16-5f4a-49c5-b112-8c18d037071e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:16.918081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.918040 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llggl\" (UniqueName: \"kubernetes.io/projected/117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff-kube-api-access-llggl\") pod \"ovnkube-node-jjl58\" (UID: \"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:16.923702 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.923672 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4njtc\" (UniqueName: \"kubernetes.io/projected/7578bca4-894d-4728-91c6-58a80610d546-kube-api-access-4njtc\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:16.924370 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.924311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghx74\" (UniqueName: \"kubernetes.io/projected/4f3fb3fe-6913-4c8e-8497-748fe372a7d3-kube-api-access-ghx74\") pod \"iptables-alerter-d9v78\" (UID: \"4f3fb3fe-6913-4c8e-8497-748fe372a7d3\") " pod="openshift-network-operator/iptables-alerter-d9v78" Jul 08 19:01:16.926238 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.926172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzntw\" (UniqueName: \"kubernetes.io/projected/1306beae-2a22-4c5b-a1a3-cf0faf472251-kube-api-access-rzntw\") pod \"multus-additional-cni-plugins-g5mjl\" (UID: \"1306beae-2a22-4c5b-a1a3-cf0faf472251\") " pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:16.927425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.927402 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2slfp\" (UniqueName: \"kubernetes.io/projected/0567a65b-384d-4e96-80cb-2387578db093-kube-api-access-2slfp\") pod \"multus-bmxct\" (UID: \"0567a65b-384d-4e96-80cb-2387578db093\") " pod="openshift-multus/multus-bmxct" Jul 08 19:01:16.982169 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.982134 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" Jul 08 19:01:16.990691 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.990653 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jf5mb" Jul 08 19:01:16.996583 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:16.996551 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904992b3_8110_4a60_8b7f_e601707754ce.slice/crio-ae41f89748419cae1a10750df18cc94301799398f51afde9a14e38bf118bb2d6 WatchSource:0}: Error finding container ae41f89748419cae1a10750df18cc94301799398f51afde9a14e38bf118bb2d6: Status 404 returned error can't find the container with id ae41f89748419cae1a10750df18cc94301799398f51afde9a14e38bf118bb2d6 Jul 08 19:01:16.998110 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:16.998084 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mtzxd" Jul 08 19:01:17.002459 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.002435 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g5mjl" Jul 08 19:01:17.003729 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:17.003704 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a16935f_0d0d_481f_b13d_d795748d25a1.slice/crio-47a11b7935739747a7739e2d1306742038eb94e460480e0d163e3ec7a68c8065 WatchSource:0}: Error finding container 47a11b7935739747a7739e2d1306742038eb94e460480e0d163e3ec7a68c8065: Status 404 returned error can't find the container with id 47a11b7935739747a7739e2d1306742038eb94e460480e0d163e3ec7a68c8065 Jul 08 19:01:17.009394 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.009229 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bmxct" Jul 08 19:01:17.013309 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:17.013281 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a33998b_fe43_48ce_ba28_19cfa98a95df.slice/crio-637bf5afb0b5ce6e4672b37f3c9dcd1bee66267d9ae46081f06d775375fa1c75 WatchSource:0}: Error finding container 637bf5afb0b5ce6e4672b37f3c9dcd1bee66267d9ae46081f06d775375fa1c75: Status 404 returned error can't find the container with id 637bf5afb0b5ce6e4672b37f3c9dcd1bee66267d9ae46081f06d775375fa1c75 Jul 08 19:01:17.015693 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.015666 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7mb8t" Jul 08 19:01:17.026726 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.024468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" Jul 08 19:01:17.031409 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.031388 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d9v78" Jul 08 19:01:17.036551 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:17.036522 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561fd62e_f32c_4ebc_82da_ffba58319ef2.slice/crio-ee7926250d1f4ae3ad857c5fd1ddf66704f14768b64b2737c02cc0cf46eff6ef WatchSource:0}: Error finding container ee7926250d1f4ae3ad857c5fd1ddf66704f14768b64b2737c02cc0cf46eff6ef: Status 404 returned error can't find the container with id ee7926250d1f4ae3ad857c5fd1ddf66704f14768b64b2737c02cc0cf46eff6ef Jul 08 19:01:17.036691 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.036669 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:17.041909 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:17.041183 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f900e16_5f4a_49c5_b112_8c18d037071e.slice/crio-91dc769350b590aa4ca9fc9ab4016788518e8cffdf827cdfc2e0bbe92b6db15c WatchSource:0}: Error finding container 91dc769350b590aa4ca9fc9ab4016788518e8cffdf827cdfc2e0bbe92b6db15c: Status 404 returned error can't find the container with id 91dc769350b590aa4ca9fc9ab4016788518e8cffdf827cdfc2e0bbe92b6db15c Jul 08 19:01:17.049823 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:01:17.049794 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117fd7e7_8453_43bf_b5ea_6c9ef15bd0ff.slice/crio-63ed2b18145e2f0563657fa0625384602fcf336df2b08084f87ab49b1d593f30 WatchSource:0}: Error finding container 63ed2b18145e2f0563657fa0625384602fcf336df2b08084f87ab49b1d593f30: Status 404 returned error can't find the container with id 63ed2b18145e2f0563657fa0625384602fcf336df2b08084f87ab49b1d593f30 Jul 08 19:01:17.094320 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.094287 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:01:17.303651 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.303571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:17.303807 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:17.303687 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:17.303807 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:17.303738 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret podName:f961bcd4-9cc9-45fd-bf10-6c82cf845d0a nodeName:}" failed. No retries permitted until 2026-07-08 19:01:18.303723811 +0000 UTC m=+3.909636862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret") pod "global-pull-secret-syncer-fxx2m" (UID: "f961bcd4-9cc9-45fd-bf10-6c82cf845d0a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:17.404882 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.404851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:17.405042 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:17.404980 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:17.405124 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:17.405050 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs podName:7578bca4-894d-4728-91c6-58a80610d546 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:18.405019339 +0000 UTC m=+4.010932391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs") pod "network-metrics-daemon-gkpxk" (UID: "7578bca4-894d-4728-91c6-58a80610d546") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:17.505655 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.505622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s892\" (UniqueName: \"kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892\") pod \"network-check-target-8gfm5\" (UID: \"dca44699-6002-4eb4-a852-5b1e3e3321ca\") " pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:17.505832 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:17.505786 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:17.505832 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:17.505807 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:17.505832 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:17.505825 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s892 for pod openshift-network-diagnostics/network-check-target-8gfm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:17.505980 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:17.505893 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892 podName:dca44699-6002-4eb4-a852-5b1e3e3321ca nodeName:}" failed. No retries permitted until 2026-07-08 19:01:18.50587396 +0000 UTC m=+4.111787013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s892" (UniqueName: "kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892") pod "network-check-target-8gfm5" (UID: "dca44699-6002-4eb4-a852-5b1e3e3321ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:17.735755 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.735700 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:56:17 +0000 UTC" deadline="2028-01-06 03:24:46.201613639 +0000 UTC" Jul 08 19:01:17.735755 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.735747 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13112h23m28.46587194s" Jul 08 19:01:17.782520 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.782481 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:17.782715 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:17.782634 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:17.797530 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.797477 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7mb8t" event={"ID":"561fd62e-f32c-4ebc-82da-ffba58319ef2","Type":"ContainerStarted","Data":"ee7926250d1f4ae3ad857c5fd1ddf66704f14768b64b2737c02cc0cf46eff6ef"} Jul 08 19:01:17.799048 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.799015 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bmxct" event={"ID":"0567a65b-384d-4e96-80cb-2387578db093","Type":"ContainerStarted","Data":"14bc3c7a4b7763a15cc02af603d9f120baea0ed61f963d811a7b262ac5cf2c8e"} Jul 08 19:01:17.800509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.800475 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5mjl" event={"ID":"1306beae-2a22-4c5b-a1a3-cf0faf472251","Type":"ContainerStarted","Data":"234c3ef8d4233608abedb304a0c0e629f788eb62638bc4deab5efa442b3173b3"} Jul 08 19:01:17.801946 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.801924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mtzxd" event={"ID":"3a33998b-fe43-48ce-ba28-19cfa98a95df","Type":"ContainerStarted","Data":"637bf5afb0b5ce6e4672b37f3c9dcd1bee66267d9ae46081f06d775375fa1c75"} Jul 08 19:01:17.803570 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.803535 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d9v78" event={"ID":"4f3fb3fe-6913-4c8e-8497-748fe372a7d3","Type":"ContainerStarted","Data":"c9a2c4d5f5999c83f112b6d17a320dcd05608242db9a88c9b3ad0c8e33affc79"} Jul 08 19:01:17.804857 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.804836 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jf5mb" event={"ID":"0a16935f-0d0d-481f-b13d-d795748d25a1","Type":"ContainerStarted","Data":"47a11b7935739747a7739e2d1306742038eb94e460480e0d163e3ec7a68c8065"} Jul 08 19:01:17.806495 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.806471 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" event={"ID":"904992b3-8110-4a60-8b7f-e601707754ce","Type":"ContainerStarted","Data":"ae41f89748419cae1a10750df18cc94301799398f51afde9a14e38bf118bb2d6"} Jul 08 19:01:17.808125 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.808101 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" event={"ID":"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff","Type":"ContainerStarted","Data":"63ed2b18145e2f0563657fa0625384602fcf336df2b08084f87ab49b1d593f30"} Jul 08 19:01:17.809827 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:17.809801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" event={"ID":"5f900e16-5f4a-49c5-b112-8c18d037071e","Type":"ContainerStarted","Data":"91dc769350b590aa4ca9fc9ab4016788518e8cffdf827cdfc2e0bbe92b6db15c"} Jul 08 19:01:18.312621 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:18.312582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:18.312828 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:18.312744 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:18.312828 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:18.312811 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret podName:f961bcd4-9cc9-45fd-bf10-6c82cf845d0a nodeName:}" failed. No retries permitted until 2026-07-08 19:01:20.312791496 +0000 UTC m=+5.918704563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret") pod "global-pull-secret-syncer-fxx2m" (UID: "f961bcd4-9cc9-45fd-bf10-6c82cf845d0a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:18.414080 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:18.414036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:18.414279 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:18.414181 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:18.414279 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:18.414252 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs podName:7578bca4-894d-4728-91c6-58a80610d546 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:20.414232964 +0000 UTC m=+6.020146016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs") pod "network-metrics-daemon-gkpxk" (UID: "7578bca4-894d-4728-91c6-58a80610d546") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:18.515592 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:18.515550 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s892\" (UniqueName: \"kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892\") pod \"network-check-target-8gfm5\" (UID: \"dca44699-6002-4eb4-a852-5b1e3e3321ca\") " pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:18.515828 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:18.515802 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:18.515895 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:18.515839 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:18.515895 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:18.515858 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s892 for pod openshift-network-diagnostics/network-check-target-8gfm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:18.516007 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:18.515929 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892 podName:dca44699-6002-4eb4-a852-5b1e3e3321ca nodeName:}" failed. No retries permitted until 2026-07-08 19:01:20.515907035 +0000 UTC m=+6.121820114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s892" (UniqueName: "kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892") pod "network-check-target-8gfm5" (UID: "dca44699-6002-4eb4-a852-5b1e3e3321ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:18.737148 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:18.737021 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:56:17 +0000 UTC" deadline="2028-04-20 00:27:20.236967286 +0000 UTC" Jul 08 19:01:18.737148 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:18.737069 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15629h26m1.499903514s" Jul 08 19:01:18.784533 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:18.784478 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:18.784740 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:18.784628 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:18.785003 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:18.784487 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:18.785130 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:18.785107 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:19.782913 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:19.782298 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:19.782913 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:19.782470 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:20.333039 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:20.332979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:20.333249 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:20.333154 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:20.333249 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:20.333224 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret podName:f961bcd4-9cc9-45fd-bf10-6c82cf845d0a nodeName:}" failed. No retries permitted until 2026-07-08 19:01:24.333205317 +0000 UTC m=+9.939118388 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret") pod "global-pull-secret-syncer-fxx2m" (UID: "f961bcd4-9cc9-45fd-bf10-6c82cf845d0a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:20.434652 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:20.434609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:20.434890 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:20.434836 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:20.434966 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:20.434915 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs podName:7578bca4-894d-4728-91c6-58a80610d546 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:24.43489524 +0000 UTC m=+10.040808298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs") pod "network-metrics-daemon-gkpxk" (UID: "7578bca4-894d-4728-91c6-58a80610d546") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:20.536314 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:20.535721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s892\" (UniqueName: \"kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892\") pod \"network-check-target-8gfm5\" (UID: \"dca44699-6002-4eb4-a852-5b1e3e3321ca\") " pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:20.536314 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:20.535931 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:20.536314 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:20.535955 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:20.536314 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:20.535968 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s892 for pod openshift-network-diagnostics/network-check-target-8gfm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:20.536314 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:20.536026 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892 podName:dca44699-6002-4eb4-a852-5b1e3e3321ca nodeName:}" failed. No retries permitted until 2026-07-08 19:01:24.536010568 +0000 UTC m=+10.141923620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s892" (UniqueName: "kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892") pod "network-check-target-8gfm5" (UID: "dca44699-6002-4eb4-a852-5b1e3e3321ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:20.783389 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:20.783281 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:20.783864 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:20.783476 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:20.786024 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:20.785800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:20.786024 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:20.785930 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:21.782644 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:21.782607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:21.782838 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:21.782760 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:22.783750 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:22.783449 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:22.784341 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:22.783860 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:22.785589 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:22.785425 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:22.785589 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:22.785543 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:23.782146 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:23.782110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:23.782360 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:23.782254 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:24.372260 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.371772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:24.372260 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:24.371888 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:24.372260 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:24.371935 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret podName:f961bcd4-9cc9-45fd-bf10-6c82cf845d0a nodeName:}" failed. No retries permitted until 2026-07-08 19:01:32.37192272 +0000 UTC m=+17.977835771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret") pod "global-pull-secret-syncer-fxx2m" (UID: "f961bcd4-9cc9-45fd-bf10-6c82cf845d0a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:24.472464 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.472427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:24.472641 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:24.472621 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:24.472723 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:24.472703 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs podName:7578bca4-894d-4728-91c6-58a80610d546 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:32.472680895 +0000 UTC m=+18.078593965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs") pod "network-metrics-daemon-gkpxk" (UID: "7578bca4-894d-4728-91c6-58a80610d546") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:24.572871 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.572838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s892\" (UniqueName: \"kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892\") pod \"network-check-target-8gfm5\" (UID: \"dca44699-6002-4eb4-a852-5b1e3e3321ca\") " pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:24.573125 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:24.573050 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:24.573125 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:24.573073 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:24.573125 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:24.573086 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s892 for pod openshift-network-diagnostics/network-check-target-8gfm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:24.573304 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:24.573143 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892 podName:dca44699-6002-4eb4-a852-5b1e3e3321ca nodeName:}" failed. No retries permitted until 2026-07-08 19:01:32.573124242 +0000 UTC m=+18.179037308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s892" (UniqueName: "kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892") pod "network-check-target-8gfm5" (UID: "dca44699-6002-4eb4-a852-5b1e3e3321ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:24.782955 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.782573 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:24.782955 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:24.782670 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:24.783396 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.783240 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:24.783396 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:24.783365 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:24.831840 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.831243 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-32.ec2.internal" event={"ID":"c64d84b2ff9c3bb74e9379c477de15a9","Type":"ContainerStarted","Data":"3d84d6923b15b0dbdc6ec504f003712dc086f013afc3a46d6c77bf426799b027"} Jul 08 19:01:24.833960 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.833926 2577 generic.go:356] "Generic (PLEG): container finished" podID="c16d154b3279b4f9d9e55179eee181c7" containerID="e74e8a293f948e707e71caeb8196c6537adbb3e81fdfbc5b6a125c20f4a16cec" exitCode=0 Jul 08 19:01:24.834075 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.834015 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" event={"ID":"c16d154b3279b4f9d9e55179eee181c7","Type":"ContainerDied","Data":"e74e8a293f948e707e71caeb8196c6537adbb3e81fdfbc5b6a125c20f4a16cec"} Jul 08 19:01:24.836700 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.836676 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" event={"ID":"5f900e16-5f4a-49c5-b112-8c18d037071e","Type":"ContainerStarted","Data":"592c8870cd5d5e96892a16e5d0b74fb3a4515ca5e245cccf6d1d96e9b1222937"} Jul 08 19:01:24.838855 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.838333 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7mb8t" event={"ID":"561fd62e-f32c-4ebc-82da-ffba58319ef2","Type":"ContainerStarted","Data":"bd8005bdcb6f5a5ea6ed8874297dc00da1888258d9007b750594fe172283ddee"} Jul 08 19:01:24.840988 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.840960 2577 generic.go:356] "Generic (PLEG): container finished" podID="1306beae-2a22-4c5b-a1a3-cf0faf472251" containerID="5d31fcfe1c47e85679889ec6afd4e0f583722d27af97f93b0d1221381e7f14ac" exitCode=0 Jul 08 19:01:24.841087 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.841055 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5mjl" event={"ID":"1306beae-2a22-4c5b-a1a3-cf0faf472251","Type":"ContainerDied","Data":"5d31fcfe1c47e85679889ec6afd4e0f583722d27af97f93b0d1221381e7f14ac"} Jul 08 19:01:24.844518 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.844494 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mtzxd" event={"ID":"3a33998b-fe43-48ce-ba28-19cfa98a95df","Type":"ContainerStarted","Data":"f627a7f7ccb466f18c11d34843916f0be1d87055f54fbb2604071449b3e1047e"} Jul 08 19:01:24.846571 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.846543 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jf5mb" event={"ID":"0a16935f-0d0d-481f-b13d-d795748d25a1","Type":"ContainerStarted","Data":"81497c9f660c2b204776674a0d79b0417972fa363c0110a33c9f1e56f92a566b"} Jul 08 19:01:24.848109 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.848055 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-32.ec2.internal" podStartSLOduration=7.848036928 podStartE2EDuration="7.848036928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:24.846968675 +0000 UTC m=+10.452881752" watchObservedRunningTime="2026-07-08 19:01:24.848036928 +0000 UTC m=+10.453950003" Jul 08 19:01:24.905783 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.905605 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7mb8t" podStartSLOduration=2.821611078 podStartE2EDuration="9.905581549s" totalImagesPullingTime="7.083970471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:24.889289791 +0000 UTC m=+10.495202870" watchObservedRunningTime="2026-07-08 19:01:24.905581549 +0000 UTC m=+10.511494624" Jul 08 19:01:24.922953 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.922900 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jf5mb" podStartSLOduration=2.80645375 podStartE2EDuration="9.922880423s" totalImagesPullingTime="7.116426673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:24.90645839 +0000 UTC m=+10.512371466" watchObservedRunningTime="2026-07-08 19:01:24.922880423 +0000 UTC m=+10.528793500" Jul 08 19:01:24.923108 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:24.922991 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mtzxd" podStartSLOduration=2.807822066 podStartE2EDuration="9.922985844s" totalImagesPullingTime="7.115163778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:24.922665281 +0000 UTC m=+10.528578357" watchObservedRunningTime="2026-07-08 19:01:24.922985844 +0000 UTC m=+10.528898920" Jul 08 19:01:25.783004 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:25.782515 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:25.783004 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:25.782658 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:25.855374 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:25.855311 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d9v78" event={"ID":"4f3fb3fe-6913-4c8e-8497-748fe372a7d3","Type":"ContainerStarted","Data":"52851bc4d9f7d258d06414d6ee3af55ed52da864cac160e516817a9bd7249617"} Jul 08 19:01:25.870848 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:25.870787 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d9v78" podStartSLOduration=3.788283765 podStartE2EDuration="10.870765154s" totalImagesPullingTime="7.082481389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:25.870635939 +0000 UTC m=+11.476549015" watchObservedRunningTime="2026-07-08 19:01:25.870765154 +0000 UTC m=+11.476678232" Jul 08 19:01:26.372537 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:26.372499 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7mb8t" Jul 08 19:01:26.373360 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:26.373326 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7mb8t" Jul 08 19:01:26.782589 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:26.782510 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:26.782745 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:26.782625 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:26.782745 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:26.782680 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:26.782858 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:26.782781 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:27.782325 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:27.782292 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:27.782811 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:27.782431 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:27.859001 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:27.858608 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 19:01:28.783391 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:28.783360 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:28.784042 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:28.783483 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:28.784042 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:28.783867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:28.784042 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:28.783958 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:29.782207 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:29.782177 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:29.782407 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:29.782298 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:30.783033 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:30.782530 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:30.783033 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:30.782668 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:30.783816 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:30.783789 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:30.783965 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:30.783919 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:31.782451 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:31.782417 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:31.782621 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:31.782541 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:32.441328 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:32.441285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:32.441819 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:32.441454 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:32.441819 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:32.441539 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret podName:f961bcd4-9cc9-45fd-bf10-6c82cf845d0a nodeName:}" failed. No retries permitted until 2026-07-08 19:01:48.441517556 +0000 UTC m=+34.047430610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret") pod "global-pull-secret-syncer-fxx2m" (UID: "f961bcd4-9cc9-45fd-bf10-6c82cf845d0a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:32.542225 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:32.542172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:32.542409 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:32.542370 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:32.542468 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:32.542447 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs podName:7578bca4-894d-4728-91c6-58a80610d546 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:48.542425609 +0000 UTC m=+34.148338664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs") pod "network-metrics-daemon-gkpxk" (UID: "7578bca4-894d-4728-91c6-58a80610d546") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:32.643322 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:32.643245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s892\" (UniqueName: \"kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892\") pod \"network-check-target-8gfm5\" (UID: \"dca44699-6002-4eb4-a852-5b1e3e3321ca\") " pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:32.643479 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:32.643434 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:32.643479 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:32.643465 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:32.643581 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:32.643480 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s892 for pod openshift-network-diagnostics/network-check-target-8gfm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:32.643581 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:32.643549 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892 podName:dca44699-6002-4eb4-a852-5b1e3e3321ca nodeName:}" failed. No retries permitted until 2026-07-08 19:01:48.643529632 +0000 UTC m=+34.249442682 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s892" (UniqueName: "kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892") pod "network-check-target-8gfm5" (UID: "dca44699-6002-4eb4-a852-5b1e3e3321ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:32.782425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:32.782338 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:32.782425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:32.782396 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:32.782634 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:32.782474 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:32.782634 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:32.782608 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:33.782713 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:33.782680 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:33.783157 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:33.782810 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:34.782919 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:34.782887 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:34.783514 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:34.782966 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:34.783514 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:34.782995 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:34.783514 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:34.783063 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:35.782849 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:35.782816 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:35.783033 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:35.783009 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:36.148691 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:36.148609 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:36.235631 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:36.235602 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:36.687816 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:36.687777 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7mb8t" Jul 08 19:01:36.688136 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:36.687908 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 19:01:36.688478 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:36.688390 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7mb8t" Jul 08 19:01:36.752226 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:36.752182 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:36.782413 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:36.782384 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:36.782604 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:36.782521 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:36.782878 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:36.782857 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:36.782966 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:36.782949 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:37.782639 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:37.782599 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:37.783065 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:37.782705 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:38.782664 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:38.782627 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:38.783122 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:38.782674 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:38.783122 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:38.782753 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:38.783122 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:38.782844 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:39.782629 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:39.782597 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:39.782779 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:39.782703 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:39.978327 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:39.977706 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 19:01:40.756291 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.755933 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T19:01:39.977924554Z","UUID":"fba5526c-d6e4-477c-83dd-c4edfebd7e01","Handler":null,"Name":"","Endpoint":""} Jul 08 19:01:40.757317 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.757300 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 19:01:40.757414 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.757333 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 19:01:40.781963 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.781937 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:40.782142 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.781939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:40.782142 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:40.782033 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:40.782241 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:40.782145 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:40.887014 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.886978 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" event={"ID":"c16d154b3279b4f9d9e55179eee181c7","Type":"ContainerStarted","Data":"18516885c90862c25f10749b59f9e65a1ac23bdb2c38e186db9af0c3da5fc799"} Jul 08 19:01:40.890138 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.890093 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" event={"ID":"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff","Type":"ContainerStarted","Data":"d4eae51ab358e17229883b7a3bc384452a13941cb605e5490d4781984508effb"} Jul 08 19:01:40.890307 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.890169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" event={"ID":"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff","Type":"ContainerStarted","Data":"64dbfbf2ea8d845716254009159ce6c44d709a770fcd3845ef26b3f6f3050449"} Jul 08 19:01:40.890307 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.890229 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" event={"ID":"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff","Type":"ContainerStarted","Data":"cd5b54087b96ba0d433984448d50237e15f7907a975478cf8c6f3ee72ee8e392"} Jul 08 19:01:40.890307 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.890291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" event={"ID":"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff","Type":"ContainerStarted","Data":"9237e8235df7cecdcc07ac1a0de84eba55bfe759320131c8d1a54a2286c97282"} Jul 08 19:01:40.890425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.890333 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" event={"ID":"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff","Type":"ContainerStarted","Data":"5e13b4194feb203818253e7852a93cdf70742b75c9dac1a1883eac445efe8b3f"} Jul 08 19:01:40.890425 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.890368 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" event={"ID":"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff","Type":"ContainerStarted","Data":"43cce72666e80b42d2b425887bf1394bf716830f209ea7389165c60ae2ac3d8b"} Jul 08 19:01:40.891755 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.891732 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" event={"ID":"5f900e16-5f4a-49c5-b112-8c18d037071e","Type":"ContainerStarted","Data":"dc65c6368cdec1ccf8c27b042a67452e751edc15682e99f9f1ddaa75e39bf7ed"} Jul 08 19:01:40.893096 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.893078 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bmxct" event={"ID":"0567a65b-384d-4e96-80cb-2387578db093","Type":"ContainerStarted","Data":"6d21e82460e1420592acf967125fd153a08781479b63e8ef4f54ae74aa06e950"} Jul 08 19:01:40.894937 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.894918 2577 generic.go:356] "Generic (PLEG): container finished" podID="1306beae-2a22-4c5b-a1a3-cf0faf472251" containerID="b4798dd6bc8a08340d74fa42bf24d1d82e904ebda47434e854fefa6675ded628" exitCode=0 Jul 08 19:01:40.895023 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.894985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5mjl" event={"ID":"1306beae-2a22-4c5b-a1a3-cf0faf472251","Type":"ContainerDied","Data":"b4798dd6bc8a08340d74fa42bf24d1d82e904ebda47434e854fefa6675ded628"} Jul 08 19:01:40.896295 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.896279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" event={"ID":"904992b3-8110-4a60-8b7f-e601707754ce","Type":"ContainerStarted","Data":"8ee26bbeec49648ca464beda55d4202220196ec93caf03bc531a084f8a5f124b"} Jul 08 19:01:40.902639 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.902608 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-32.ec2.internal" podStartSLOduration=23.902591747 podStartE2EDuration="23.902591747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:40.902161017 +0000 UTC m=+26.508074099" watchObservedRunningTime="2026-07-08 19:01:40.902591747 +0000 UTC m=+26.508504819" Jul 08 19:01:40.917272 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.917214 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q2lxq" podStartSLOduration=3.66340274 podStartE2EDuration="25.917201354s" totalImagesPullingTime="22.253798614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:40.917073215 +0000 UTC m=+26.522986287" watchObservedRunningTime="2026-07-08 19:01:40.917201354 +0000 UTC m=+26.523114426" Jul 08 19:01:40.959781 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:40.959734 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bmxct" podStartSLOduration=3.177714064 podStartE2EDuration="25.959720444s" totalImagesPullingTime="22.78200638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:40.959492643 +0000 UTC m=+26.565405715" watchObservedRunningTime="2026-07-08 19:01:40.959720444 +0000 UTC m=+26.565633515" Jul 08 19:01:41.092498 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:41.092411 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:41.144813 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:41.144779 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:41.782461 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:41.782431 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:41.782633 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:41.782549 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:42.699212 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:42.699179 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:42.782308 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:42.782220 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:42.782450 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:42.782369 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:42.782450 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:42.782417 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:42.782568 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:42.782545 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:42.785725 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:42.785705 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:42.853399 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:42.853371 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:42.904748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:42.904708 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" event={"ID":"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff","Type":"ContainerStarted","Data":"ab3af8aa1976f142cd6455247c0cf6c9d62d6749d7309d6fc14eb14b96aee2eb"} Jul 08 19:01:42.907234 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:42.907203 2577 generic.go:356] "Generic (PLEG): container finished" podID="1306beae-2a22-4c5b-a1a3-cf0faf472251" containerID="298cc01a78783241bcfe19dd4776df7fb3d868208bacb14d3fca0eb7c3a5105b" exitCode=0 Jul 08 19:01:42.907391 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:42.907240 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5mjl" event={"ID":"1306beae-2a22-4c5b-a1a3-cf0faf472251","Type":"ContainerDied","Data":"298cc01a78783241bcfe19dd4776df7fb3d868208bacb14d3fca0eb7c3a5105b"} Jul 08 19:01:42.952998 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:42.952959 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:43.053429 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:43.053397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:43.150027 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:43.149997 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:43.725215 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:43.725177 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:43.782083 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:43.782057 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:43.782292 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:43.782172 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:43.783106 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:43.783074 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:43.911318 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:43.911281 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" event={"ID":"5f900e16-5f4a-49c5-b112-8c18d037071e","Type":"ContainerStarted","Data":"af0000e42fa308f4d84f7bc3346b6ad4d702367502b9275a4891eb453700310a"} Jul 08 19:01:44.126822 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:44.126742 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:44.181938 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:44.181904 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:44.783490 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:44.783104 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:44.783490 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:44.783199 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:44.783793 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:44.783502 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:44.783793 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:44.783562 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:44.915313 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:44.915280 2577 generic.go:356] "Generic (PLEG): container finished" podID="1306beae-2a22-4c5b-a1a3-cf0faf472251" containerID="d82a5bd15c2db17ff1ce55fdcdeca28aab4a43f10337069be88ade60731280f3" exitCode=0 Jul 08 19:01:44.915523 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:44.915370 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5mjl" event={"ID":"1306beae-2a22-4c5b-a1a3-cf0faf472251","Type":"ContainerDied","Data":"d82a5bd15c2db17ff1ce55fdcdeca28aab4a43f10337069be88ade60731280f3"} Jul 08 19:01:44.919095 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:44.919056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" event={"ID":"117fd7e7-8453-43bf-b5ea-6c9ef15bd0ff","Type":"ContainerStarted","Data":"195977c6870f8c4a85bf1248f8186d62f043c46c6bc780ae9f8056c0cf27bdea"} Jul 08 19:01:44.938027 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:44.937913 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8x485" podStartSLOduration=4.637254417 podStartE2EDuration="29.937898511s" totalImagesPullingTime="25.300644094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:43.931296014 +0000 UTC m=+29.537209087" watchObservedRunningTime="2026-07-08 19:01:44.937898511 +0000 UTC m=+30.543811585" Jul 08 19:01:44.963233 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:44.963189 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" podStartSLOduration=7.02554815 podStartE2EDuration="29.963174541s" totalImagesPullingTime="22.937626391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:44.962709379 +0000 UTC m=+30.568622453" watchObservedRunningTime="2026-07-08 19:01:44.963174541 +0000 UTC m=+30.569087613" Jul 08 19:01:45.157411 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:45.157380 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:45.781909 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:45.781871 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:45.782113 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:45.781999 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:45.921967 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:45.921940 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:45.922497 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:45.922028 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:45.922497 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:45.922072 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:45.944527 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:45.944482 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:45.945247 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:45.945152 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:01:46.635653 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:46.635628 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jf5mb_0a16935f-0d0d-481f-b13d-d795748d25a1/dns-node-resolver/0.log" Jul 08 19:01:46.782790 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:46.782758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:46.782932 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:46.782864 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:46.782932 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:46.782897 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:46.783020 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:46.782952 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:46.900844 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:46.900755 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fxx2m"] Jul 08 19:01:46.900965 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:46.900900 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:46.901068 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:46.901043 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:46.903933 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:46.903911 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gkpxk"] Jul 08 19:01:46.904753 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:46.904731 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8gfm5"] Jul 08 19:01:46.923228 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:46.923197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:46.923228 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:46.923217 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:46.923721 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:46.923328 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:46.923721 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:46.923452 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:47.398976 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:47.398897 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:47.500322 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:47.500283 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:47.840362 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:47.840286 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mtzxd_3a33998b-fe43-48ce-ba28-19cfa98a95df/node-ca/0.log" Jul 08 19:01:48.284706 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:48.284615 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:48.339678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:48.339644 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:48.467442 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:48.467407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:48.467621 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:48.467530 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:48.467621 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:48.467591 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret podName:f961bcd4-9cc9-45fd-bf10-6c82cf845d0a nodeName:}" failed. No retries permitted until 2026-07-08 19:02:20.467573286 +0000 UTC m=+66.073486350 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret") pod "global-pull-secret-syncer-fxx2m" (UID: "f961bcd4-9cc9-45fd-bf10-6c82cf845d0a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:48.568791 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:48.568691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:48.568944 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:48.568832 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:48.568944 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:48.568902 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs podName:7578bca4-894d-4728-91c6-58a80610d546 nodeName:}" failed. No retries permitted until 2026-07-08 19:02:20.5688807 +0000 UTC m=+66.174793750 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs") pod "network-metrics-daemon-gkpxk" (UID: "7578bca4-894d-4728-91c6-58a80610d546") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:48.670201 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:48.670165 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s892\" (UniqueName: \"kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892\") pod \"network-check-target-8gfm5\" (UID: \"dca44699-6002-4eb4-a852-5b1e3e3321ca\") " pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:48.670403 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:48.670356 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:48.670403 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:48.670381 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:48.670403 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:48.670395 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s892 for pod openshift-network-diagnostics/network-check-target-8gfm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:48.670566 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:48.670458 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892 podName:dca44699-6002-4eb4-a852-5b1e3e3321ca nodeName:}" failed. No retries permitted until 2026-07-08 19:02:20.670436922 +0000 UTC m=+66.276349974 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s892" (UniqueName: "kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892") pod "network-check-target-8gfm5" (UID: "dca44699-6002-4eb4-a852-5b1e3e3321ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:48.785840 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:48.785811 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:48.785988 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:48.785848 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:48.785988 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:48.785937 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:48.785988 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:48.785959 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:48.786115 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:48.786039 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:48.786155 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:48.786111 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:49.296368 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:49.296284 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:50.769324 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:50.769092 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:50.782226 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:50.782186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:50.782497 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:50.782186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:50.782497 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:50.782200 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:50.782497 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:50.782381 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:50.782497 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:50.782445 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:50.782712 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:50.782551 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:51.046683 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:51.046626 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:51.172764 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:51.172690 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:51.310983 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:51.310901 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:51.412353 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:51.412322 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:51.513042 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:51.513010 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:51.613758 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:51.613677 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:51.712984 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:51.712955 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:51.852183 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:51.852150 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:51.936795 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:51.936709 2577 generic.go:356] "Generic (PLEG): container finished" podID="1306beae-2a22-4c5b-a1a3-cf0faf472251" containerID="3c47468b9973c031db5b5d197c949042fbc450e8096d9f29d1557c5ede9b8b13" exitCode=0 Jul 08 19:01:51.936795 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:51.936785 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5mjl" event={"ID":"1306beae-2a22-4c5b-a1a3-cf0faf472251","Type":"ContainerDied","Data":"3c47468b9973c031db5b5d197c949042fbc450e8096d9f29d1557c5ede9b8b13"} Jul 08 19:01:52.067379 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:52.067349 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:52.662578 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:52.662542 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:52.782236 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:52.782203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:52.782424 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:52.782334 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:52.782424 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:52.782202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:52.782424 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:52.782370 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:52.782543 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:52.782426 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:52.782543 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:52.782495 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:52.942108 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:52.942022 2577 generic.go:356] "Generic (PLEG): container finished" podID="1306beae-2a22-4c5b-a1a3-cf0faf472251" containerID="c9cd4b11ce6d05509ca538c7b2eae9809e5bd7d927d333a673c79503efbca7a5" exitCode=0 Jul 08 19:01:52.942108 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:52.942072 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5mjl" event={"ID":"1306beae-2a22-4c5b-a1a3-cf0faf472251","Type":"ContainerDied","Data":"c9cd4b11ce6d05509ca538c7b2eae9809e5bd7d927d333a673c79503efbca7a5"} Jul 08 19:01:53.059993 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:53.059942 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:53.264514 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:53.264415 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:53.529133 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:53.529052 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:53.947936 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:53.947856 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5mjl" event={"ID":"1306beae-2a22-4c5b-a1a3-cf0faf472251","Type":"ContainerStarted","Data":"8ef8c9a1a56fa79f0cfdd650a8516c17c9d4b3a33f83a9f62ce023e0b236e3bb"} Jul 08 19:01:53.985041 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:53.984980 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g5mjl" podStartSLOduration=8.984660579 podStartE2EDuration="38.98495567s" totalImagesPullingTime="30.000295091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:53.984561772 +0000 UTC m=+39.590474842" watchObservedRunningTime="2026-07-08 19:01:53.98495567 +0000 UTC m=+39.590868743" Jul 08 19:01:54.786079 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:54.783917 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:54.786079 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:54.784079 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:54.786079 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:54.784355 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:54.786079 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:54.784465 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:54.786079 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:54.784666 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:54.786079 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:54.784789 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:55.618254 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:55.618213 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:56.785637 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:56.785556 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:56.786061 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:56.785671 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:56.786061 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:56.785686 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:56.786061 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:56.785763 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:56.786061 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:56.785810 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:56.786061 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:56.785887 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:57.547667 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:57.547633 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:57.611423 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:57.611363 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:57.672251 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:57.672194 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:57.880522 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:57.880419 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:58.782793 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:58.782757 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:01:58.782793 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:58.782778 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:01:58.783007 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:58.782763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:01:58.783007 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:58.782874 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:01:58.783007 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:58.782938 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:01:58.783104 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:01:58.783011 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:01:59.721590 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:59.721556 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:59.787348 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:59.787314 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:01:59.864125 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:01:59.864092 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:00.782622 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:00.782591 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:02:00.782622 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:00.782612 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:02:00.783056 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:00.782596 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:02:00.783056 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:00.782713 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:02:00.783056 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:00.782759 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:02:00.783056 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:00.782857 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:02:00.857245 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:00.857209 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:01.063572 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:01.063541 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:01.260617 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:01.260579 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:01.458240 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:01.458168 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:02.782532 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:02.782499 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:02:02.782532 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:02.782525 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:02:02.783056 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:02.782503 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:02:02.783056 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:02.782599 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:02:02.783056 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:02.782659 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:02:02.783056 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:02.782721 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:02:04.783603 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:04.783565 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:02:04.784019 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:04.783670 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:02:04.784019 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:04.783752 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:02:04.784019 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:04.783867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:02:04.784019 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:04.783880 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:02:04.784019 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:04.783943 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:02:05.038077 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:05.038004 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:05.094570 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:05.094547 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:05.426192 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:05.426160 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:05.644723 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:05.644690 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:05.928860 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:05.928824 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:06.785164 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:06.785134 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:02:06.785429 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:06.785225 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:02:06.785429 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:06.785232 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:02:06.785429 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:06.785249 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:02:06.785429 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:06.785353 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:02:06.785429 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:06.785402 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:02:07.917900 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:07.917861 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:08.016354 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:08.016322 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:08.629209 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:08.629174 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:08.708633 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:08.708605 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:08.782566 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:08.782537 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:02:08.782725 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:08.782539 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:02:08.782725 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:08.782630 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gfm5" podUID="dca44699-6002-4eb4-a852-5b1e3e3321ca" Jul 08 19:02:08.782725 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:08.782543 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:02:08.782725 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:08.782704 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxx2m" podUID="f961bcd4-9cc9-45fd-bf10-6c82cf845d0a" Jul 08 19:02:08.782854 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:08.782771 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpxk" podUID="7578bca4-894d-4728-91c6-58a80610d546" Jul 08 19:02:08.808759 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:08.808730 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:09.090170 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.090139 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:09.152631 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.152598 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:09.254376 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.254349 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:09.759423 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.759391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:09.792872 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.792852 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-32.ec2.internal" event="NodeReady" Jul 08 19:02:09.793010 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.792978 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 19:02:09.834314 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.834283 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-569654c8c9-q4ckr"] Jul 08 19:02:09.838141 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.838124 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:09.840920 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.840896 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 19:02:09.841032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.840903 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 19:02:09.841032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.840993 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 19:02:09.841144 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.841051 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2wp6b\"" Jul 08 19:02:09.846788 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.846767 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 19:02:09.846990 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.846976 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s9kjr"] Jul 08 19:02:09.850868 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.850854 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7v7vg"] Jul 08 19:02:09.851005 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.850990 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:09.852390 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.852371 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:09.854433 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.854414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7v7vg" Jul 08 19:02:09.855248 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.855234 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 19:02:09.855737 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.855722 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgfwc\"" Jul 08 19:02:09.856888 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.856851 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 19:02:09.857453 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.857436 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 19:02:09.857558 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.857525 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 19:02:09.858026 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.858009 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hl22b\"" Jul 08 19:02:09.858809 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.858792 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 19:02:09.859050 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.859032 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-569654c8c9-q4ckr"] Jul 08 19:02:09.862772 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.862748 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s9kjr"] Jul 08 19:02:09.867792 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.867774 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7v7vg"] Jul 08 19:02:09.934004 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.933971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0977f4c9-db1e-4e12-afb6-8bb9d513051c-image-registry-private-configuration\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:09.934004 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0977f4c9-db1e-4e12-afb6-8bb9d513051c-ca-trust-extracted\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:09.934223 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ed4d741-aa0d-4288-9c64-0e6e1e152c1d-tmp-dir\") pod \"dns-default-s9kjr\" (UID: \"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d\") " pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:09.934223 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0977f4c9-db1e-4e12-afb6-8bb9d513051c-registry-tls\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:09.934223 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0977f4c9-db1e-4e12-afb6-8bb9d513051c-bound-sa-token\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:09.934223 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hv68\" (UniqueName: \"kubernetes.io/projected/0977f4c9-db1e-4e12-afb6-8bb9d513051c-kube-api-access-8hv68\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:09.934223 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrdnb\" (UniqueName: \"kubernetes.io/projected/8ed4d741-aa0d-4288-9c64-0e6e1e152c1d-kube-api-access-zrdnb\") pod \"dns-default-s9kjr\" (UID: \"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d\") " pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:09.934223 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0977f4c9-db1e-4e12-afb6-8bb9d513051c-trusted-ca\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:09.934223 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934221 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8ed4d741-aa0d-4288-9c64-0e6e1e152c1d-config-volume\") pod \"dns-default-s9kjr\" (UID: \"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d\") " pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:09.934511 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/608f0288-cf38-4eec-832f-f1c1aad2502c-cert\") pod \"ingress-canary-7v7vg\" (UID: \"608f0288-cf38-4eec-832f-f1c1aad2502c\") " pod="openshift-ingress-canary/ingress-canary-7v7vg" Jul 08 19:02:09.934511 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0977f4c9-db1e-4e12-afb6-8bb9d513051c-registry-certificates\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:09.934511 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934329 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0977f4c9-db1e-4e12-afb6-8bb9d513051c-installation-pull-secrets\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:09.934511 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ed4d741-aa0d-4288-9c64-0e6e1e152c1d-metrics-tls\") pod \"dns-default-s9kjr\" (UID: \"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d\") " pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:09.934511 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.934364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcsv6\" (UniqueName: \"kubernetes.io/projected/608f0288-cf38-4eec-832f-f1c1aad2502c-kube-api-access-xcsv6\") pod \"ingress-canary-7v7vg\" (UID: \"608f0288-cf38-4eec-832f-f1c1aad2502c\") " pod="openshift-ingress-canary/ingress-canary-7v7vg" Jul 08 19:02:09.951925 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.951895 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tf76k"] Jul 08 19:02:09.955717 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.955698 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:09.959543 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.959526 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 19:02:09.959954 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.959935 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bk24w\"" Jul 08 19:02:09.960054 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.959934 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 19:02:09.960112 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.960095 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 19:02:09.960234 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.960221 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 19:02:09.968511 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.968487 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tf76k"] Jul 08 19:02:09.986412 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:09.986383 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:10.035226 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0977f4c9-db1e-4e12-afb6-8bb9d513051c-registry-certificates\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.035226 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0977f4c9-db1e-4e12-afb6-8bb9d513051c-installation-pull-secrets\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.035226 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ed4d741-aa0d-4288-9c64-0e6e1e152c1d-metrics-tls\") pod \"dns-default-s9kjr\" (UID: \"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d\") " pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:10.035448 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcsv6\" (UniqueName: \"kubernetes.io/projected/608f0288-cf38-4eec-832f-f1c1aad2502c-kube-api-access-xcsv6\") pod \"ingress-canary-7v7vg\" (UID: \"608f0288-cf38-4eec-832f-f1c1aad2502c\") " pod="openshift-ingress-canary/ingress-canary-7v7vg" Jul 08 19:02:10.035448 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvbkw\" (UniqueName: \"kubernetes.io/projected/717273ff-6667-4f9b-acbb-05b250e4358c-kube-api-access-kvbkw\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.035448 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/717273ff-6667-4f9b-acbb-05b250e4358c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.035569 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0977f4c9-db1e-4e12-afb6-8bb9d513051c-image-registry-private-configuration\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.035569 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0977f4c9-db1e-4e12-afb6-8bb9d513051c-ca-trust-extracted\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.035649 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ed4d741-aa0d-4288-9c64-0e6e1e152c1d-tmp-dir\") pod \"dns-default-s9kjr\" (UID: \"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d\") " pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:10.035649 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0977f4c9-db1e-4e12-afb6-8bb9d513051c-registry-tls\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.035649 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0977f4c9-db1e-4e12-afb6-8bb9d513051c-bound-sa-token\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.035949 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035929 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0977f4c9-db1e-4e12-afb6-8bb9d513051c-ca-trust-extracted\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.036101 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.035972 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ed4d741-aa0d-4288-9c64-0e6e1e152c1d-tmp-dir\") pod \"dns-default-s9kjr\" (UID: \"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d\") " pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:10.036101 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.036084 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0977f4c9-db1e-4e12-afb6-8bb9d513051c-registry-certificates\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.036290 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.036109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hv68\" (UniqueName: \"kubernetes.io/projected/0977f4c9-db1e-4e12-afb6-8bb9d513051c-kube-api-access-8hv68\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.036290 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.036142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrdnb\" (UniqueName: \"kubernetes.io/projected/8ed4d741-aa0d-4288-9c64-0e6e1e152c1d-kube-api-access-zrdnb\") pod \"dns-default-s9kjr\" (UID: \"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d\") " pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:10.036290 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.036195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0977f4c9-db1e-4e12-afb6-8bb9d513051c-trusted-ca\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.036290 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.036223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/717273ff-6667-4f9b-acbb-05b250e4358c-data-volume\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.036290 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.036247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/717273ff-6667-4f9b-acbb-05b250e4358c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.036523 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.036333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8ed4d741-aa0d-4288-9c64-0e6e1e152c1d-config-volume\") pod \"dns-default-s9kjr\" (UID: \"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d\") " pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:10.036523 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.036359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/608f0288-cf38-4eec-832f-f1c1aad2502c-cert\") pod \"ingress-canary-7v7vg\" (UID: \"608f0288-cf38-4eec-832f-f1c1aad2502c\") " pod="openshift-ingress-canary/ingress-canary-7v7vg" Jul 08 19:02:10.036523 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.036382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/717273ff-6667-4f9b-acbb-05b250e4358c-crio-socket\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.036908 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.036886 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8ed4d741-aa0d-4288-9c64-0e6e1e152c1d-config-volume\") pod \"dns-default-s9kjr\" (UID: \"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d\") " pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:10.037179 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.037157 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0977f4c9-db1e-4e12-afb6-8bb9d513051c-trusted-ca\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.039690 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.039664 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ed4d741-aa0d-4288-9c64-0e6e1e152c1d-metrics-tls\") pod \"dns-default-s9kjr\" (UID: \"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d\") " pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:10.039830 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.039808 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0977f4c9-db1e-4e12-afb6-8bb9d513051c-installation-pull-secrets\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.039889 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.039840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/608f0288-cf38-4eec-832f-f1c1aad2502c-cert\") pod \"ingress-canary-7v7vg\" (UID: \"608f0288-cf38-4eec-832f-f1c1aad2502c\") " pod="openshift-ingress-canary/ingress-canary-7v7vg" Jul 08 19:02:10.039984 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.039963 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0977f4c9-db1e-4e12-afb6-8bb9d513051c-registry-tls\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.040021 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.039963 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0977f4c9-db1e-4e12-afb6-8bb9d513051c-image-registry-private-configuration\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.040910 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.040889 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:10.045758 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.045708 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hv68\" (UniqueName: \"kubernetes.io/projected/0977f4c9-db1e-4e12-afb6-8bb9d513051c-kube-api-access-8hv68\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.045758 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.045727 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0977f4c9-db1e-4e12-afb6-8bb9d513051c-bound-sa-token\") pod \"image-registry-569654c8c9-q4ckr\" (UID: \"0977f4c9-db1e-4e12-afb6-8bb9d513051c\") " pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.046286 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.046247 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrdnb\" (UniqueName: \"kubernetes.io/projected/8ed4d741-aa0d-4288-9c64-0e6e1e152c1d-kube-api-access-zrdnb\") pod \"dns-default-s9kjr\" (UID: \"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d\") " pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:10.046457 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.046328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcsv6\" (UniqueName: \"kubernetes.io/projected/608f0288-cf38-4eec-832f-f1c1aad2502c-kube-api-access-xcsv6\") pod \"ingress-canary-7v7vg\" (UID: \"608f0288-cf38-4eec-832f-f1c1aad2502c\") " pod="openshift-ingress-canary/ingress-canary-7v7vg" Jul 08 19:02:10.137402 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.137368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvbkw\" (UniqueName: \"kubernetes.io/projected/717273ff-6667-4f9b-acbb-05b250e4358c-kube-api-access-kvbkw\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.137402 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.137405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/717273ff-6667-4f9b-acbb-05b250e4358c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.137863 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.137447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/717273ff-6667-4f9b-acbb-05b250e4358c-data-volume\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.137863 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.137553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/717273ff-6667-4f9b-acbb-05b250e4358c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.137863 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.137615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/717273ff-6667-4f9b-acbb-05b250e4358c-crio-socket\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.137863 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.137680 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/717273ff-6667-4f9b-acbb-05b250e4358c-crio-socket\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.137863 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.137725 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/717273ff-6667-4f9b-acbb-05b250e4358c-data-volume\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.138069 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.138049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/717273ff-6667-4f9b-acbb-05b250e4358c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.139791 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.139764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/717273ff-6667-4f9b-acbb-05b250e4358c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.145183 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.145155 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:10.146339 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.146323 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvbkw\" (UniqueName: \"kubernetes.io/projected/717273ff-6667-4f9b-acbb-05b250e4358c-kube-api-access-kvbkw\") pod \"insights-runtime-extractor-tf76k\" (UID: \"717273ff-6667-4f9b-acbb-05b250e4358c\") " pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.148300 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.148275 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:10.161084 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.160900 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:10.166446 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.166431 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7v7vg" Jul 08 19:02:10.246411 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.246321 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:10.264645 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.264615 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tf76k" Jul 08 19:02:10.301301 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.301246 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:10.318497 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.318468 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s9kjr"] Jul 08 19:02:10.320143 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:10.320109 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed4d741_aa0d_4288_9c64_0e6e1e152c1d.slice/crio-80904e38b452422e021538d3d6fd94471763c2bc26f09115f4ff951172477a4b WatchSource:0}: Error finding container 80904e38b452422e021538d3d6fd94471763c2bc26f09115f4ff951172477a4b: Status 404 returned error can't find the container with id 80904e38b452422e021538d3d6fd94471763c2bc26f09115f4ff951172477a4b Jul 08 19:02:10.334588 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.334560 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-569654c8c9-q4ckr"] Jul 08 19:02:10.339702 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:10.339669 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0977f4c9_db1e_4e12_afb6_8bb9d513051c.slice/crio-fa4d9f02e90c59806e8616d8e6b20936c4cbb80798a9f78e50dd2c3364ebf3a6 WatchSource:0}: Error finding container fa4d9f02e90c59806e8616d8e6b20936c4cbb80798a9f78e50dd2c3364ebf3a6: Status 404 returned error can't find the container with id fa4d9f02e90c59806e8616d8e6b20936c4cbb80798a9f78e50dd2c3364ebf3a6 Jul 08 19:02:10.406343 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.406317 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tf76k"] Jul 08 19:02:10.409894 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:10.409867 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717273ff_6667_4f9b_acbb_05b250e4358c.slice/crio-bac9f04d63687ae151a07cc2054a7911f943aab112f42c1d4e298b6007ef6f5a WatchSource:0}: Error finding container bac9f04d63687ae151a07cc2054a7911f943aab112f42c1d4e298b6007ef6f5a: Status 404 returned error can't find the container with id bac9f04d63687ae151a07cc2054a7911f943aab112f42c1d4e298b6007ef6f5a Jul 08 19:02:10.533302 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.533249 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7v7vg"] Jul 08 19:02:10.536847 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:10.536825 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod608f0288_cf38_4eec_832f_f1c1aad2502c.slice/crio-8aac675cbd51433dc766e6bd5ed16773cd01000f2597c62c1992662ef3a51b13 WatchSource:0}: Error finding container 8aac675cbd51433dc766e6bd5ed16773cd01000f2597c62c1992662ef3a51b13: Status 404 returned error can't find the container with id 8aac675cbd51433dc766e6bd5ed16773cd01000f2597c62c1992662ef3a51b13 Jul 08 19:02:10.782634 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.782499 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:02:10.782634 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.782533 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:02:10.782634 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.782533 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:02:10.785699 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.785676 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 19:02:10.785819 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.785677 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-db4b9\"" Jul 08 19:02:10.785976 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.785958 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 19:02:10.785976 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.785971 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 19:02:10.786683 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.786491 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 19:02:10.786683 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.786540 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-72lbb\"" Jul 08 19:02:10.988039 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.987993 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s9kjr" event={"ID":"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d","Type":"ContainerStarted","Data":"80904e38b452422e021538d3d6fd94471763c2bc26f09115f4ff951172477a4b"} Jul 08 19:02:10.989908 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.989872 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7v7vg" event={"ID":"608f0288-cf38-4eec-832f-f1c1aad2502c","Type":"ContainerStarted","Data":"8aac675cbd51433dc766e6bd5ed16773cd01000f2597c62c1992662ef3a51b13"} Jul 08 19:02:10.991504 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.991471 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tf76k" event={"ID":"717273ff-6667-4f9b-acbb-05b250e4358c","Type":"ContainerStarted","Data":"bac9f04d63687ae151a07cc2054a7911f943aab112f42c1d4e298b6007ef6f5a"} Jul 08 19:02:10.994384 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.993584 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" event={"ID":"0977f4c9-db1e-4e12-afb6-8bb9d513051c","Type":"ContainerStarted","Data":"c13d41b57cee9877946d617800f0ac05f5f22b4e0f1c701f1793c1ff6e78de73"} Jul 08 19:02:10.994384 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.993633 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" event={"ID":"0977f4c9-db1e-4e12-afb6-8bb9d513051c","Type":"ContainerStarted","Data":"fa4d9f02e90c59806e8616d8e6b20936c4cbb80798a9f78e50dd2c3364ebf3a6"} Jul 08 19:02:10.994384 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:10.994341 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:11.018348 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:11.017930 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" podStartSLOduration=3.017906258 podStartE2EDuration="3.017906258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:11.016766502 +0000 UTC m=+56.622679575" watchObservedRunningTime="2026-07-08 19:02:11.017906258 +0000 UTC m=+56.623819311" Jul 08 19:02:13.502051 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.502015 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-844674b46d-82ldh"] Jul 08 19:02:13.515751 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.515727 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.518801 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.518773 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 19:02:13.519028 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.519011 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 19:02:13.519471 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.519330 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 19:02:13.519471 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.519388 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 19:02:13.519967 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.519944 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 19:02:13.520186 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.520169 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 19:02:13.520410 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.520394 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 19:02:13.520818 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.520779 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6m9lb\"" Jul 08 19:02:13.521664 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.521611 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844674b46d-82ldh"] Jul 08 19:02:13.566586 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.566553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e58013b5-187d-4367-9ce6-cc03f83dc927-console-serving-cert\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.566740 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.566592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-service-ca\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.566740 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.566626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-console-config\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.566740 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.566668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t2r2\" (UniqueName: \"kubernetes.io/projected/e58013b5-187d-4367-9ce6-cc03f83dc927-kube-api-access-4t2r2\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.566858 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.566795 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-oauth-serving-cert\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.566913 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.566862 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e58013b5-187d-4367-9ce6-cc03f83dc927-console-oauth-config\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.667713 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.667669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t2r2\" (UniqueName: \"kubernetes.io/projected/e58013b5-187d-4367-9ce6-cc03f83dc927-kube-api-access-4t2r2\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.667891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.667775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-oauth-serving-cert\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.667891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.667803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e58013b5-187d-4367-9ce6-cc03f83dc927-console-oauth-config\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.667891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.667829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e58013b5-187d-4367-9ce6-cc03f83dc927-console-serving-cert\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.667891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.667858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-service-ca\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.667891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.667891 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-console-config\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.668706 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.668617 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-oauth-serving-cert\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.668706 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.668621 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-console-config\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.669055 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.668750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-service-ca\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.670912 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.670889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e58013b5-187d-4367-9ce6-cc03f83dc927-console-oauth-config\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.671072 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.671050 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e58013b5-187d-4367-9ce6-cc03f83dc927-console-serving-cert\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.679340 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.679317 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t2r2\" (UniqueName: \"kubernetes.io/projected/e58013b5-187d-4367-9ce6-cc03f83dc927-kube-api-access-4t2r2\") pod \"console-844674b46d-82ldh\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:13.827419 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:13.827381 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:14.441082 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:14.441047 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:15.587536 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:15.587394 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844674b46d-82ldh"] Jul 08 19:02:15.593003 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:15.592951 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode58013b5_187d_4367_9ce6_cc03f83dc927.slice/crio-3b21a19e6647fca9512cbd9884f0c2dbad899c44199772623408021243105073 WatchSource:0}: Error finding container 3b21a19e6647fca9512cbd9884f0c2dbad899c44199772623408021243105073: Status 404 returned error can't find the container with id 3b21a19e6647fca9512cbd9884f0c2dbad899c44199772623408021243105073 Jul 08 19:02:16.010519 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:16.010485 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tf76k" event={"ID":"717273ff-6667-4f9b-acbb-05b250e4358c","Type":"ContainerStarted","Data":"3d21308856cc16fc91cce75a7545725c7d428345466cd5e767db70de9a3e6bad"} Jul 08 19:02:16.012325 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:16.012297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s9kjr" event={"ID":"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d","Type":"ContainerStarted","Data":"5ddfb80e78cc704863514a0c3e24ca51534a2ca45e83e86d5611603cd4b5ca2b"} Jul 08 19:02:16.012443 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:16.012345 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s9kjr" event={"ID":"8ed4d741-aa0d-4288-9c64-0e6e1e152c1d","Type":"ContainerStarted","Data":"d748826c3176c80e344f91f5f08cd5d1b8c4b1e16fa12046849a339b3acb1713"} Jul 08 19:02:16.012443 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:16.012436 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:16.013994 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:16.013973 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7v7vg" event={"ID":"608f0288-cf38-4eec-832f-f1c1aad2502c","Type":"ContainerStarted","Data":"35750b50bd96774986a025dc82612368b51c436b6e064921c1525be383f9f0f9"} Jul 08 19:02:16.015094 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:16.015074 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844674b46d-82ldh" event={"ID":"e58013b5-187d-4367-9ce6-cc03f83dc927","Type":"ContainerStarted","Data":"3b21a19e6647fca9512cbd9884f0c2dbad899c44199772623408021243105073"} Jul 08 19:02:16.054618 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:16.054562 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7v7vg" podStartSLOduration=2.142523531 podStartE2EDuration="7.054539819s" totalImagesPullingTime="4.912016288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:16.054239763 +0000 UTC m=+61.660152832" watchObservedRunningTime="2026-07-08 19:02:16.054539819 +0000 UTC m=+61.660452891" Jul 08 19:02:16.055326 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:16.055284 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s9kjr" podStartSLOduration=1.933596243 podStartE2EDuration="7.055271331s" totalImagesPullingTime="5.121675088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:16.032651476 +0000 UTC m=+61.638564549" watchObservedRunningTime="2026-07-08 19:02:16.055271331 +0000 UTC m=+61.661184394" Jul 08 19:02:17.022277 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:17.022219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tf76k" event={"ID":"717273ff-6667-4f9b-acbb-05b250e4358c","Type":"ContainerStarted","Data":"fb57aabbf8d50754fa4d3ccc4926b81502352e3f5e5c506363965603f0cd2073"} Jul 08 19:02:17.937870 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:17.937845 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjl58" Jul 08 19:02:18.100216 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:18.100167 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:18.163176 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:18.163142 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:19.840395 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:19.840364 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:19.940156 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:19.940122 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:20.033691 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.033660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844674b46d-82ldh" event={"ID":"e58013b5-187d-4367-9ce6-cc03f83dc927","Type":"ContainerStarted","Data":"cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34"} Jul 08 19:02:20.035780 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.035715 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tf76k" event={"ID":"717273ff-6667-4f9b-acbb-05b250e4358c","Type":"ContainerStarted","Data":"cada29ebe885a8e131198bd98098934aa08a126d8ab3cbf8ca384b62cbcd052b"} Jul 08 19:02:20.051272 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.051233 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:20.066420 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.066377 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-844674b46d-82ldh" podStartSLOduration=2.87621389 podStartE2EDuration="7.066363447s" totalImagesPullingTime="4.190149557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:20.066167591 +0000 UTC m=+65.672080662" watchObservedRunningTime="2026-07-08 19:02:20.066363447 +0000 UTC m=+65.672276519" Jul 08 19:02:20.082675 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.082646 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4"] Jul 08 19:02:20.085547 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.085530 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4" Jul 08 19:02:20.088790 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.088764 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 19:02:20.089312 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.089297 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zrnwv\"" Jul 08 19:02:20.104729 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.104704 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4"] Jul 08 19:02:20.146576 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.146524 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tf76k" podStartSLOduration=1.9097166639999998 podStartE2EDuration="11.146507174s" totalImagesPullingTime="9.23679051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:02:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:20.124088216 +0000 UTC m=+65.730001288" watchObservedRunningTime="2026-07-08 19:02:20.146507174 +0000 UTC m=+65.752420246" Jul 08 19:02:20.221633 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.221596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/112cb826-3e85-44e0-b16c-d56afcdd1a24-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zgkl4\" (UID: \"112cb826-3e85-44e0-b16c-d56afcdd1a24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4" Jul 08 19:02:20.322214 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.322154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/112cb826-3e85-44e0-b16c-d56afcdd1a24-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zgkl4\" (UID: \"112cb826-3e85-44e0-b16c-d56afcdd1a24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4" Jul 08 19:02:20.324666 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.324643 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/112cb826-3e85-44e0-b16c-d56afcdd1a24-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zgkl4\" (UID: \"112cb826-3e85-44e0-b16c-d56afcdd1a24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4" Jul 08 19:02:20.383480 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.383440 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:20.393916 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.393886 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4" Jul 08 19:02:20.466271 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.466229 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:20.524422 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.524384 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:02:20.527388 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.527371 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 19:02:20.530735 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.530713 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4"] Jul 08 19:02:20.533714 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:20.533688 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112cb826_3e85_44e0_b16c_d56afcdd1a24.slice/crio-dc946804d81803f138671b0ee96018895477aa4c6be8744b1dc79cc2f2dda19d WatchSource:0}: Error finding container dc946804d81803f138671b0ee96018895477aa4c6be8744b1dc79cc2f2dda19d: Status 404 returned error can't find the container with id dc946804d81803f138671b0ee96018895477aa4c6be8744b1dc79cc2f2dda19d Jul 08 19:02:20.537117 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.537093 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f961bcd4-9cc9-45fd-bf10-6c82cf845d0a-original-pull-secret\") pod \"global-pull-secret-syncer-fxx2m\" (UID: \"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a\") " pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:02:20.537449 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.537431 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:20.625081 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.625001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:02:20.628355 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.628335 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 19:02:20.638336 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.638310 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7578bca4-894d-4728-91c6-58a80610d546-metrics-certs\") pod \"network-metrics-daemon-gkpxk\" (UID: \"7578bca4-894d-4728-91c6-58a80610d546\") " pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:02:20.700547 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.700506 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-72lbb\"" Jul 08 19:02:20.706662 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.706643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpxk" Jul 08 19:02:20.708884 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.708867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxx2m" Jul 08 19:02:20.726232 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.726199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s892\" (UniqueName: \"kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892\") pod \"network-check-target-8gfm5\" (UID: \"dca44699-6002-4eb4-a852-5b1e3e3321ca\") " pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:02:20.729412 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.729394 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 19:02:20.741121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.741096 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 19:02:20.749752 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.749719 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s892\" (UniqueName: \"kubernetes.io/projected/dca44699-6002-4eb4-a852-5b1e3e3321ca-kube-api-access-6s892\") pod \"network-check-target-8gfm5\" (UID: \"dca44699-6002-4eb4-a852-5b1e3e3321ca\") " pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:02:20.892088 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.892013 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gkpxk"] Jul 08 19:02:20.896282 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:20.896233 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7578bca4_894d_4728_91c6_58a80610d546.slice/crio-e583eb7febe954e0eb2947d4a778e3fd8ef5394ad5a9bf11b618647c692b1444 WatchSource:0}: Error finding container e583eb7febe954e0eb2947d4a778e3fd8ef5394ad5a9bf11b618647c692b1444: Status 404 returned error can't find the container with id e583eb7febe954e0eb2947d4a778e3fd8ef5394ad5a9bf11b618647c692b1444 Jul 08 19:02:20.935691 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:20.935659 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fxx2m"] Jul 08 19:02:20.938719 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:20.938691 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf961bcd4_9cc9_45fd_bf10_6c82cf845d0a.slice/crio-6e912e02bba8f6254c012009d61d4a447af09f248666a08ffa3571548c5d3c3f WatchSource:0}: Error finding container 6e912e02bba8f6254c012009d61d4a447af09f248666a08ffa3571548c5d3c3f: Status 404 returned error can't find the container with id 6e912e02bba8f6254c012009d61d4a447af09f248666a08ffa3571548c5d3c3f Jul 08 19:02:21.009904 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:21.009870 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-db4b9\"" Jul 08 19:02:21.014429 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:21.014410 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:02:21.040204 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:21.040173 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4" event={"ID":"112cb826-3e85-44e0-b16c-d56afcdd1a24","Type":"ContainerStarted","Data":"dc946804d81803f138671b0ee96018895477aa4c6be8744b1dc79cc2f2dda19d"} Jul 08 19:02:21.041213 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:21.041182 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkpxk" event={"ID":"7578bca4-894d-4728-91c6-58a80610d546","Type":"ContainerStarted","Data":"e583eb7febe954e0eb2947d4a778e3fd8ef5394ad5a9bf11b618647c692b1444"} Jul 08 19:02:21.042499 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:21.042471 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fxx2m" event={"ID":"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a","Type":"ContainerStarted","Data":"6e912e02bba8f6254c012009d61d4a447af09f248666a08ffa3571548c5d3c3f"} Jul 08 19:02:21.183876 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:21.183732 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8gfm5"] Jul 08 19:02:21.186290 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:21.186250 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca44699_6002_4eb4_a852_5b1e3e3321ca.slice/crio-3f3debfbfd907d388f83988dc3aa3982deb92226e4b746f3910a41c8078decd8 WatchSource:0}: Error finding container 3f3debfbfd907d388f83988dc3aa3982deb92226e4b746f3910a41c8078decd8: Status 404 returned error can't find the container with id 3f3debfbfd907d388f83988dc3aa3982deb92226e4b746f3910a41c8078decd8 Jul 08 19:02:21.387931 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:21.387890 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:21.464297 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:21.464189 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:22.048593 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:22.048509 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8gfm5" event={"ID":"dca44699-6002-4eb4-a852-5b1e3e3321ca","Type":"ContainerStarted","Data":"3f3debfbfd907d388f83988dc3aa3982deb92226e4b746f3910a41c8078decd8"} Jul 08 19:02:22.319605 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:22.319552 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:22.421943 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:22.421867 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:23.053156 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.053122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4" event={"ID":"112cb826-3e85-44e0-b16c-d56afcdd1a24","Type":"ContainerStarted","Data":"387beb7f7625bc0a785ed4240264888eba1ffb2f94460d8ebd485dd7166368e0"} Jul 08 19:02:23.053616 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.053296 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4" Jul 08 19:02:23.055325 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.055290 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkpxk" event={"ID":"7578bca4-894d-4728-91c6-58a80610d546","Type":"ContainerStarted","Data":"58e71ea3d6cb909e592f19e85e9471276d199fadbc53ae1a6247064418ab250e"} Jul 08 19:02:23.055458 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.055343 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkpxk" event={"ID":"7578bca4-894d-4728-91c6-58a80610d546","Type":"ContainerStarted","Data":"6d20b5aa7e868a99eebe6ee0c7675b5e6e9acf3e2fbed323af4cf5b50c307b4f"} Jul 08 19:02:23.058366 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.058352 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4" Jul 08 19:02:23.081511 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.081457 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zgkl4" podStartSLOduration=0.762789494 podStartE2EDuration="3.081442684s" totalImagesPullingTime="2.31865319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:23.081011931 +0000 UTC m=+68.686925003" watchObservedRunningTime="2026-07-08 19:02:23.081442684 +0000 UTC m=+68.687355756" Jul 08 19:02:23.105606 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.105493 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gkpxk" podStartSLOduration=66.770301313 podStartE2EDuration="1m8.105473138s" totalImagesPullingTime="1.335171825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:23.104606763 +0000 UTC m=+68.710519836" watchObservedRunningTime="2026-07-08 19:02:23.105473138 +0000 UTC m=+68.711386210" Jul 08 19:02:23.244845 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.244807 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:23.344496 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.344461 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:23.828159 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.828117 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:23.828357 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.828185 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:23.829467 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.829436 2577 patch_prober.go:28] interesting pod/console-844674b46d-82ldh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" start-of-body= Jul 08 19:02:23.829580 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:23.829489 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-844674b46d-82ldh" podUID="e58013b5-187d-4367-9ce6-cc03f83dc927" containerName="console" probeResult="failure" output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" Jul 08 19:02:24.119929 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.119838 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:24.213663 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.213630 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl"] Jul 08 19:02:24.216815 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.216794 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.226118 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.226096 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 08 19:02:24.226235 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.226098 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 19:02:24.226235 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.226102 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 19:02:24.227005 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.226952 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 19:02:24.227005 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.226981 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 08 19:02:24.227005 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.227004 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cbzn7\"" Jul 08 19:02:24.236415 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.236390 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl"] Jul 08 19:02:24.354182 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.354144 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba7db034-b031-4a77-bac9-9482d27606fd-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.354372 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.354299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64nw2\" (UniqueName: \"kubernetes.io/projected/ba7db034-b031-4a77-bac9-9482d27606fd-kube-api-access-64nw2\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.354372 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.354345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba7db034-b031-4a77-bac9-9482d27606fd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.354472 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.354383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ba7db034-b031-4a77-bac9-9482d27606fd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.455496 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.455414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba7db034-b031-4a77-bac9-9482d27606fd-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.455496 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.455464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64nw2\" (UniqueName: \"kubernetes.io/projected/ba7db034-b031-4a77-bac9-9482d27606fd-kube-api-access-64nw2\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.455496 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.455485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba7db034-b031-4a77-bac9-9482d27606fd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.455785 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.455519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ba7db034-b031-4a77-bac9-9482d27606fd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.455785 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:24.455668 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 08 19:02:24.455785 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:24.455745 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba7db034-b031-4a77-bac9-9482d27606fd-prometheus-operator-tls podName:ba7db034-b031-4a77-bac9-9482d27606fd nodeName:}" failed. No retries permitted until 2026-07-08 19:02:24.955723842 +0000 UTC m=+70.561636897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ba7db034-b031-4a77-bac9-9482d27606fd-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-l4xzl" (UID: "ba7db034-b031-4a77-bac9-9482d27606fd") : secret "prometheus-operator-tls" not found Jul 08 19:02:24.456232 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.456203 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba7db034-b031-4a77-bac9-9482d27606fd-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.458269 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.458232 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba7db034-b031-4a77-bac9-9482d27606fd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.473219 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.473190 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64nw2\" (UniqueName: \"kubernetes.io/projected/ba7db034-b031-4a77-bac9-9482d27606fd-kube-api-access-64nw2\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.636743 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.636701 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:24.694250 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.694218 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:24.958949 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.958909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ba7db034-b031-4a77-bac9-9482d27606fd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:24.961654 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:24.961624 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ba7db034-b031-4a77-bac9-9482d27606fd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-l4xzl\" (UID: \"ba7db034-b031-4a77-bac9-9482d27606fd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:25.126733 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:25.126694 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" Jul 08 19:02:26.025431 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:26.025399 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s9kjr" Jul 08 19:02:26.113568 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:26.113531 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:26.167033 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:26.166993 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:27.018583 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:27.018556 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl"] Jul 08 19:02:27.021869 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:27.021844 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7db034_b031_4a77_bac9_9482d27606fd.slice/crio-2860762af3beeb034b2f9147c34359e974de359bc3e09d96c78846068c183a5f WatchSource:0}: Error finding container 2860762af3beeb034b2f9147c34359e974de359bc3e09d96c78846068c183a5f: Status 404 returned error can't find the container with id 2860762af3beeb034b2f9147c34359e974de359bc3e09d96c78846068c183a5f Jul 08 19:02:27.072619 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:27.072568 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8gfm5" event={"ID":"dca44699-6002-4eb4-a852-5b1e3e3321ca","Type":"ContainerStarted","Data":"87735cc5e2ef82d44664dca2207841525fa0c0f6ec81e7854556de91aa26fd35"} Jul 08 19:02:27.072798 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:27.072719 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:02:27.074230 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:27.074206 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fxx2m" event={"ID":"f961bcd4-9cc9-45fd-bf10-6c82cf845d0a","Type":"ContainerStarted","Data":"aaf3845db9c4a91d18d65573065e1be1b0be4a8ecce855306b4b597a57ce1315"} Jul 08 19:02:27.075412 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:27.075394 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" event={"ID":"ba7db034-b031-4a77-bac9-9482d27606fd","Type":"ContainerStarted","Data":"2860762af3beeb034b2f9147c34359e974de359bc3e09d96c78846068c183a5f"} Jul 08 19:02:27.127738 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:27.127627 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fxx2m" podStartSLOduration=66.181106359 podStartE2EDuration="1m12.127610929s" totalImagesPullingTime="5.94650457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:27.126360287 +0000 UTC m=+72.732273359" watchObservedRunningTime="2026-07-08 19:02:27.127610929 +0000 UTC m=+72.733524000" Jul 08 19:02:27.127906 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:27.127853 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8gfm5" podStartSLOduration=66.438096989 podStartE2EDuration="1m12.127849016s" totalImagesPullingTime="5.689752027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:27.100811538 +0000 UTC m=+72.706724612" watchObservedRunningTime="2026-07-08 19:02:27.127849016 +0000 UTC m=+72.733762087" Jul 08 19:02:29.511358 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:29.511271 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:29.612813 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:29.612782 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:29.715859 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:29.715826 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:30.089891 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:30.089855 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" event={"ID":"ba7db034-b031-4a77-bac9-9482d27606fd","Type":"ContainerStarted","Data":"913495f74d5225e7e80ba58891e1a8aad8d9132c80722feec6af05808ec6eaeb"} Jul 08 19:02:30.090160 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:30.089936 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" event={"ID":"ba7db034-b031-4a77-bac9-9482d27606fd","Type":"ContainerStarted","Data":"5a35e795a5e8e6e6a0253b9c06c28392c1f7375ba832355e85cb7c5b7da4ffc4"} Jul 08 19:02:30.113509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:30.113463 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-l4xzl" podStartSLOduration=3.980998673 podStartE2EDuration="6.113445858s" totalImagesPullingTime="2.132447185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:30.112431019 +0000 UTC m=+75.718344091" watchObservedRunningTime="2026-07-08 19:02:30.113445858 +0000 UTC m=+75.719358941" Jul 08 19:02:30.152819 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:30.152786 2577 patch_prober.go:28] interesting pod/image-registry-569654c8c9-q4ckr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 19:02:30.153006 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:30.152837 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" podUID="0977f4c9-db1e-4e12-afb6-8bb9d513051c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 19:02:30.365048 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:30.364960 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:30.472784 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:30.472745 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:30.542218 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:30.542188 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:31.315551 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.315513 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:31.568230 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.568148 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:31.666328 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.666301 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-btc88"] Jul 08 19:02:31.669601 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.669586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.672381 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.672358 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 19:02:31.672505 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.672362 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 19:02:31.672705 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.672684 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hngkx\"" Jul 08 19:02:31.673108 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.673092 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 19:02:31.689736 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.689703 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:31.778706 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.778659 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:31.810119 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.810091 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-accelerators-collector-config\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.810211 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.810126 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-tls\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.810211 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.810148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5885f7bd-c9e5-4798-8426-90b3e0d96fed-sys\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.810211 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.810164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.810349 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.810238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-wtmp\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.810349 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.810302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvzpk\" (UniqueName: \"kubernetes.io/projected/5885f7bd-c9e5-4798-8426-90b3e0d96fed-kube-api-access-dvzpk\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.810349 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.810336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5885f7bd-c9e5-4798-8426-90b3e0d96fed-root\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.810468 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.810353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5885f7bd-c9e5-4798-8426-90b3e0d96fed-metrics-client-ca\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.810468 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.810373 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-textfile\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.877191 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.877107 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:31.911224 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-textfile\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.911401 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-accelerators-collector-config\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.911401 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-tls\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.911401 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5885f7bd-c9e5-4798-8426-90b3e0d96fed-sys\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.911401 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.911401 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-wtmp\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.911652 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvzpk\" (UniqueName: \"kubernetes.io/projected/5885f7bd-c9e5-4798-8426-90b3e0d96fed-kube-api-access-dvzpk\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.911652 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5885f7bd-c9e5-4798-8426-90b3e0d96fed-sys\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.911652 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:31.911465 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 19:02:31.911652 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911511 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5885f7bd-c9e5-4798-8426-90b3e0d96fed-root\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.911652 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:02:31.911529 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-tls podName:5885f7bd-c9e5-4798-8426-90b3e0d96fed nodeName:}" failed. No retries permitted until 2026-07-08 19:02:32.411509743 +0000 UTC m=+78.017422793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-tls") pod "node-exporter-btc88" (UID: "5885f7bd-c9e5-4798-8426-90b3e0d96fed") : secret "node-exporter-tls" not found Jul 08 19:02:31.911652 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911467 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5885f7bd-c9e5-4798-8426-90b3e0d96fed-root\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.911652 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5885f7bd-c9e5-4798-8426-90b3e0d96fed-metrics-client-ca\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.911652 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-wtmp\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.911652 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-textfile\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.912097 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.911878 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-accelerators-collector-config\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.912097 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.912069 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5885f7bd-c9e5-4798-8426-90b3e0d96fed-metrics-client-ca\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.913919 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.913899 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.920762 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.920740 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvzpk\" (UniqueName: \"kubernetes.io/projected/5885f7bd-c9e5-4798-8426-90b3e0d96fed-kube-api-access-dvzpk\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:31.980989 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:31.980954 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:32.086621 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:32.086547 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:32.182785 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:32.182705 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:32.292710 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:32.292680 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:32.416130 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:32.416090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-tls\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:32.418530 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:32.418502 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5885f7bd-c9e5-4798-8426-90b3e0d96fed-node-exporter-tls\") pod \"node-exporter-btc88\" (UID: \"5885f7bd-c9e5-4798-8426-90b3e0d96fed\") " pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:32.578605 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:32.578559 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-btc88" Jul 08 19:02:32.593682 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:32.593635 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5885f7bd_c9e5_4798_8426_90b3e0d96fed.slice/crio-6d7ad5f6ff0587adf0e16e1e872a3ff69a9b1e5d0787b722e09ce0f53006df41 WatchSource:0}: Error finding container 6d7ad5f6ff0587adf0e16e1e872a3ff69a9b1e5d0787b722e09ce0f53006df41: Status 404 returned error can't find the container with id 6d7ad5f6ff0587adf0e16e1e872a3ff69a9b1e5d0787b722e09ce0f53006df41 Jul 08 19:02:32.635251 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:32.635225 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:32.829117 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:32.829032 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:33.004879 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:33.004854 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-569654c8c9-q4ckr" Jul 08 19:02:33.052064 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:33.052029 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:33.104344 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:33.102510 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btc88" event={"ID":"5885f7bd-c9e5-4798-8426-90b3e0d96fed","Type":"ContainerStarted","Data":"6d7ad5f6ff0587adf0e16e1e872a3ff69a9b1e5d0787b722e09ce0f53006df41"} Jul 08 19:02:33.215233 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:33.215186 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:33.320287 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:33.320231 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:33.832138 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:33.832104 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:33.835875 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:33.835857 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:02:33.949317 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:33.949240 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:34.022565 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:34.022521 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:34.532236 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:34.532147 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:34.634111 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:34.634079 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:34.694571 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:34.694523 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:34.761334 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:34.761303 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:35.110088 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.110050 2577 generic.go:356] "Generic (PLEG): container finished" podID="5885f7bd-c9e5-4798-8426-90b3e0d96fed" containerID="5c676608a900f013394128e9917089a411ab93dea209635bddbfefba43bd1d78" exitCode=0 Jul 08 19:02:35.110487 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.110105 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btc88" event={"ID":"5885f7bd-c9e5-4798-8426-90b3e0d96fed","Type":"ContainerDied","Data":"5c676608a900f013394128e9917089a411ab93dea209635bddbfefba43bd1d78"} Jul 08 19:02:35.230057 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.230036 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:35.248661 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.248634 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844674b46d-82ldh"] Jul 08 19:02:35.331641 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.331602 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:35.923741 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.923713 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:35.949090 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.949062 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5988d766d8-v25r9"] Jul 08 19:02:35.952035 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.952014 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:35.955691 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.955671 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 19:02:35.955785 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.955748 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-d94wh\"" Jul 08 19:02:35.956605 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.956587 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b7ok1pfebeif2\"" Jul 08 19:02:35.957466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.957448 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 19:02:35.959560 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.959543 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 19:02:35.959666 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.959549 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 19:02:35.972905 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:35.972886 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5988d766d8-v25r9"] Jul 08 19:02:36.043346 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.043316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khmtc\" (UniqueName: \"kubernetes.io/projected/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-kube-api-access-khmtc\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.043529 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.043370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-secret-metrics-server-client-certs\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.043529 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.043419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.043529 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.043454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-audit-log\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.043529 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.043480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-client-ca-bundle\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.043529 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.043530 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-secret-metrics-server-tls\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.043710 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.043550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-metrics-server-audit-profiles\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.120941 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.120902 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btc88" event={"ID":"5885f7bd-c9e5-4798-8426-90b3e0d96fed","Type":"ContainerStarted","Data":"56b1be5c7f6cf04e43fc5ba0734816c8bc733e184650a8251307f60b42db9276"} Jul 08 19:02:36.121384 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.120990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btc88" event={"ID":"5885f7bd-c9e5-4798-8426-90b3e0d96fed","Type":"ContainerStarted","Data":"29dd485259cecdf37969aa28f8ab0e2061275067203cd76440515bc89c341e1a"} Jul 08 19:02:36.144022 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.143989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-audit-log\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.144164 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.144032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-client-ca-bundle\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.144164 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.144060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-secret-metrics-server-tls\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.144164 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.144083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-metrics-server-audit-profiles\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.144164 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.144111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khmtc\" (UniqueName: \"kubernetes.io/projected/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-kube-api-access-khmtc\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.144164 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.144156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-secret-metrics-server-client-certs\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.144427 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.144320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.144500 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.144476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-audit-log\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.145059 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.145033 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.145191 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.145171 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-metrics-server-audit-profiles\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.146679 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.146654 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-client-ca-bundle\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.146987 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.146955 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-secret-metrics-server-tls\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.147201 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.147177 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-secret-metrics-server-client-certs\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.148053 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.148014 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-btc88" podStartSLOduration=3.560156932 podStartE2EDuration="5.148001747s" totalImagesPullingTime="1.518401152s" totalInitContainerRuntime="69.443663ms" isStatefulPod=true podCreationTimestamp="2026-07-08 19:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:36.147032418 +0000 UTC m=+81.752945491" watchObservedRunningTime="2026-07-08 19:02:36.148001747 +0000 UTC m=+81.753914820" Jul 08 19:02:36.157279 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.157242 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khmtc\" (UniqueName: \"kubernetes.io/projected/0cbaeed2-305d-4d24-84ff-a6e27e6546fa-kube-api-access-khmtc\") pod \"metrics-server-5988d766d8-v25r9\" (UID: \"0cbaeed2-305d-4d24-84ff-a6e27e6546fa\") " pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.260911 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.260830 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:36.408722 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.408688 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5988d766d8-v25r9"] Jul 08 19:02:36.411647 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:36.411615 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cbaeed2_305d_4d24_84ff_a6e27e6546fa.slice/crio-3fa67fefaf9a6352710ed7b26eaf8b4c5b23ee4c332c4eb0c94ae909ae7c5482 WatchSource:0}: Error finding container 3fa67fefaf9a6352710ed7b26eaf8b4c5b23ee4c332c4eb0c94ae909ae7c5482: Status 404 returned error can't find the container with id 3fa67fefaf9a6352710ed7b26eaf8b4c5b23ee4c332c4eb0c94ae909ae7c5482 Jul 08 19:02:36.415688 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.415654 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:36.452363 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.452334 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z"] Jul 08 19:02:36.456445 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.456428 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" Jul 08 19:02:36.459814 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.459798 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 08 19:02:36.459894 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.459814 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8xf6h\"" Jul 08 19:02:36.490282 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.485122 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z"] Jul 08 19:02:36.495395 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.495364 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:36.547455 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.547357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c55987b2-5fa3-48f0-9176-ca8450bbda1a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xrh9z\" (UID: \"c55987b2-5fa3-48f0-9176-ca8450bbda1a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" Jul 08 19:02:36.547600 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.547510 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldhff\" (UniqueName: \"kubernetes.io/projected/c55987b2-5fa3-48f0-9176-ca8450bbda1a-kube-api-access-ldhff\") pod \"monitoring-plugin-d5dcff7cf-xrh9z\" (UID: \"c55987b2-5fa3-48f0-9176-ca8450bbda1a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" Jul 08 19:02:36.648750 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.648716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c55987b2-5fa3-48f0-9176-ca8450bbda1a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xrh9z\" (UID: \"c55987b2-5fa3-48f0-9176-ca8450bbda1a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" Jul 08 19:02:36.648905 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.648770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldhff\" (UniqueName: \"kubernetes.io/projected/c55987b2-5fa3-48f0-9176-ca8450bbda1a-kube-api-access-ldhff\") pod \"monitoring-plugin-d5dcff7cf-xrh9z\" (UID: \"c55987b2-5fa3-48f0-9176-ca8450bbda1a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" Jul 08 19:02:36.653212 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.653185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c55987b2-5fa3-48f0-9176-ca8450bbda1a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xrh9z\" (UID: \"c55987b2-5fa3-48f0-9176-ca8450bbda1a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" Jul 08 19:02:36.660091 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.660060 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:36.661242 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.661220 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldhff\" (UniqueName: \"kubernetes.io/projected/c55987b2-5fa3-48f0-9176-ca8450bbda1a-kube-api-access-ldhff\") pod \"monitoring-plugin-d5dcff7cf-xrh9z\" (UID: \"c55987b2-5fa3-48f0-9176-ca8450bbda1a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" Jul 08 19:02:36.751574 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.751546 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:36.765252 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.765228 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" Jul 08 19:02:36.953554 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:36.953446 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z"] Jul 08 19:02:36.955948 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:36.955922 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55987b2_5fa3_48f0_9176_ca8450bbda1a.slice/crio-14ccfc3bb151de8b2a56a43487d4ccb91cabedf72e6d90ad8f9106f40bbf5314 WatchSource:0}: Error finding container 14ccfc3bb151de8b2a56a43487d4ccb91cabedf72e6d90ad8f9106f40bbf5314: Status 404 returned error can't find the container with id 14ccfc3bb151de8b2a56a43487d4ccb91cabedf72e6d90ad8f9106f40bbf5314 Jul 08 19:02:37.125348 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:37.125239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" event={"ID":"c55987b2-5fa3-48f0-9176-ca8450bbda1a","Type":"ContainerStarted","Data":"14ccfc3bb151de8b2a56a43487d4ccb91cabedf72e6d90ad8f9106f40bbf5314"} Jul 08 19:02:37.126508 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:37.126483 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" event={"ID":"0cbaeed2-305d-4d24-84ff-a6e27e6546fa","Type":"ContainerStarted","Data":"3fa67fefaf9a6352710ed7b26eaf8b4c5b23ee4c332c4eb0c94ae909ae7c5482"} Jul 08 19:02:38.000950 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.000902 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:38.008148 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.007522 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:02:38.014596 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.014568 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.020766 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.020204 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 19:02:38.020766 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.020345 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 19:02:38.020766 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.020445 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 19:02:38.020766 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.020537 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 19:02:38.020766 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.020604 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 19:02:38.020766 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.020660 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 19:02:38.022306 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.022281 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 19:02:38.030554 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.029512 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 19:02:38.030554 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.029635 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dbxdm\"" Jul 08 19:02:38.031403 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.030990 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 19:02:38.031403 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.031320 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 19:02:38.032736 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.032694 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:02:38.033726 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.033693 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 19:02:38.033998 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.033974 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5g305nrdp0ifa\"" Jul 08 19:02:38.034093 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.034050 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 19:02:38.041678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.041647 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 19:02:38.058888 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.057775 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 19:02:38.156186 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.156140 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:38.163791 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.163759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.163934 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.163802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.163934 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.163837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.163934 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.163861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.163934 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.163879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.163934 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.163895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-config\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.163934 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.163916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.163951 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.164017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.164054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxvdc\" (UniqueName: \"kubernetes.io/projected/959dacf0-da8f-4b82-9eeb-5548452ae6a7-kube-api-access-qxvdc\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.164111 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.164152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164350 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.164182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164350 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.164204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164350 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.164231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164350 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.164250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/959dacf0-da8f-4b82-9eeb-5548452ae6a7-config-out\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164350 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.164283 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/959dacf0-da8f-4b82-9eeb-5548452ae6a7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164350 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.164304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164350 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.164326 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.164350 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.164344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-web-config\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.255045 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.254848 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:38.264984 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.264950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.264984 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.265000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.265221 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.265029 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/959dacf0-da8f-4b82-9eeb-5548452ae6a7-config-out\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.265221 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.265068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/959dacf0-da8f-4b82-9eeb-5548452ae6a7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.265221 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.265095 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.265221 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.265119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.265221 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.265183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-web-config\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267079 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267192 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267192 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267192 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267192 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267390 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-config\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267390 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267390 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267390 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267390 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxvdc\" (UniqueName: \"kubernetes.io/projected/959dacf0-da8f-4b82-9eeb-5548452ae6a7-kube-api-access-qxvdc\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267390 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267658 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267397 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267658 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.267924 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.267897 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.268781 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.268076 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.268781 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.268697 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.269745 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.269718 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.270106 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.270080 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.270604 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.270578 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.272114 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.272094 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.273195 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.272983 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/959dacf0-da8f-4b82-9eeb-5548452ae6a7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.275904 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.275878 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.282617 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.282064 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-config\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.283748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.283701 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-web-config\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.285793 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.285733 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/959dacf0-da8f-4b82-9eeb-5548452ae6a7-config-out\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.286089 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.286062 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.286240 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.286188 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.286920 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.286878 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.287009 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.286986 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.287464 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.287416 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.287816 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.287771 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxvdc\" (UniqueName: \"kubernetes.io/projected/959dacf0-da8f-4b82-9eeb-5548452ae6a7-kube-api-access-qxvdc\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.287904 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.287856 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/959dacf0-da8f-4b82-9eeb-5548452ae6a7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.289988 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.289969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/959dacf0-da8f-4b82-9eeb-5548452ae6a7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"959dacf0-da8f-4b82-9eeb-5548452ae6a7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.334960 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.334680 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:38.528077 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.527989 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:38.589395 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.589361 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:38.990165 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:38.990138 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:02:38.992021 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:02:38.992001 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959dacf0_da8f_4b82_9eeb_5548452ae6a7.slice/crio-7bcdb9ee65dba8c2974bb3676df3d97b7cdee4b0ac704d8ce9c35ea3913a2cb9 WatchSource:0}: Error finding container 7bcdb9ee65dba8c2974bb3676df3d97b7cdee4b0ac704d8ce9c35ea3913a2cb9: Status 404 returned error can't find the container with id 7bcdb9ee65dba8c2974bb3676df3d97b7cdee4b0ac704d8ce9c35ea3913a2cb9 Jul 08 19:02:39.138739 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:39.138646 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" event={"ID":"c55987b2-5fa3-48f0-9176-ca8450bbda1a","Type":"ContainerStarted","Data":"643d3836a63a7826eefde10c4538a6947d5a902d0e53d8bc733758f03fb415f1"} Jul 08 19:02:39.138913 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:39.138845 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" Jul 08 19:02:39.140594 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:39.140527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" event={"ID":"0cbaeed2-305d-4d24-84ff-a6e27e6546fa","Type":"ContainerStarted","Data":"58238df048121640f71bf50b3f65ef927bd3aa8f3e02fca883b0b837ba0f1921"} Jul 08 19:02:39.141783 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:39.141764 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"959dacf0-da8f-4b82-9eeb-5548452ae6a7","Type":"ContainerStarted","Data":"7bcdb9ee65dba8c2974bb3676df3d97b7cdee4b0ac704d8ce9c35ea3913a2cb9"} Jul 08 19:02:39.144170 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:39.144142 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" Jul 08 19:02:39.167207 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:39.167151 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xrh9z" podStartSLOduration=1.279227407 podStartE2EDuration="3.167137646s" totalImagesPullingTime="1.887910239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:39.164220562 +0000 UTC m=+84.770133634" watchObservedRunningTime="2026-07-08 19:02:39.167137646 +0000 UTC m=+84.773050717" Jul 08 19:02:39.237909 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:39.237857 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" podStartSLOduration=1.8077853510000002 podStartE2EDuration="4.237840701s" totalImagesPullingTime="2.43005535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:39.237113377 +0000 UTC m=+84.843026449" watchObservedRunningTime="2026-07-08 19:02:39.237840701 +0000 UTC m=+84.843753774" Jul 08 19:02:40.146951 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:40.146925 2577 generic.go:356] "Generic (PLEG): container finished" podID="959dacf0-da8f-4b82-9eeb-5548452ae6a7" containerID="98cd1720ec8c783420954c15908aef4394410a2c5a517e3198f15a759533ad6c" exitCode=0 Jul 08 19:02:40.147053 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:40.147012 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"959dacf0-da8f-4b82-9eeb-5548452ae6a7","Type":"ContainerDied","Data":"98cd1720ec8c783420954c15908aef4394410a2c5a517e3198f15a759533ad6c"} Jul 08 19:02:40.188446 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:40.188419 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:40.284530 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:40.284499 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:42.886948 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:42.886893 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:43.014249 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:43.014213 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:43.348216 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:43.348182 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:43.454426 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:43.454283 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:43.509433 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:43.509397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:44.189816 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:44.189757 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:44.250484 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:44.250454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:45.170377 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:45.170329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"959dacf0-da8f-4b82-9eeb-5548452ae6a7","Type":"ContainerStarted","Data":"a657524d29c80b89db97f3cfc182d13449adcdf0f9ce840599de8753c2c28271"} Jul 08 19:02:45.170546 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:45.170426 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"959dacf0-da8f-4b82-9eeb-5548452ae6a7","Type":"ContainerStarted","Data":"b8808598e787c4cb3a51ba2ed16ba9f12538a513f1f7885d8daf7224a7b71fd0"} Jul 08 19:02:47.338410 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:47.338384 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:47.444608 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:47.444573 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:47.553872 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:47.553840 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:48.189801 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:48.189753 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"959dacf0-da8f-4b82-9eeb-5548452ae6a7","Type":"ContainerStarted","Data":"f7a19b56242f58a1334fdd0102105e7b5ce5a6a87e0d6826aaef2dbecb64ae66"} Jul 08 19:02:48.190003 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:48.189853 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"959dacf0-da8f-4b82-9eeb-5548452ae6a7","Type":"ContainerStarted","Data":"a8df83c05c4b5cdf4286fb200b33e749eea47f513ab6252b3fd65c3cb7e7a462"} Jul 08 19:02:48.190003 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:48.189892 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"959dacf0-da8f-4b82-9eeb-5548452ae6a7","Type":"ContainerStarted","Data":"996dc26e3b630185c5e744724278f2d880cf087996c40df8904dcf01ce75df15"} Jul 08 19:02:48.190003 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:48.189925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"959dacf0-da8f-4b82-9eeb-5548452ae6a7","Type":"ContainerStarted","Data":"6b887a0313f8f9265ff01aed25f28af0411e6393153a6950cac594891ac713f0"} Jul 08 19:02:48.244395 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:48.244338 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.328469923 podStartE2EDuration="11.244316542s" totalImagesPullingTime="7.897945029s" totalInitContainerRuntime="17.90159ms" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:48.24233335 +0000 UTC m=+93.848246424" watchObservedRunningTime="2026-07-08 19:02:48.244316542 +0000 UTC m=+93.850229615" Jul 08 19:02:48.335588 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:48.335557 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:02:51.481841 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:51.481790 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:51.581299 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:51.581241 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:51.685466 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:51.685428 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:52.081345 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:52.081309 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:52.153655 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:52.153618 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:53.277788 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:53.277754 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:53.374084 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:53.374051 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:53.578736 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:53.578707 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:53.680269 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:53.680210 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:02:56.261636 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:56.261599 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:56.262013 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:56.261661 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:02:58.081598 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:02:58.081570 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8gfm5" Jul 08 19:03:00.269715 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.269680 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-844674b46d-82ldh" podUID="e58013b5-187d-4367-9ce6-cc03f83dc927" containerName="console" containerID="cri-o://cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34" gracePeriod=15 Jul 08 19:03:00.505031 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.505007 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:03:00.564364 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.564330 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-service-ca\") pod \"e58013b5-187d-4367-9ce6-cc03f83dc927\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " Jul 08 19:03:00.564542 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.564385 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-console-config\") pod \"e58013b5-187d-4367-9ce6-cc03f83dc927\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " Jul 08 19:03:00.564542 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.564458 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e58013b5-187d-4367-9ce6-cc03f83dc927-console-serving-cert\") pod \"e58013b5-187d-4367-9ce6-cc03f83dc927\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " Jul 08 19:03:00.564542 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.564489 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t2r2\" (UniqueName: \"kubernetes.io/projected/e58013b5-187d-4367-9ce6-cc03f83dc927-kube-api-access-4t2r2\") pod \"e58013b5-187d-4367-9ce6-cc03f83dc927\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " Jul 08 19:03:00.564542 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.564518 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-oauth-serving-cert\") pod \"e58013b5-187d-4367-9ce6-cc03f83dc927\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " Jul 08 19:03:00.564747 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.564559 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e58013b5-187d-4367-9ce6-cc03f83dc927-console-oauth-config\") pod \"e58013b5-187d-4367-9ce6-cc03f83dc927\" (UID: \"e58013b5-187d-4367-9ce6-cc03f83dc927\") " Jul 08 19:03:00.564875 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.564846 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-console-config" (OuterVolumeSpecName: "console-config") pod "e58013b5-187d-4367-9ce6-cc03f83dc927" (UID: "e58013b5-187d-4367-9ce6-cc03f83dc927"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:03:00.564945 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.564863 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-service-ca" (OuterVolumeSpecName: "service-ca") pod "e58013b5-187d-4367-9ce6-cc03f83dc927" (UID: "e58013b5-187d-4367-9ce6-cc03f83dc927"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:03:00.565007 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.564945 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e58013b5-187d-4367-9ce6-cc03f83dc927" (UID: "e58013b5-187d-4367-9ce6-cc03f83dc927"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:03:00.566991 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.566963 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e58013b5-187d-4367-9ce6-cc03f83dc927-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e58013b5-187d-4367-9ce6-cc03f83dc927" (UID: "e58013b5-187d-4367-9ce6-cc03f83dc927"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:03:00.566991 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.566983 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e58013b5-187d-4367-9ce6-cc03f83dc927-kube-api-access-4t2r2" (OuterVolumeSpecName: "kube-api-access-4t2r2") pod "e58013b5-187d-4367-9ce6-cc03f83dc927" (UID: "e58013b5-187d-4367-9ce6-cc03f83dc927"). InnerVolumeSpecName "kube-api-access-4t2r2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:03:00.567125 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.567006 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e58013b5-187d-4367-9ce6-cc03f83dc927-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e58013b5-187d-4367-9ce6-cc03f83dc927" (UID: "e58013b5-187d-4367-9ce6-cc03f83dc927"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:03:00.665282 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.665232 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-service-ca\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:03:00.665282 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.665289 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-console-config\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:03:00.665468 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.665300 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e58013b5-187d-4367-9ce6-cc03f83dc927-console-serving-cert\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:03:00.665468 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.665309 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t2r2\" (UniqueName: \"kubernetes.io/projected/e58013b5-187d-4367-9ce6-cc03f83dc927-kube-api-access-4t2r2\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:03:00.665468 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.665319 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e58013b5-187d-4367-9ce6-cc03f83dc927-oauth-serving-cert\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:03:00.665468 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:00.665327 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e58013b5-187d-4367-9ce6-cc03f83dc927-console-oauth-config\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:03:01.237019 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:01.236986 2577 generic.go:356] "Generic (PLEG): container finished" podID="e58013b5-187d-4367-9ce6-cc03f83dc927" containerID="cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34" exitCode=0 Jul 08 19:03:01.237186 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:01.237031 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844674b46d-82ldh" Jul 08 19:03:01.237186 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:01.237065 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844674b46d-82ldh" event={"ID":"e58013b5-187d-4367-9ce6-cc03f83dc927","Type":"ContainerDied","Data":"cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34"} Jul 08 19:03:01.237186 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:01.237117 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844674b46d-82ldh" event={"ID":"e58013b5-187d-4367-9ce6-cc03f83dc927","Type":"ContainerDied","Data":"3b21a19e6647fca9512cbd9884f0c2dbad899c44199772623408021243105073"} Jul 08 19:03:01.237186 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:01.237138 2577 scope.go:117] "RemoveContainer" containerID="cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34" Jul 08 19:03:01.245824 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:01.245794 2577 scope.go:117] "RemoveContainer" containerID="cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34" Jul 08 19:03:01.246174 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:03:01.246129 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34\": container with ID starting with cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34 not found: ID does not exist" containerID="cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34" Jul 08 19:03:01.246317 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:01.246185 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34"} err="failed to get container status \"cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34\": rpc error: code = NotFound desc = could not find container \"cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34\": container with ID starting with cc4864593b031336d732d6ae785f11bdc2f3910a7d3b307d01580b5a91f4ca34 not found: ID does not exist" Jul 08 19:03:01.259833 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:01.259799 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844674b46d-82ldh"] Jul 08 19:03:01.267164 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:01.267138 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-844674b46d-82ldh"] Jul 08 19:03:02.788635 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:02.788586 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e58013b5-187d-4367-9ce6-cc03f83dc927" path="/var/lib/kubelet/pods/e58013b5-187d-4367-9ce6-cc03f83dc927/volumes" Jul 08 19:03:06.544048 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:06.544015 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:03:06.604421 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:06.604391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:03:16.267314 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:16.267280 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:03:16.271454 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:16.271422 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5988d766d8-v25r9" Jul 08 19:03:22.584348 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:22.584313 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:03:22.644297 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:22.644252 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:03:29.461138 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:29.461106 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:03:38.335865 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:38.335823 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:03:38.354614 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:38.354575 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:03:38.390098 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:38.390071 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:03:47.847085 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:47.847038 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:03:47.905631 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:47.905592 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:03:48.608696 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:48.608664 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:03:48.678942 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:48.678913 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:03:59.800063 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:59.800033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:03:59.858436 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:59.858388 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:03:59.928332 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:03:59.928302 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:04:06.552378 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:04:06.552302 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:04:06.657908 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:04:06.657872 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:04:06.755213 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:04:06.755181 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:04:15.695314 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:04:15.695243 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:04:21.286532 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:04:21.286486 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:04:21.349408 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:04:21.349376 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:04:51.324607 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:04:51.324570 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:04:51.420113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:04:51.420069 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:22.772221 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:22.772180 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:24.137108 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:24.137065 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:26.445532 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:26.445498 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:26.547334 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:26.547301 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:28.444664 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:28.444621 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:28.549814 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:28.549778 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:28.638971 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:28.638938 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:30.957593 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:30.957554 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:31.258336 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:31.258241 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:33.384974 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:33.384945 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:33.484507 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:33.484471 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:36.504019 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:36.503931 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:36.603002 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:36.602945 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:38.609415 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:38.609349 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:42.626974 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:42.626934 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:42.684358 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:42.684327 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:45.586426 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:45.586386 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:45.686407 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:45.686358 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:51.795437 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:51.795397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:51.896684 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:51.896646 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:53.996937 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:05:53.996906 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:04.286400 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.286361 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:04.359760 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.359727 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv"] Jul 08 19:06:04.359995 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.359983 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e58013b5-187d-4367-9ce6-cc03f83dc927" containerName="console" Jul 08 19:06:04.360042 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.359996 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e58013b5-187d-4367-9ce6-cc03f83dc927" containerName="console" Jul 08 19:06:04.360075 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.360051 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e58013b5-187d-4367-9ce6-cc03f83dc927" containerName="console" Jul 08 19:06:04.362865 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.362843 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.365720 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.365702 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 19:06:04.367108 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.367080 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qqjrz\"" Jul 08 19:06:04.371305 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.367288 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:06:04.371305 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.367397 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 19:06:04.371305 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.367623 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 19:06:04.371305 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.367644 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 19:06:04.378172 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.378150 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv"] Jul 08 19:06:04.498600 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.498566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3da0796d-e92d-4d64-8f45-659c3fd2d10f-cert\") pod \"lws-controller-manager-ff8fc7d87-kzrmv\" (UID: \"3da0796d-e92d-4d64-8f45-659c3fd2d10f\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.498807 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.498627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3da0796d-e92d-4d64-8f45-659c3fd2d10f-manager-config\") pod \"lws-controller-manager-ff8fc7d87-kzrmv\" (UID: \"3da0796d-e92d-4d64-8f45-659c3fd2d10f\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.498807 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.498694 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3da0796d-e92d-4d64-8f45-659c3fd2d10f-metrics-cert\") pod \"lws-controller-manager-ff8fc7d87-kzrmv\" (UID: \"3da0796d-e92d-4d64-8f45-659c3fd2d10f\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.498807 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.498752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9hls\" (UniqueName: \"kubernetes.io/projected/3da0796d-e92d-4d64-8f45-659c3fd2d10f-kube-api-access-p9hls\") pod \"lws-controller-manager-ff8fc7d87-kzrmv\" (UID: \"3da0796d-e92d-4d64-8f45-659c3fd2d10f\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.599421 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.599382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3da0796d-e92d-4d64-8f45-659c3fd2d10f-manager-config\") pod \"lws-controller-manager-ff8fc7d87-kzrmv\" (UID: \"3da0796d-e92d-4d64-8f45-659c3fd2d10f\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.599575 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.599433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3da0796d-e92d-4d64-8f45-659c3fd2d10f-metrics-cert\") pod \"lws-controller-manager-ff8fc7d87-kzrmv\" (UID: \"3da0796d-e92d-4d64-8f45-659c3fd2d10f\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.599575 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.599458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9hls\" (UniqueName: \"kubernetes.io/projected/3da0796d-e92d-4d64-8f45-659c3fd2d10f-kube-api-access-p9hls\") pod \"lws-controller-manager-ff8fc7d87-kzrmv\" (UID: \"3da0796d-e92d-4d64-8f45-659c3fd2d10f\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.599575 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.599492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3da0796d-e92d-4d64-8f45-659c3fd2d10f-cert\") pod \"lws-controller-manager-ff8fc7d87-kzrmv\" (UID: \"3da0796d-e92d-4d64-8f45-659c3fd2d10f\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.600078 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.600054 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3da0796d-e92d-4d64-8f45-659c3fd2d10f-manager-config\") pod \"lws-controller-manager-ff8fc7d87-kzrmv\" (UID: \"3da0796d-e92d-4d64-8f45-659c3fd2d10f\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.602040 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.602019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3da0796d-e92d-4d64-8f45-659c3fd2d10f-cert\") pod \"lws-controller-manager-ff8fc7d87-kzrmv\" (UID: \"3da0796d-e92d-4d64-8f45-659c3fd2d10f\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.602126 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.602052 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3da0796d-e92d-4d64-8f45-659c3fd2d10f-metrics-cert\") pod \"lws-controller-manager-ff8fc7d87-kzrmv\" (UID: \"3da0796d-e92d-4d64-8f45-659c3fd2d10f\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.610483 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.610458 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9hls\" (UniqueName: \"kubernetes.io/projected/3da0796d-e92d-4d64-8f45-659c3fd2d10f-kube-api-access-p9hls\") pod \"lws-controller-manager-ff8fc7d87-kzrmv\" (UID: \"3da0796d-e92d-4d64-8f45-659c3fd2d10f\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.674844 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.674806 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:04.809677 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.809589 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv"] Jul 08 19:06:04.811831 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:06:04.811801 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da0796d_e92d_4d64_8f45_659c3fd2d10f.slice/crio-9d6390a02eea1097fcd8bcd20d44f758f733809e5f1ab281e5897edac5eac7af WatchSource:0}: Error finding container 9d6390a02eea1097fcd8bcd20d44f758f733809e5f1ab281e5897edac5eac7af: Status 404 returned error can't find the container with id 9d6390a02eea1097fcd8bcd20d44f758f733809e5f1ab281e5897edac5eac7af Jul 08 19:06:04.867516 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:04.867426 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" event={"ID":"3da0796d-e92d-4d64-8f45-659c3fd2d10f","Type":"ContainerStarted","Data":"9d6390a02eea1097fcd8bcd20d44f758f733809e5f1ab281e5897edac5eac7af"} Jul 08 19:06:05.479923 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:05.479890 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:05.786324 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:05.786233 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:05.886637 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:05.886589 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:06.403721 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.403688 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:06.621440 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.621407 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:06.727966 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.727888 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:06.773752 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.773723 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx"] Jul 08 19:06:06.782463 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.782435 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:06.785084 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.785059 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 19:06:06.785235 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.785127 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 19:06:06.785438 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.785415 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-np4sl\"" Jul 08 19:06:06.785511 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.785455 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 19:06:06.785511 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.785460 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 19:06:06.790326 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.790300 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx"] Jul 08 19:06:06.920461 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.920422 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19a589fd-4ec9-4cbb-9306-0298123c10bf-webhook-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:06.920648 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.920474 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k65m9\" (UniqueName: \"kubernetes.io/projected/19a589fd-4ec9-4cbb-9306-0298123c10bf-kube-api-access-k65m9\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:06.920648 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.920535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/19a589fd-4ec9-4cbb-9306-0298123c10bf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:06.920648 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.920603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19a589fd-4ec9-4cbb-9306-0298123c10bf-tmp\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:06.920648 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.920645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/19a589fd-4ec9-4cbb-9306-0298123c10bf-manifests\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:06.925461 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:06.925420 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:07.021068 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.020994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19a589fd-4ec9-4cbb-9306-0298123c10bf-tmp\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:07.021068 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.021040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/19a589fd-4ec9-4cbb-9306-0298123c10bf-manifests\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:07.021304 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.021080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19a589fd-4ec9-4cbb-9306-0298123c10bf-webhook-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:07.021304 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.021108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k65m9\" (UniqueName: \"kubernetes.io/projected/19a589fd-4ec9-4cbb-9306-0298123c10bf-kube-api-access-k65m9\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:07.021304 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.021182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/19a589fd-4ec9-4cbb-9306-0298123c10bf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:07.021492 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.021470 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/19a589fd-4ec9-4cbb-9306-0298123c10bf-manifests\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:07.022302 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.022275 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:07.023624 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.023604 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19a589fd-4ec9-4cbb-9306-0298123c10bf-webhook-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:07.023896 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.023870 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19a589fd-4ec9-4cbb-9306-0298123c10bf-tmp\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:07.024229 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.024207 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/19a589fd-4ec9-4cbb-9306-0298123c10bf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:07.031317 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.031291 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k65m9\" (UniqueName: \"kubernetes.io/projected/19a589fd-4ec9-4cbb-9306-0298123c10bf-kube-api-access-k65m9\") pod \"opendatahub-operator-controller-manager-9dc45487-zshsx\" (UID: \"19a589fd-4ec9-4cbb-9306-0298123c10bf\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:07.095873 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.095835 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:07.122165 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.122135 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:07.219814 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.219780 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:07.284283 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.284171 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:07.517014 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.516992 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx"] Jul 08 19:06:07.518449 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:06:07.518421 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a589fd_4ec9_4cbb_9306_0298123c10bf.slice/crio-ca9abb9d71168bf2e5b1daf5310115d9792af67cd87713f94ce355aa4036b36f WatchSource:0}: Error finding container ca9abb9d71168bf2e5b1daf5310115d9792af67cd87713f94ce355aa4036b36f: Status 404 returned error can't find the container with id ca9abb9d71168bf2e5b1daf5310115d9792af67cd87713f94ce355aa4036b36f Jul 08 19:06:07.881031 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.880997 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" event={"ID":"3da0796d-e92d-4d64-8f45-659c3fd2d10f","Type":"ContainerStarted","Data":"6e630ae46e04687b720feb8c5ea602777b3a2bf1487ad3eb8cef4ef739156f7a"} Jul 08 19:06:07.881505 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.881109 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:07.882356 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.882328 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" event={"ID":"19a589fd-4ec9-4cbb-9306-0298123c10bf","Type":"ContainerStarted","Data":"ca9abb9d71168bf2e5b1daf5310115d9792af67cd87713f94ce355aa4036b36f"} Jul 08 19:06:07.915137 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:07.915083 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" podStartSLOduration=1.283803876 podStartE2EDuration="3.915066657s" totalImagesPullingTime="2.631262781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:07.913177553 +0000 UTC m=+293.519090627" watchObservedRunningTime="2026-07-08 19:06:07.915066657 +0000 UTC m=+293.520979728" Jul 08 19:06:10.895461 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:10.895427 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" event={"ID":"19a589fd-4ec9-4cbb-9306-0298123c10bf","Type":"ContainerStarted","Data":"0da2552066f70a2e63c9b6c1f2d23c1cbf7d4afb7b47c926bb3536a16a5508f0"} Jul 08 19:06:11.900403 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:11.900371 2577 generic.go:356] "Generic (PLEG): container finished" podID="19a589fd-4ec9-4cbb-9306-0298123c10bf" containerID="0da2552066f70a2e63c9b6c1f2d23c1cbf7d4afb7b47c926bb3536a16a5508f0" exitCode=0 Jul 08 19:06:11.900810 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:11.900432 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" event={"ID":"19a589fd-4ec9-4cbb-9306-0298123c10bf","Type":"ContainerDied","Data":"0da2552066f70a2e63c9b6c1f2d23c1cbf7d4afb7b47c926bb3536a16a5508f0"} Jul 08 19:06:12.906973 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:12.906933 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" event={"ID":"19a589fd-4ec9-4cbb-9306-0298123c10bf","Type":"ContainerStarted","Data":"0a7b7ab6e0e952b8fd56ebc40176d2b3b720f90f3ebfbdc584ba702ae1d13640"} Jul 08 19:06:12.907397 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:12.907061 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:12.929580 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:12.929474 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" podStartSLOduration=2.7587553590000002 podStartE2EDuration="6.9294539s" totalImagesPullingTime="3.124830876s" totalInitContainerRuntime="1.045867665s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:12.927592172 +0000 UTC m=+298.533505245" watchObservedRunningTime="2026-07-08 19:06:12.9294539 +0000 UTC m=+298.535366974" Jul 08 19:06:14.698559 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:14.698520 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 19:06:18.888600 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:18.888527 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-kzrmv" Jul 08 19:06:21.479894 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:21.479859 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:21.639219 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:21.639184 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:23.913432 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:23.913400 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-zshsx" Jul 08 19:06:25.778314 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:25.778281 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:25.874502 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:25.874470 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:25.984034 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:25.983998 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:26.150656 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.150624 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt"] Jul 08 19:06:26.223141 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.223102 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt"] Jul 08 19:06:26.223407 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.223247 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" Jul 08 19:06:26.227066 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.227037 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 19:06:26.227374 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.227351 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 19:06:26.227530 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.227372 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 19:06:26.227941 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.227922 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 19:06:26.228039 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.227930 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kqqnn\"" Jul 08 19:06:26.278302 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.278239 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a7b251a-612a-4904-82b4-2e50b7f0a3cb-tls-certs\") pod \"kube-auth-proxy-9cd5f7d96-8vmlt\" (UID: \"0a7b251a-612a-4904-82b4-2e50b7f0a3cb\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" Jul 08 19:06:26.278464 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.278320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q66dv\" (UniqueName: \"kubernetes.io/projected/0a7b251a-612a-4904-82b4-2e50b7f0a3cb-kube-api-access-q66dv\") pod \"kube-auth-proxy-9cd5f7d96-8vmlt\" (UID: \"0a7b251a-612a-4904-82b4-2e50b7f0a3cb\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" Jul 08 19:06:26.278464 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.278340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a7b251a-612a-4904-82b4-2e50b7f0a3cb-tmp\") pod \"kube-auth-proxy-9cd5f7d96-8vmlt\" (UID: \"0a7b251a-612a-4904-82b4-2e50b7f0a3cb\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" Jul 08 19:06:26.290618 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.290587 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:26.378972 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.378939 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a7b251a-612a-4904-82b4-2e50b7f0a3cb-tls-certs\") pod \"kube-auth-proxy-9cd5f7d96-8vmlt\" (UID: \"0a7b251a-612a-4904-82b4-2e50b7f0a3cb\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" Jul 08 19:06:26.379158 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.378979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q66dv\" (UniqueName: \"kubernetes.io/projected/0a7b251a-612a-4904-82b4-2e50b7f0a3cb-kube-api-access-q66dv\") pod \"kube-auth-proxy-9cd5f7d96-8vmlt\" (UID: \"0a7b251a-612a-4904-82b4-2e50b7f0a3cb\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" Jul 08 19:06:26.379158 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.378998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a7b251a-612a-4904-82b4-2e50b7f0a3cb-tmp\") pod \"kube-auth-proxy-9cd5f7d96-8vmlt\" (UID: \"0a7b251a-612a-4904-82b4-2e50b7f0a3cb\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" Jul 08 19:06:26.381475 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.381442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a7b251a-612a-4904-82b4-2e50b7f0a3cb-tmp\") pod \"kube-auth-proxy-9cd5f7d96-8vmlt\" (UID: \"0a7b251a-612a-4904-82b4-2e50b7f0a3cb\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" Jul 08 19:06:26.381614 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.381596 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a7b251a-612a-4904-82b4-2e50b7f0a3cb-tls-certs\") pod \"kube-auth-proxy-9cd5f7d96-8vmlt\" (UID: \"0a7b251a-612a-4904-82b4-2e50b7f0a3cb\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" Jul 08 19:06:26.388742 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.388719 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q66dv\" (UniqueName: \"kubernetes.io/projected/0a7b251a-612a-4904-82b4-2e50b7f0a3cb-kube-api-access-q66dv\") pod \"kube-auth-proxy-9cd5f7d96-8vmlt\" (UID: \"0a7b251a-612a-4904-82b4-2e50b7f0a3cb\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" Jul 08 19:06:26.487688 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.487613 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:26.535167 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.535135 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" Jul 08 19:06:26.582615 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.582576 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:26.689830 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.689803 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:26.720416 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.720363 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt"] Jul 08 19:06:26.723587 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:06:26.723556 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7b251a_612a_4904_82b4_2e50b7f0a3cb.slice/crio-a105fc37bc157f4d16d40c44801827c2cbf22ae9b0c5dc2e151cefe2db4bc306 WatchSource:0}: Error finding container a105fc37bc157f4d16d40c44801827c2cbf22ae9b0c5dc2e151cefe2db4bc306: Status 404 returned error can't find the container with id a105fc37bc157f4d16d40c44801827c2cbf22ae9b0c5dc2e151cefe2db4bc306 Jul 08 19:06:26.725825 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.725807 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:06:26.959946 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:26.959911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" event={"ID":"0a7b251a-612a-4904-82b4-2e50b7f0a3cb","Type":"ContainerStarted","Data":"a105fc37bc157f4d16d40c44801827c2cbf22ae9b0c5dc2e151cefe2db4bc306"} Jul 08 19:06:27.261838 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:27.261750 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:27.395694 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:27.395643 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:27.482023 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:27.481987 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:27.539490 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:27.539392 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:28.497420 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:28.497372 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:29.975102 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:29.975068 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" event={"ID":"0a7b251a-612a-4904-82b4-2e50b7f0a3cb","Type":"ContainerStarted","Data":"3c54096a573bcfe247cff4852383348793e8444e3483707024c6adb7cc4ce863"} Jul 08 19:06:29.993197 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:29.993148 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8vmlt" podStartSLOduration=0.948666967 podStartE2EDuration="3.993131666s" totalImagesPullingTime="3.044464699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:29.992287722 +0000 UTC m=+315.598200788" watchObservedRunningTime="2026-07-08 19:06:29.993131666 +0000 UTC m=+315.599044738" Jul 08 19:06:34.021566 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.021533 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:34.119491 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.119458 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:34.865743 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.865715 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch"] Jul 08 19:06:34.870243 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.870224 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:34.872923 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.872898 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xcn4b\"" Jul 08 19:06:34.873032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.873004 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 19:06:34.882062 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.882039 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch"] Jul 08 19:06:34.897543 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.897513 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:34.944148 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.944113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:34.944367 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.944157 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg86m\" (UniqueName: \"kubernetes.io/projected/776f7577-6c4e-4121-865e-91f50b0131a3-kube-api-access-dg86m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:34.944367 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.944196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:34.944367 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.944214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/776f7577-6c4e-4121-865e-91f50b0131a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:34.944367 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.944302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/776f7577-6c4e-4121-865e-91f50b0131a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:34.944367 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.944339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:34.944616 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.944411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:34.944616 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.944478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:34.944616 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:34.944521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/776f7577-6c4e-4121-865e-91f50b0131a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.045185 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/776f7577-6c4e-4121-865e-91f50b0131a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.045690 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.045690 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.045690 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.045690 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/776f7577-6c4e-4121-865e-91f50b0131a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.045690 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.045690 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg86m\" (UniqueName: \"kubernetes.io/projected/776f7577-6c4e-4121-865e-91f50b0131a3-kube-api-access-dg86m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.045690 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045444 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.045690 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045472 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/776f7577-6c4e-4121-865e-91f50b0131a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.045690 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045675 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.046130 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045698 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.046130 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.046130 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045779 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.046130 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.045991 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/776f7577-6c4e-4121-865e-91f50b0131a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.047875 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.047855 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/776f7577-6c4e-4121-865e-91f50b0131a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.048172 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.048153 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/776f7577-6c4e-4121-865e-91f50b0131a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.055707 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.055685 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg86m\" (UniqueName: \"kubernetes.io/projected/776f7577-6c4e-4121-865e-91f50b0131a3-kube-api-access-dg86m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.055813 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.055793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/776f7577-6c4e-4121-865e-91f50b0131a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wc7ch\" (UID: \"776f7577-6c4e-4121-865e-91f50b0131a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.135225 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.135104 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:35.180682 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.180634 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:35.321554 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.321527 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch"] Jul 08 19:06:35.324179 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:06:35.324148 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776f7577_6c4e_4121_865e_91f50b0131a3.slice/crio-bbde61b0d560ccb792bf693c84e58cdcc2bb123ab0f3bbff2c131789b3c61001 WatchSource:0}: Error finding container bbde61b0d560ccb792bf693c84e58cdcc2bb123ab0f3bbff2c131789b3c61001: Status 404 returned error can't find the container with id bbde61b0d560ccb792bf693c84e58cdcc2bb123ab0f3bbff2c131789b3c61001 Jul 08 19:06:35.587895 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:35.587853 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:36.000312 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:36.000099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" event={"ID":"776f7577-6c4e-4121-865e-91f50b0131a3","Type":"ContainerStarted","Data":"bbde61b0d560ccb792bf693c84e58cdcc2bb123ab0f3bbff2c131789b3c61001"} Jul 08 19:06:36.938659 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:36.938614 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:37.033813 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.033733 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:37.059112 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.059075 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8"] Jul 08 19:06:37.064170 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.064122 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" Jul 08 19:06:37.070611 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.070586 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-pfvwb\"" Jul 08 19:06:37.073906 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.073880 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 08 19:06:37.078710 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.078679 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8"] Jul 08 19:06:37.138914 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.138873 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:37.165381 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.165341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qmdb\" (UniqueName: \"kubernetes.io/projected/6f847f97-b488-476b-9ab8-1a7ac75e056b-kube-api-access-8qmdb\") pod \"llmisvc-controller-manager-777c6bd7d5-t74g8\" (UID: \"6f847f97-b488-476b-9ab8-1a7ac75e056b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" Jul 08 19:06:37.165569 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.165506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f847f97-b488-476b-9ab8-1a7ac75e056b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t74g8\" (UID: \"6f847f97-b488-476b-9ab8-1a7ac75e056b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" Jul 08 19:06:37.265510 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.265395 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:37.266393 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.266367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qmdb\" (UniqueName: \"kubernetes.io/projected/6f847f97-b488-476b-9ab8-1a7ac75e056b-kube-api-access-8qmdb\") pod \"llmisvc-controller-manager-777c6bd7d5-t74g8\" (UID: \"6f847f97-b488-476b-9ab8-1a7ac75e056b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" Jul 08 19:06:37.266530 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.266450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f847f97-b488-476b-9ab8-1a7ac75e056b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t74g8\" (UID: \"6f847f97-b488-476b-9ab8-1a7ac75e056b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" Jul 08 19:06:37.266641 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:06:37.266623 2577 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 08 19:06:37.266713 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:06:37.266698 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f847f97-b488-476b-9ab8-1a7ac75e056b-cert podName:6f847f97-b488-476b-9ab8-1a7ac75e056b nodeName:}" failed. No retries permitted until 2026-07-08 19:06:37.766678455 +0000 UTC m=+323.372591521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6f847f97-b488-476b-9ab8-1a7ac75e056b-cert") pod "llmisvc-controller-manager-777c6bd7d5-t74g8" (UID: "6f847f97-b488-476b-9ab8-1a7ac75e056b") : secret "llmisvc-webhook-server-cert" not found Jul 08 19:06:37.281343 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.281318 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qmdb\" (UniqueName: \"kubernetes.io/projected/6f847f97-b488-476b-9ab8-1a7ac75e056b-kube-api-access-8qmdb\") pod \"llmisvc-controller-manager-777c6bd7d5-t74g8\" (UID: \"6f847f97-b488-476b-9ab8-1a7ac75e056b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" Jul 08 19:06:37.363894 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.363857 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:37.462658 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.462606 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:37.770121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.770087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f847f97-b488-476b-9ab8-1a7ac75e056b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t74g8\" (UID: \"6f847f97-b488-476b-9ab8-1a7ac75e056b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" Jul 08 19:06:37.773187 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.773159 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f847f97-b488-476b-9ab8-1a7ac75e056b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t74g8\" (UID: \"6f847f97-b488-476b-9ab8-1a7ac75e056b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" Jul 08 19:06:37.977192 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:37.977151 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" Jul 08 19:06:38.081499 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:38.081469 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:06:38.081576 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:38.081538 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:06:38.081576 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:38.081567 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:06:38.147555 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:38.147530 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8"] Jul 08 19:06:38.150950 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:06:38.150926 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6f847f97_b488_476b_9ab8_1a7ac75e056b.slice/crio-4d499d9b7a39b2ce052b6e50656a6782d63de89229765dd9a452874f1018cc3a WatchSource:0}: Error finding container 4d499d9b7a39b2ce052b6e50656a6782d63de89229765dd9a452874f1018cc3a: Status 404 returned error can't find the container with id 4d499d9b7a39b2ce052b6e50656a6782d63de89229765dd9a452874f1018cc3a Jul 08 19:06:39.012510 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:39.012476 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" event={"ID":"776f7577-6c4e-4121-865e-91f50b0131a3","Type":"ContainerStarted","Data":"a6b54328f3e575d99040aa62959fd02801b861cfbb6b10af1559d6cba02c0291"} Jul 08 19:06:39.013700 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:39.013674 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" event={"ID":"6f847f97-b488-476b-9ab8-1a7ac75e056b","Type":"ContainerStarted","Data":"4d499d9b7a39b2ce052b6e50656a6782d63de89229765dd9a452874f1018cc3a"} Jul 08 19:06:39.063552 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:39.063493 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" podStartSLOduration=2.308493984 podStartE2EDuration="5.063475896s" totalImagesPullingTime="2.754981912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:39.062519478 +0000 UTC m=+324.668432552" watchObservedRunningTime="2026-07-08 19:06:39.063475896 +0000 UTC m=+324.669388968" Jul 08 19:06:39.181841 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:39.181806 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:39.186446 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:39.186412 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:40.018637 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:40.018604 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:40.019799 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:40.019777 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wc7ch" Jul 08 19:06:42.028614 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:42.028531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" event={"ID":"6f847f97-b488-476b-9ab8-1a7ac75e056b","Type":"ContainerStarted","Data":"62eaa7ad5c1d5aa2455246c9ea8c4a302b813c2cc9a6e24e438b26ff045fd5f7"} Jul 08 19:06:43.032415 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:43.032388 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" Jul 08 19:06:47.091292 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:47.091234 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:47.152043 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:47.152007 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:47.223892 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:06:47.223843 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:03.794368 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:07:03.794331 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:03.850482 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:07:03.850449 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:14.039958 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:07:14.039888 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" Jul 08 19:07:14.060687 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:07:14.060630 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t74g8" podStartSLOduration=33.519379785 podStartE2EDuration="37.060612895s" totalImagesPullingTime="3.54123311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:42.052145837 +0000 UTC m=+327.658058909" watchObservedRunningTime="2026-07-08 19:07:14.060612895 +0000 UTC m=+359.666525967" Jul 08 19:07:27.268899 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:07:27.268853 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:27.377379 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:07:27.377341 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:27.472213 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:07:27.472184 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:56.421698 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:07:56.421669 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:59.862000 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:07:59.861968 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:00.642485 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:00.642435 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:01.199473 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:01.199435 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:01.313420 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:01.313384 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:03.666557 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:03.666520 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:03.766605 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:03.766566 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:03.893805 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:03.893771 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:06.090123 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:06.090074 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:07.843012 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:07.842981 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:09.416165 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:09.416130 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:11.043427 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:11.043381 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:12.132003 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:12.131969 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:12.232982 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:12.232951 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:12.329152 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:12.329122 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:13.005746 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:13.005717 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:13.105801 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:13.105770 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:17.033572 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:17.033541 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:17.135166 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:17.135135 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:17.475476 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:17.475436 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:17.542047 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:17.542015 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:19.799816 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.799771 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:19.800846 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.800826 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs"] Jul 08 19:08:19.804008 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.803994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" Jul 08 19:08:19.806903 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.806879 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 08 19:08:19.807148 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.807126 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c8qc2\"" Jul 08 19:08:19.808039 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.808023 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 08 19:08:19.808039 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.808032 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 19:08:19.808195 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.808033 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 19:08:19.817311 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.817287 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs"] Jul 08 19:08:19.843331 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.843298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpxpq\" (UniqueName: \"kubernetes.io/projected/802aae78-644d-489e-b12f-bc326e6c3d77-kube-api-access-gpxpq\") pod \"kuadrant-console-plugin-66b5774985-bhprs\" (UID: \"802aae78-644d-489e-b12f-bc326e6c3d77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" Jul 08 19:08:19.843472 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.843396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/802aae78-644d-489e-b12f-bc326e6c3d77-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bhprs\" (UID: \"802aae78-644d-489e-b12f-bc326e6c3d77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" Jul 08 19:08:19.843472 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.843419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/802aae78-644d-489e-b12f-bc326e6c3d77-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bhprs\" (UID: \"802aae78-644d-489e-b12f-bc326e6c3d77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" Jul 08 19:08:19.943909 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.943871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/802aae78-644d-489e-b12f-bc326e6c3d77-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bhprs\" (UID: \"802aae78-644d-489e-b12f-bc326e6c3d77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" Jul 08 19:08:19.943909 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.943912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/802aae78-644d-489e-b12f-bc326e6c3d77-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bhprs\" (UID: \"802aae78-644d-489e-b12f-bc326e6c3d77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" Jul 08 19:08:19.944211 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.943980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpxpq\" (UniqueName: \"kubernetes.io/projected/802aae78-644d-489e-b12f-bc326e6c3d77-kube-api-access-gpxpq\") pod \"kuadrant-console-plugin-66b5774985-bhprs\" (UID: \"802aae78-644d-489e-b12f-bc326e6c3d77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" Jul 08 19:08:19.944211 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:08:19.944093 2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 08 19:08:19.944211 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:08:19.944166 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/802aae78-644d-489e-b12f-bc326e6c3d77-plugin-serving-cert podName:802aae78-644d-489e-b12f-bc326e6c3d77 nodeName:}" failed. No retries permitted until 2026-07-08 19:08:20.444148385 +0000 UTC m=+426.050061434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/802aae78-644d-489e-b12f-bc326e6c3d77-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-bhprs" (UID: "802aae78-644d-489e-b12f-bc326e6c3d77") : secret "plugin-serving-cert" not found Jul 08 19:08:19.944535 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.944516 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/802aae78-644d-489e-b12f-bc326e6c3d77-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bhprs\" (UID: \"802aae78-644d-489e-b12f-bc326e6c3d77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" Jul 08 19:08:19.962820 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:19.962790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpxpq\" (UniqueName: \"kubernetes.io/projected/802aae78-644d-489e-b12f-bc326e6c3d77-kube-api-access-gpxpq\") pod \"kuadrant-console-plugin-66b5774985-bhprs\" (UID: \"802aae78-644d-489e-b12f-bc326e6c3d77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" Jul 08 19:08:20.158639 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:20.158543 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:20.449022 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:20.448930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/802aae78-644d-489e-b12f-bc326e6c3d77-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bhprs\" (UID: \"802aae78-644d-489e-b12f-bc326e6c3d77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" Jul 08 19:08:20.451508 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:20.451480 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/802aae78-644d-489e-b12f-bc326e6c3d77-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bhprs\" (UID: \"802aae78-644d-489e-b12f-bc326e6c3d77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" Jul 08 19:08:20.723244 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:20.723149 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" Jul 08 19:08:20.857855 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:20.857829 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs"] Jul 08 19:08:20.859869 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:08:20.859844 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod802aae78_644d_489e_b12f_bc326e6c3d77.slice/crio-bb250b24c6b4cd2b1ff8edd330e3abff770c338d129b8ca2bd3501ad8c92caa4 WatchSource:0}: Error finding container bb250b24c6b4cd2b1ff8edd330e3abff770c338d129b8ca2bd3501ad8c92caa4: Status 404 returned error can't find the container with id bb250b24c6b4cd2b1ff8edd330e3abff770c338d129b8ca2bd3501ad8c92caa4 Jul 08 19:08:21.400209 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:21.400161 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:21.432086 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:21.432053 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" event={"ID":"802aae78-644d-489e-b12f-bc326e6c3d77","Type":"ContainerStarted","Data":"bb250b24c6b4cd2b1ff8edd330e3abff770c338d129b8ca2bd3501ad8c92caa4"} Jul 08 19:08:21.498172 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:21.498142 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:27.930750 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:27.930718 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:27.991514 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:27.991480 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:32.307164 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:32.307121 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:32.403805 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:32.403767 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:37.663898 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:37.663819 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:37.721636 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:37.721602 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:38.070040 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:38.070006 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:38.129253 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:38.129214 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:41.657836 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:41.657796 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:41.713112 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:41.713085 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:47.564012 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:47.563981 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" event={"ID":"802aae78-644d-489e-b12f-bc326e6c3d77","Type":"ContainerStarted","Data":"eb234d6cacbfe13ae65eb5f998d1c0cba13dd0a7797178a00e4bb1c925cb416c"} Jul 08 19:08:47.580879 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:47.580827 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bhprs" podStartSLOduration=2.992077401 podStartE2EDuration="28.580811948s" totalImagesPullingTime="25.588734547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:08:47.57938528 +0000 UTC m=+453.185298355" watchObservedRunningTime="2026-07-08 19:08:47.580811948 +0000 UTC m=+453.186725020" Jul 08 19:08:47.581286 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:47.581245 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:47.682300 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:47.682216 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:59.417475 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.417444 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk"] Jul 08 19:08:59.436274 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.436205 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:59.449923 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.449899 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk"] Jul 08 19:08:59.450064 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.449994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.453037 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.453019 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9plq8\"" Jul 08 19:08:59.595924 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.595889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce1676c4-ad5f-40c1-995c-2780154a68a7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.596136 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.595933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.596136 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.596002 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.596136 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.596029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.596136 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.596075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.596136 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.596096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce1676c4-ad5f-40c1-995c-2780154a68a7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.596362 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.596168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxn6d\" (UniqueName: \"kubernetes.io/projected/ce1676c4-ad5f-40c1-995c-2780154a68a7-kube-api-access-wxn6d\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.596362 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.596214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce1676c4-ad5f-40c1-995c-2780154a68a7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.596362 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.596233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697022 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.696919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697022 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.696976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697022 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.696995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce1676c4-ad5f-40c1-995c-2780154a68a7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697022 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.697028 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxn6d\" (UniqueName: \"kubernetes.io/projected/ce1676c4-ad5f-40c1-995c-2780154a68a7-kube-api-access-wxn6d\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697443 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.697059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce1676c4-ad5f-40c1-995c-2780154a68a7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697443 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.697082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697443 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.697117 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce1676c4-ad5f-40c1-995c-2780154a68a7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697443 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.697144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697443 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.697193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697669 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.697569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697669 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.697646 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697769 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.697747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.697870 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.697842 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce1676c4-ad5f-40c1-995c-2780154a68a7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.698163 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.697883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.699625 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.699602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce1676c4-ad5f-40c1-995c-2780154a68a7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.700171 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.700143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce1676c4-ad5f-40c1-995c-2780154a68a7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.708099 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.708074 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce1676c4-ad5f-40c1-995c-2780154a68a7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.708189 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.708134 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxn6d\" (UniqueName: \"kubernetes.io/projected/ce1676c4-ad5f-40c1-995c-2780154a68a7-kube-api-access-wxn6d\") pod \"maas-default-gateway-openshift-default-56654dcf7-45cbk\" (UID: \"ce1676c4-ad5f-40c1-995c-2780154a68a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.760837 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.760803 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:08:59.894484 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.894449 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk"] Jul 08 19:08:59.898571 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:08:59.898542 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1676c4_ad5f_40c1_995c_2780154a68a7.slice/crio-ef29f6ebeb7dc74b463da5eec3294d0aac1a57bccb61e70020dd72a652616323 WatchSource:0}: Error finding container ef29f6ebeb7dc74b463da5eec3294d0aac1a57bccb61e70020dd72a652616323: Status 404 returned error can't find the container with id ef29f6ebeb7dc74b463da5eec3294d0aac1a57bccb61e70020dd72a652616323 Jul 08 19:08:59.900771 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.900742 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:08:59.900847 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.900828 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:08:59.900888 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.900868 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:08:59.958986 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:08:59.958956 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:00.617654 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:00.617610 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" event={"ID":"ce1676c4-ad5f-40c1-995c-2780154a68a7","Type":"ContainerStarted","Data":"4d8297ab784a7e2510c3bb3cefaaf3d1cf3a267e0040064c6aea78a87958aa70"} Jul 08 19:09:00.618044 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:00.617666 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" event={"ID":"ce1676c4-ad5f-40c1-995c-2780154a68a7","Type":"ContainerStarted","Data":"ef29f6ebeb7dc74b463da5eec3294d0aac1a57bccb61e70020dd72a652616323"} Jul 08 19:09:00.641729 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:00.641668 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" podStartSLOduration=1.6416415199999999 podStartE2EDuration="1.64164152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:00.641581083 +0000 UTC m=+466.247494156" watchObservedRunningTime="2026-07-08 19:09:00.64164152 +0000 UTC m=+466.247554592" Jul 08 19:09:00.762018 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:00.761985 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:09:00.766810 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:00.766783 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:09:01.621783 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:01.621753 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:09:01.622855 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:01.622835 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:09:03.543151 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:03.543118 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:12.891459 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:12.891419 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:12.998210 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:12.998180 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:13.101127 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:13.101086 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:13.733362 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:13.733321 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-qpxrt"] Jul 08 19:09:13.763248 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:13.763213 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:13.807671 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:13.807637 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qpxrt"] Jul 08 19:09:13.807850 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:13.807738 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qpxrt" Jul 08 19:09:13.810509 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:13.810483 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rswsd\"" Jul 08 19:09:13.825295 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:13.825253 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:13.904663 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:13.904626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2ptc\" (UniqueName: \"kubernetes.io/projected/e69d966a-abe6-40c3-8386-98483666e320-kube-api-access-l2ptc\") pod \"authorino-58cd955675-qpxrt\" (UID: \"e69d966a-abe6-40c3-8386-98483666e320\") " pod="kuadrant-system/authorino-58cd955675-qpxrt" Jul 08 19:09:14.006199 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:14.006111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2ptc\" (UniqueName: \"kubernetes.io/projected/e69d966a-abe6-40c3-8386-98483666e320-kube-api-access-l2ptc\") pod \"authorino-58cd955675-qpxrt\" (UID: \"e69d966a-abe6-40c3-8386-98483666e320\") " pod="kuadrant-system/authorino-58cd955675-qpxrt" Jul 08 19:09:14.015484 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:14.015455 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2ptc\" (UniqueName: \"kubernetes.io/projected/e69d966a-abe6-40c3-8386-98483666e320-kube-api-access-l2ptc\") pod \"authorino-58cd955675-qpxrt\" (UID: \"e69d966a-abe6-40c3-8386-98483666e320\") " pod="kuadrant-system/authorino-58cd955675-qpxrt" Jul 08 19:09:14.118036 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:14.118003 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qpxrt" Jul 08 19:09:14.249836 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:14.249806 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qpxrt"] Jul 08 19:09:14.252951 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:09:14.252927 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode69d966a_abe6_40c3_8386_98483666e320.slice/crio-0d4042492d044ec8db0068af222710ccb8870f12c315310f6d6f6a99f79c7969 WatchSource:0}: Error finding container 0d4042492d044ec8db0068af222710ccb8870f12c315310f6d6f6a99f79c7969: Status 404 returned error can't find the container with id 0d4042492d044ec8db0068af222710ccb8870f12c315310f6d6f6a99f79c7969 Jul 08 19:09:14.677830 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:14.677796 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qpxrt" event={"ID":"e69d966a-abe6-40c3-8386-98483666e320","Type":"ContainerStarted","Data":"0d4042492d044ec8db0068af222710ccb8870f12c315310f6d6f6a99f79c7969"} Jul 08 19:09:19.164080 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:19.164051 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qpxrt"] Jul 08 19:09:19.704501 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:19.704467 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qpxrt" event={"ID":"e69d966a-abe6-40c3-8386-98483666e320","Type":"ContainerStarted","Data":"afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702"} Jul 08 19:09:19.723176 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:19.723119 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-qpxrt" podStartSLOduration=1.917195989 podStartE2EDuration="6.723102834s" totalImagesPullingTime="4.805906845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:19.722346544 +0000 UTC m=+485.328259615" watchObservedRunningTime="2026-07-08 19:09:19.723102834 +0000 UTC m=+485.329015903" Jul 08 19:09:20.708978 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:20.708938 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-qpxrt" podUID="e69d966a-abe6-40c3-8386-98483666e320" containerName="authorino" containerID="cri-o://afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702" gracePeriod=30 Jul 08 19:09:20.949087 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:20.949063 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qpxrt" Jul 08 19:09:21.067884 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:21.067858 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2ptc\" (UniqueName: \"kubernetes.io/projected/e69d966a-abe6-40c3-8386-98483666e320-kube-api-access-l2ptc\") pod \"e69d966a-abe6-40c3-8386-98483666e320\" (UID: \"e69d966a-abe6-40c3-8386-98483666e320\") " Jul 08 19:09:21.070110 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:21.070089 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69d966a-abe6-40c3-8386-98483666e320-kube-api-access-l2ptc" (OuterVolumeSpecName: "kube-api-access-l2ptc") pod "e69d966a-abe6-40c3-8386-98483666e320" (UID: "e69d966a-abe6-40c3-8386-98483666e320"). InnerVolumeSpecName "kube-api-access-l2ptc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:09:21.169132 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:21.169094 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2ptc\" (UniqueName: \"kubernetes.io/projected/e69d966a-abe6-40c3-8386-98483666e320-kube-api-access-l2ptc\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:09:21.713895 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:21.713857 2577 generic.go:356] "Generic (PLEG): container finished" podID="e69d966a-abe6-40c3-8386-98483666e320" containerID="afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702" exitCode=0 Jul 08 19:09:21.714351 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:21.713899 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qpxrt" Jul 08 19:09:21.714351 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:21.713927 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qpxrt" event={"ID":"e69d966a-abe6-40c3-8386-98483666e320","Type":"ContainerDied","Data":"afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702"} Jul 08 19:09:21.714351 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:21.713965 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qpxrt" event={"ID":"e69d966a-abe6-40c3-8386-98483666e320","Type":"ContainerDied","Data":"0d4042492d044ec8db0068af222710ccb8870f12c315310f6d6f6a99f79c7969"} Jul 08 19:09:21.714351 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:21.713989 2577 scope.go:117] "RemoveContainer" containerID="afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702" Jul 08 19:09:21.722430 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:21.722411 2577 scope.go:117] "RemoveContainer" containerID="afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702" Jul 08 19:09:21.722661 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:09:21.722642 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702\": container with ID starting with afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702 not found: ID does not exist" containerID="afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702" Jul 08 19:09:21.722724 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:21.722667 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702"} err="failed to get container status \"afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702\": rpc error: code = NotFound desc = could not find container \"afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702\": container with ID starting with afbedc05b96a951cb0c01a555968c3329919d8c29568981d8a4c9bfb75c3b702 not found: ID does not exist" Jul 08 19:09:21.735116 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:21.735092 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qpxrt"] Jul 08 19:09:21.739438 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:21.739414 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-qpxrt"] Jul 08 19:09:22.788163 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:22.788129 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e69d966a-abe6-40c3-8386-98483666e320" path="/var/lib/kubelet/pods/e69d966a-abe6-40c3-8386-98483666e320/volumes" Jul 08 19:09:33.206534 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:33.206489 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:33.303801 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:33.303760 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:33.700715 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:33.700687 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:45.729410 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:45.729371 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:45.826727 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:45.826689 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:52.756125 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:52.756078 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:52.841939 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:52.841905 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:52.892764 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:52.892731 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:53.260012 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:53.259982 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:56.591077 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:56.591046 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:56.690971 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:09:56.690880 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:01.603250 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:01.603217 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:01.705447 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:01.705415 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:04.966669 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:04.966639 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:05.015483 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:05.015451 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:23.366327 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:23.366296 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:26.623550 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:26.623513 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:26.722234 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:26.722203 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:27.161020 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.160991 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:27.273774 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.273744 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:27.427308 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.427215 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:27.613131 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.613096 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:27.711146 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.711061 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:27.793507 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.793472 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-vgxqr"] Jul 08 19:10:27.793804 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.793790 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69d966a-abe6-40c3-8386-98483666e320" containerName="authorino" Jul 08 19:10:27.793844 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.793805 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69d966a-abe6-40c3-8386-98483666e320" containerName="authorino" Jul 08 19:10:27.793877 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.793859 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69d966a-abe6-40c3-8386-98483666e320" containerName="authorino" Jul 08 19:10:27.797416 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.797394 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" Jul 08 19:10:27.800289 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.800247 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hp9lv\"" Jul 08 19:10:27.801039 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.801017 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 08 19:10:27.807092 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.807069 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-vgxqr"] Jul 08 19:10:27.947928 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.947886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d44af44c-c368-4ef9-acf5-8b53fc97bd5f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-vgxqr\" (UID: \"d44af44c-c368-4ef9-acf5-8b53fc97bd5f\") " pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" Jul 08 19:10:27.948063 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:27.947994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmwps\" (UniqueName: \"kubernetes.io/projected/d44af44c-c368-4ef9-acf5-8b53fc97bd5f-kube-api-access-xmwps\") pod \"payload-pre-processing-7964457696-vgxqr\" (UID: \"d44af44c-c368-4ef9-acf5-8b53fc97bd5f\") " pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" Jul 08 19:10:28.049064 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:28.049035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d44af44c-c368-4ef9-acf5-8b53fc97bd5f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-vgxqr\" (UID: \"d44af44c-c368-4ef9-acf5-8b53fc97bd5f\") " pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" Jul 08 19:10:28.049208 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:28.049084 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmwps\" (UniqueName: \"kubernetes.io/projected/d44af44c-c368-4ef9-acf5-8b53fc97bd5f-kube-api-access-xmwps\") pod \"payload-pre-processing-7964457696-vgxqr\" (UID: \"d44af44c-c368-4ef9-acf5-8b53fc97bd5f\") " pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" Jul 08 19:10:28.049824 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:28.049803 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d44af44c-c368-4ef9-acf5-8b53fc97bd5f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-vgxqr\" (UID: \"d44af44c-c368-4ef9-acf5-8b53fc97bd5f\") " pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" Jul 08 19:10:28.057555 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:28.057531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmwps\" (UniqueName: \"kubernetes.io/projected/d44af44c-c368-4ef9-acf5-8b53fc97bd5f-kube-api-access-xmwps\") pod \"payload-pre-processing-7964457696-vgxqr\" (UID: \"d44af44c-c368-4ef9-acf5-8b53fc97bd5f\") " pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" Jul 08 19:10:28.108400 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:28.108364 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" Jul 08 19:10:28.235621 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:28.235597 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-vgxqr"] Jul 08 19:10:28.237992 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:10:28.237953 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44af44c_c368_4ef9_acf5_8b53fc97bd5f.slice/crio-0b6433ad233e63a279ef4beea99a36fb66513f446925435ae2105ed1c05f7a7b WatchSource:0}: Error finding container 0b6433ad233e63a279ef4beea99a36fb66513f446925435ae2105ed1c05f7a7b: Status 404 returned error can't find the container with id 0b6433ad233e63a279ef4beea99a36fb66513f446925435ae2105ed1c05f7a7b Jul 08 19:10:28.987061 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:28.987030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" event={"ID":"d44af44c-c368-4ef9-acf5-8b53fc97bd5f","Type":"ContainerStarted","Data":"0b6433ad233e63a279ef4beea99a36fb66513f446925435ae2105ed1c05f7a7b"} Jul 08 19:10:30.998510 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:30.998465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" event={"ID":"d44af44c-c368-4ef9-acf5-8b53fc97bd5f","Type":"ContainerStarted","Data":"283eed1407a0f923e327de80f48144a819a84695436d0e81a7fc9d98577fd088"} Jul 08 19:10:30.999282 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:30.999236 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" Jul 08 19:10:31.017201 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:31.017134 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" podStartSLOduration=2.191266447 podStartE2EDuration="4.017111897s" totalImagesPullingTime="1.82584545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:10:31.014561063 +0000 UTC m=+556.620474135" watchObservedRunningTime="2026-07-08 19:10:31.017111897 +0000 UTC m=+556.623024970" Jul 08 19:10:36.021252 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:36.021218 2577 generic.go:356] "Generic (PLEG): container finished" podID="ce1676c4-ad5f-40c1-995c-2780154a68a7" containerID="4d8297ab784a7e2510c3bb3cefaaf3d1cf3a267e0040064c6aea78a87958aa70" exitCode=0 Jul 08 19:10:36.021681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:36.021291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" event={"ID":"ce1676c4-ad5f-40c1-995c-2780154a68a7","Type":"ContainerDied","Data":"4d8297ab784a7e2510c3bb3cefaaf3d1cf3a267e0040064c6aea78a87958aa70"} Jul 08 19:10:36.021681 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:36.021634 2577 scope.go:117] "RemoveContainer" containerID="4d8297ab784a7e2510c3bb3cefaaf3d1cf3a267e0040064c6aea78a87958aa70" Jul 08 19:10:36.022567 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:36.022536 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:10:36.022685 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:36.022617 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:10:36.022685 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:36.022659 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:10:37.026831 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:37.026801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" event={"ID":"ce1676c4-ad5f-40c1-995c-2780154a68a7","Type":"ContainerStarted","Data":"0da639b347c0eb2f0db94af7839df818d89865b838d90f0abaf91be45d99c991"} Jul 08 19:10:37.746718 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:37.746681 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:37.761612 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:37.761588 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:10:37.761817 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:37.761800 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-45cbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 08 19:10:37.761900 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:37.761841 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" podUID="ce1676c4-ad5f-40c1-995c-2780154a68a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 08 19:10:37.844386 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:37.844355 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:38.761342 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:38.761307 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-45cbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 08 19:10:38.761803 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:38.761370 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" podUID="ce1676c4-ad5f-40c1-995c-2780154a68a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 08 19:10:39.761757 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:39.761722 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-45cbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 08 19:10:39.762124 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:39.761781 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" podUID="ce1676c4-ad5f-40c1-995c-2780154a68a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 08 19:10:40.761459 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:40.761422 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-45cbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 08 19:10:40.761630 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:40.761481 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" podUID="ce1676c4-ad5f-40c1-995c-2780154a68a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 08 19:10:41.765138 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:41.765108 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:10:41.765524 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:41.765379 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:10:41.765986 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:41.765967 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-45cbk" Jul 08 19:10:43.011202 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:43.011178 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-vgxqr" Jul 08 19:10:47.480769 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:47.480732 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:51.165437 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:10:51.165404 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:01.054440 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.054407 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd"] Jul 08 19:11:01.058110 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.058087 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.060611 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.060584 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 19:11:01.060735 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.060584 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-r6kqj\"" Jul 08 19:11:01.061808 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.061787 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 19:11:01.061921 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.061789 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 19:11:01.067159 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.067136 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd"] Jul 08 19:11:01.084631 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.084607 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:01.149644 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.149615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01e198c3-c4a8-4327-a20b-c51f368ffb78-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.149644 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.149651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01e198c3-c4a8-4327-a20b-c51f368ffb78-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.149887 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.149668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01e198c3-c4a8-4327-a20b-c51f368ffb78-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.149887 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.149688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dcr\" (UniqueName: \"kubernetes.io/projected/01e198c3-c4a8-4327-a20b-c51f368ffb78-kube-api-access-w7dcr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.149887 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.149750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01e198c3-c4a8-4327-a20b-c51f368ffb78-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.149887 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.149819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01e198c3-c4a8-4327-a20b-c51f368ffb78-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.250393 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.250352 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01e198c3-c4a8-4327-a20b-c51f368ffb78-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.250393 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.250398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01e198c3-c4a8-4327-a20b-c51f368ffb78-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.250629 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.250416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01e198c3-c4a8-4327-a20b-c51f368ffb78-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.250629 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.250434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dcr\" (UniqueName: \"kubernetes.io/projected/01e198c3-c4a8-4327-a20b-c51f368ffb78-kube-api-access-w7dcr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.250629 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.250451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01e198c3-c4a8-4327-a20b-c51f368ffb78-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.250629 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.250481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01e198c3-c4a8-4327-a20b-c51f368ffb78-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.250848 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.250822 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01e198c3-c4a8-4327-a20b-c51f368ffb78-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.250904 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.250888 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01e198c3-c4a8-4327-a20b-c51f368ffb78-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.250940 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.250918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01e198c3-c4a8-4327-a20b-c51f368ffb78-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.252924 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.252905 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01e198c3-c4a8-4327-a20b-c51f368ffb78-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.253076 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.253060 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01e198c3-c4a8-4327-a20b-c51f368ffb78-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.259678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.259658 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dcr\" (UniqueName: \"kubernetes.io/projected/01e198c3-c4a8-4327-a20b-c51f368ffb78-kube-api-access-w7dcr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bq7gd\" (UID: \"01e198c3-c4a8-4327-a20b-c51f368ffb78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.370362 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.370275 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:01.501197 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:01.501172 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd"] Jul 08 19:11:01.503752 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:11:01.503726 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e198c3_c4a8_4327_a20b_c51f368ffb78.slice/crio-642d576f4b06fd2a19e46647ca0783c4a3ec2244b636ddc1df75b8958cbe05b5 WatchSource:0}: Error finding container 642d576f4b06fd2a19e46647ca0783c4a3ec2244b636ddc1df75b8958cbe05b5: Status 404 returned error can't find the container with id 642d576f4b06fd2a19e46647ca0783c4a3ec2244b636ddc1df75b8958cbe05b5 Jul 08 19:11:02.140303 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:02.140244 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" event={"ID":"01e198c3-c4a8-4327-a20b-c51f368ffb78","Type":"ContainerStarted","Data":"642d576f4b06fd2a19e46647ca0783c4a3ec2244b636ddc1df75b8958cbe05b5"} Jul 08 19:11:02.661414 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:02.661384 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:02.762643 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:02.762608 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:03.145077 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:03.145045 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" event={"ID":"01e198c3-c4a8-4327-a20b-c51f368ffb78","Type":"ContainerStarted","Data":"bc4563efabd4adf9aa6e597e1c0f5ad9d8c73e835beaf0ad78cde4ce63d9dff5"} Jul 08 19:11:03.164631 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:03.164573 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" podStartSLOduration=0.980714508 podStartE2EDuration="2.16455741s" totalImagesPullingTime="1.183842902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:11:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:11:03.163457255 +0000 UTC m=+588.769370326" watchObservedRunningTime="2026-07-08 19:11:03.16455741 +0000 UTC m=+588.770470528" Jul 08 19:11:06.939971 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:06.939942 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l"] Jul 08 19:11:06.943410 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:06.943389 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:06.946117 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:06.946098 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 08 19:11:06.953186 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:06.953164 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l"] Jul 08 19:11:06.982557 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:06.982526 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:07.004318 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.004278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08036fd6-ed30-49ac-89ae-7a8193dc58dc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.004503 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.004338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b2rp\" (UniqueName: \"kubernetes.io/projected/08036fd6-ed30-49ac-89ae-7a8193dc58dc-kube-api-access-2b2rp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.004503 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.004366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08036fd6-ed30-49ac-89ae-7a8193dc58dc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.004503 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.004426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08036fd6-ed30-49ac-89ae-7a8193dc58dc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.004503 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.004486 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08036fd6-ed30-49ac-89ae-7a8193dc58dc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.004702 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.004513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08036fd6-ed30-49ac-89ae-7a8193dc58dc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.105300 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.105233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08036fd6-ed30-49ac-89ae-7a8193dc58dc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.105479 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.105323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b2rp\" (UniqueName: \"kubernetes.io/projected/08036fd6-ed30-49ac-89ae-7a8193dc58dc-kube-api-access-2b2rp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.105479 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.105344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08036fd6-ed30-49ac-89ae-7a8193dc58dc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.105479 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.105377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08036fd6-ed30-49ac-89ae-7a8193dc58dc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.105479 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.105403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08036fd6-ed30-49ac-89ae-7a8193dc58dc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.105479 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.105433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08036fd6-ed30-49ac-89ae-7a8193dc58dc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.106354 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.106327 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08036fd6-ed30-49ac-89ae-7a8193dc58dc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.106693 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.106362 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08036fd6-ed30-49ac-89ae-7a8193dc58dc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.106829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.106707 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08036fd6-ed30-49ac-89ae-7a8193dc58dc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.108510 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.108481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08036fd6-ed30-49ac-89ae-7a8193dc58dc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.108646 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.108627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08036fd6-ed30-49ac-89ae-7a8193dc58dc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.114909 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.114867 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b2rp\" (UniqueName: \"kubernetes.io/projected/08036fd6-ed30-49ac-89ae-7a8193dc58dc-kube-api-access-2b2rp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w4j2l\" (UID: \"08036fd6-ed30-49ac-89ae-7a8193dc58dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.254283 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.254170 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:07.386793 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:07.386768 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l"] Jul 08 19:11:07.389111 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:11:07.389083 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08036fd6_ed30_49ac_89ae_7a8193dc58dc.slice/crio-dd33f8d3a162b4365da02650eba3355f31a892506a3799ea51797fb39d2c81fb WatchSource:0}: Error finding container dd33f8d3a162b4365da02650eba3355f31a892506a3799ea51797fb39d2c81fb: Status 404 returned error can't find the container with id dd33f8d3a162b4365da02650eba3355f31a892506a3799ea51797fb39d2c81fb Jul 08 19:11:08.167562 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:08.167528 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" event={"ID":"08036fd6-ed30-49ac-89ae-7a8193dc58dc","Type":"ContainerStarted","Data":"7638bb61706cefe8fe6d8657c5feded5955c44cadfe0eb9365b079ae8cf930fe"} Jul 08 19:11:08.167956 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:08.167583 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" event={"ID":"08036fd6-ed30-49ac-89ae-7a8193dc58dc","Type":"ContainerStarted","Data":"dd33f8d3a162b4365da02650eba3355f31a892506a3799ea51797fb39d2c81fb"} Jul 08 19:11:08.187116 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:08.187062 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" podStartSLOduration=1.929891713 podStartE2EDuration="2.187045709s" totalImagesPullingTime="257.153996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:11:08.185752873 +0000 UTC m=+593.791665945" watchObservedRunningTime="2026-07-08 19:11:08.187045709 +0000 UTC m=+593.792958780" Jul 08 19:11:09.768967 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:09.768912 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:11.370578 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:11.370549 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:11.370948 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:11.370882 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:11.382875 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:11.382843 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:12.196254 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:12.196221 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bq7gd" Jul 08 19:11:17.255087 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:17.255045 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:17.255619 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:17.255155 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:17.267199 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:17.267180 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:17.584468 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:17.584435 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:18.225825 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:18.225800 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w4j2l" Jul 08 19:11:29.974626 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:11:29.974586 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:02.061533 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.061490 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-574447f8b8-6wxcb"] Jul 08 19:13:02.065020 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.064996 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574447f8b8-6wxcb" Jul 08 19:13:02.068620 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.068593 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 19:13:02.068620 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.068610 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rswsd\"" Jul 08 19:13:02.072738 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.072717 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574447f8b8-6wxcb"] Jul 08 19:13:02.234860 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.234830 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgz2w\" (UniqueName: \"kubernetes.io/projected/1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8-kube-api-access-kgz2w\") pod \"authorino-574447f8b8-6wxcb\" (UID: \"1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8\") " pod="kuadrant-system/authorino-574447f8b8-6wxcb" Jul 08 19:13:02.235042 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.234893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8-tls-cert\") pod \"authorino-574447f8b8-6wxcb\" (UID: \"1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8\") " pod="kuadrant-system/authorino-574447f8b8-6wxcb" Jul 08 19:13:02.335675 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.335587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8-tls-cert\") pod \"authorino-574447f8b8-6wxcb\" (UID: \"1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8\") " pod="kuadrant-system/authorino-574447f8b8-6wxcb" Jul 08 19:13:02.335820 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.335678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgz2w\" (UniqueName: \"kubernetes.io/projected/1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8-kube-api-access-kgz2w\") pod \"authorino-574447f8b8-6wxcb\" (UID: \"1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8\") " pod="kuadrant-system/authorino-574447f8b8-6wxcb" Jul 08 19:13:02.338121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.338098 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8-tls-cert\") pod \"authorino-574447f8b8-6wxcb\" (UID: \"1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8\") " pod="kuadrant-system/authorino-574447f8b8-6wxcb" Jul 08 19:13:02.345031 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.345007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgz2w\" (UniqueName: \"kubernetes.io/projected/1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8-kube-api-access-kgz2w\") pod \"authorino-574447f8b8-6wxcb\" (UID: \"1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8\") " pod="kuadrant-system/authorino-574447f8b8-6wxcb" Jul 08 19:13:02.374845 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.374814 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574447f8b8-6wxcb" Jul 08 19:13:02.433185 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.433151 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:02.515373 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.515352 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574447f8b8-6wxcb"] Jul 08 19:13:02.517996 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:13:02.517964 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d1a6ea6_17bd_4943_ba91_3c6aaba4d3d8.slice/crio-9505b9911d16ea8da1f103b3cd37208c211eaad9302f2345b3bf40d89e338a15 WatchSource:0}: Error finding container 9505b9911d16ea8da1f103b3cd37208c211eaad9302f2345b3bf40d89e338a15: Status 404 returned error can't find the container with id 9505b9911d16ea8da1f103b3cd37208c211eaad9302f2345b3bf40d89e338a15 Jul 08 19:13:02.518539 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.518518 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:02.519443 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.519428 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:13:02.652365 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:02.652279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574447f8b8-6wxcb" event={"ID":"1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8","Type":"ContainerStarted","Data":"9505b9911d16ea8da1f103b3cd37208c211eaad9302f2345b3bf40d89e338a15"} Jul 08 19:13:03.597621 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:03.597540 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:03.658642 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:03.658605 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574447f8b8-6wxcb" event={"ID":"1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8","Type":"ContainerStarted","Data":"0053ef2c6a40dda5f9a4db47c48c6e4bc4f0da9a590f3e6f3c0ae2e3e0bb0ad7"} Jul 08 19:13:03.683194 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:03.683143 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-574447f8b8-6wxcb" podStartSLOduration=1.208792177 podStartE2EDuration="1.683126965s" totalImagesPullingTime="474.334788ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:13:03.682312813 +0000 UTC m=+709.288225886" watchObservedRunningTime="2026-07-08 19:13:03.683126965 +0000 UTC m=+709.289040036" Jul 08 19:13:03.690868 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:03.690834 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:58.933362 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:58.933303 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:59.033781 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:13:59.033750 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:02.792252 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:14:02.792214 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:02.845388 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:14:02.845353 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:14.464736 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:14:14.464698 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:15.914817 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:14:15.914748 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:00.876275 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:15:00.876179 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:00.977510 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:15:00.977478 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:01.181764 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:15:01.181641 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:07.215113 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:15:07.215076 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:07.319726 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:15:07.319693 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:07.419154 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:15:07.419120 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:07.595768 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:15:07.595703 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:13.635936 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:15:13.635901 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:13.733856 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:15:13.733817 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:38.094046 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:15:38.094011 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:38.193213 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:15:38.193178 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:08.484167 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:16:08.484053 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:58.024907 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:17:58.024830 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:58.248972 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:17:58.248937 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:07.726155 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:19:07.726067 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:24:42.133050 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:24:42.133012 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:25:08.127770 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:25:08.127676 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:25:18.598338 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:25:18.598298 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:25:32.918349 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:25:32.918306 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:25:33.019228 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:25:33.019197 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:03.393252 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:03.393216 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:08.201685 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:08.201646 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:16.481572 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:16.481537 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:21.602405 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:21.602371 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:24.618492 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:24.618459 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:24.718339 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:24.718303 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:25.095658 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:25.095629 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:31.365211 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.365181 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:31.424037 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.424001 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:31.563094 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.563060 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm"] Jul 08 19:26:31.566893 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.566872 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.569984 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.569959 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-16aad909-openshift-default-dockercfg-bwbch\"" Jul 08 19:26:31.592715 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.592685 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm"] Jul 08 19:26:31.593235 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.593211 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:31.687176 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.687093 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:31.737174 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.737132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-data\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.737174 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.737175 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-envoy\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.737413 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.737203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-workload-certs\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.737413 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.737296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-podinfo\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.737413 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.737327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-workload-socket\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.737413 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.737390 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-credential-socket\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.737565 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.737433 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-token\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.737565 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.737454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61e90396-8c3a-49a0-b0da-b380b08e467b-istiod-ca-cert\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.737565 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.737480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxkzj\" (UniqueName: \"kubernetes.io/projected/61e90396-8c3a-49a0-b0da-b380b08e467b-kube-api-access-sxkzj\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.837962 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.837927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-token\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.837962 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.837959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61e90396-8c3a-49a0-b0da-b380b08e467b-istiod-ca-cert\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.838191 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.837986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxkzj\" (UniqueName: \"kubernetes.io/projected/61e90396-8c3a-49a0-b0da-b380b08e467b-kube-api-access-sxkzj\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.838191 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.838029 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-data\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.838191 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.838060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-envoy\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.838191 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.838100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-workload-certs\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.838191 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.838132 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-podinfo\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.838191 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.838163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-workload-socket\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.838515 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.838214 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-credential-socket\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.838515 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.838474 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-data\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.838610 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.838544 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-workload-certs\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.838691 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.838664 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-credential-socket\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.838743 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.838686 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-workload-socket\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.838809 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.838792 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61e90396-8c3a-49a0-b0da-b380b08e467b-istiod-ca-cert\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.840636 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.840614 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-envoy\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.840749 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.840719 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-podinfo\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.849416 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.849390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-token\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.849521 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.849500 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxkzj\" (UniqueName: \"kubernetes.io/projected/61e90396-8c3a-49a0-b0da-b380b08e467b-kube-api-access-sxkzj\") pod \"e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:31.877449 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:31.877417 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:32.016635 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:32.016606 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm"] Jul 08 19:26:32.018433 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:26:32.018403 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e90396_8c3a_49a0_b0da_b380b08e467b.slice/crio-2de689bac62353a8212ee4939598e949a928ba77e92af604e8a5876dbcab20bd WatchSource:0}: Error finding container 2de689bac62353a8212ee4939598e949a928ba77e92af604e8a5876dbcab20bd: Status 404 returned error can't find the container with id 2de689bac62353a8212ee4939598e949a928ba77e92af604e8a5876dbcab20bd Jul 08 19:26:32.020635 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:32.020600 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:26:32.020739 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:32.020677 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:26:32.020739 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:32.020727 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:26:32.224851 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:32.224762 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" event={"ID":"61e90396-8c3a-49a0-b0da-b380b08e467b","Type":"ContainerStarted","Data":"83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf"} Jul 08 19:26:32.224851 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:32.224810 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" event={"ID":"61e90396-8c3a-49a0-b0da-b380b08e467b","Type":"ContainerStarted","Data":"2de689bac62353a8212ee4939598e949a928ba77e92af604e8a5876dbcab20bd"} Jul 08 19:26:32.249800 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:32.249738 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" podStartSLOduration=1.249718727 podStartE2EDuration="1.249718727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:26:32.248337899 +0000 UTC m=+1517.854250972" watchObservedRunningTime="2026-07-08 19:26:32.249718727 +0000 UTC m=+1517.855631800" Jul 08 19:26:32.877721 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:32.877684 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:32.997522 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:32.997493 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:33.097977 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:33.097945 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:33.225643 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:33.225563 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:33.351232 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:33.351200 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:33.451629 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:33.451593 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:33.882760 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:33.882731 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:34.232983 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:34.232899 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:34.233922 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:34.233906 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:35.961736 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:35.961698 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:26:44.276276 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:44.276222 2577 generic.go:356] "Generic (PLEG): container finished" podID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerID="83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf" exitCode=0 Jul 08 19:26:44.276796 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:44.276299 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" event={"ID":"61e90396-8c3a-49a0-b0da-b380b08e467b","Type":"ContainerDied","Data":"83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf"} Jul 08 19:26:44.276864 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:44.276798 2577 scope.go:117] "RemoveContainer" containerID="83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf" Jul 08 19:26:44.277992 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:44.277962 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:26:44.278066 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:44.278049 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:26:44.278107 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:44.278098 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:26:45.282157 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:45.282122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" event={"ID":"61e90396-8c3a-49a0-b0da-b380b08e467b","Type":"ContainerStarted","Data":"26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283"} Jul 08 19:26:45.877620 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:45.877589 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:45.878625 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:45.878598 2577 patch_prober.go:28] interesting pod/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 08 19:26:45.878746 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:45.878650 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" podUID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 08 19:26:46.878515 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:46.878477 2577 patch_prober.go:28] interesting pod/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 08 19:26:46.878904 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:46.878559 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" podUID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 08 19:26:47.878749 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:47.878712 2577 patch_prober.go:28] interesting pod/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 08 19:26:47.879159 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:47.878784 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" podUID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 08 19:26:48.878687 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:48.878647 2577 patch_prober.go:28] interesting pod/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 08 19:26:48.878868 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:48.878728 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" podUID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 08 19:26:49.233585 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:49.233493 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:49.882299 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:49.882244 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:26:49.883219 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:26:49.883197 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:27:37.957205 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:37.957162 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm"] Jul 08 19:27:37.957813 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:37.957442 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" podUID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerName="istio-proxy" containerID="cri-o://26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283" gracePeriod=30 Jul 08 19:27:37.980345 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:37.980318 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:27:38.090814 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:38.090780 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:27:43.214824 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.214792 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:27:43.293275 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293227 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-workload-socket\") pod \"61e90396-8c3a-49a0-b0da-b380b08e467b\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " Jul 08 19:27:43.293468 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293346 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-podinfo\") pod \"61e90396-8c3a-49a0-b0da-b380b08e467b\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " Jul 08 19:27:43.293468 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293388 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-workload-certs\") pod \"61e90396-8c3a-49a0-b0da-b380b08e467b\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " Jul 08 19:27:43.293468 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293444 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-credential-socket\") pod \"61e90396-8c3a-49a0-b0da-b380b08e467b\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " Jul 08 19:27:43.293626 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293477 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-data\") pod \"61e90396-8c3a-49a0-b0da-b380b08e467b\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " Jul 08 19:27:43.293626 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293501 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-envoy\") pod \"61e90396-8c3a-49a0-b0da-b380b08e467b\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " Jul 08 19:27:43.293626 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293525 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxkzj\" (UniqueName: \"kubernetes.io/projected/61e90396-8c3a-49a0-b0da-b380b08e467b-kube-api-access-sxkzj\") pod \"61e90396-8c3a-49a0-b0da-b380b08e467b\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " Jul 08 19:27:43.293626 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293557 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-token\") pod \"61e90396-8c3a-49a0-b0da-b380b08e467b\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " Jul 08 19:27:43.293626 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293582 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61e90396-8c3a-49a0-b0da-b380b08e467b-istiod-ca-cert\") pod \"61e90396-8c3a-49a0-b0da-b380b08e467b\" (UID: \"61e90396-8c3a-49a0-b0da-b380b08e467b\") " Jul 08 19:27:43.293848 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293724 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "61e90396-8c3a-49a0-b0da-b380b08e467b" (UID: "61e90396-8c3a-49a0-b0da-b380b08e467b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:27:43.293848 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293730 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "61e90396-8c3a-49a0-b0da-b380b08e467b" (UID: "61e90396-8c3a-49a0-b0da-b380b08e467b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:27:43.293949 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293915 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-workload-certs\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:27:43.293949 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.293933 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-credential-socket\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:27:43.294048 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.294004 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "61e90396-8c3a-49a0-b0da-b380b08e467b" (UID: "61e90396-8c3a-49a0-b0da-b380b08e467b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:27:43.294301 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.294251 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61e90396-8c3a-49a0-b0da-b380b08e467b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "61e90396-8c3a-49a0-b0da-b380b08e467b" (UID: "61e90396-8c3a-49a0-b0da-b380b08e467b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:27:43.294693 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.294670 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-data" (OuterVolumeSpecName: "istio-data") pod "61e90396-8c3a-49a0-b0da-b380b08e467b" (UID: "61e90396-8c3a-49a0-b0da-b380b08e467b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:27:43.296036 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.295990 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "61e90396-8c3a-49a0-b0da-b380b08e467b" (UID: "61e90396-8c3a-49a0-b0da-b380b08e467b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 19:27:43.296514 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.296487 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-token" (OuterVolumeSpecName: "istio-token") pod "61e90396-8c3a-49a0-b0da-b380b08e467b" (UID: "61e90396-8c3a-49a0-b0da-b380b08e467b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:27:43.296514 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.296488 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "61e90396-8c3a-49a0-b0da-b380b08e467b" (UID: "61e90396-8c3a-49a0-b0da-b380b08e467b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:27:43.296636 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.296563 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61e90396-8c3a-49a0-b0da-b380b08e467b-kube-api-access-sxkzj" (OuterVolumeSpecName: "kube-api-access-sxkzj") pod "61e90396-8c3a-49a0-b0da-b380b08e467b" (UID: "61e90396-8c3a-49a0-b0da-b380b08e467b"). InnerVolumeSpecName "kube-api-access-sxkzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:27:43.394877 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.394849 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-podinfo\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:27:43.394877 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.394874 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-data\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:27:43.394877 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.394882 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-envoy\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:27:43.395092 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.394891 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxkzj\" (UniqueName: \"kubernetes.io/projected/61e90396-8c3a-49a0-b0da-b380b08e467b-kube-api-access-sxkzj\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:27:43.395092 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.394900 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61e90396-8c3a-49a0-b0da-b380b08e467b-istio-token\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:27:43.395092 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.394908 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61e90396-8c3a-49a0-b0da-b380b08e467b-istiod-ca-cert\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:27:43.395092 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.394915 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61e90396-8c3a-49a0-b0da-b380b08e467b-workload-socket\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:27:43.552379 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.552347 2577 generic.go:356] "Generic (PLEG): container finished" podID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerID="26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283" exitCode=0 Jul 08 19:27:43.552585 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.552397 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" Jul 08 19:27:43.552585 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.552436 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" event={"ID":"61e90396-8c3a-49a0-b0da-b380b08e467b","Type":"ContainerDied","Data":"26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283"} Jul 08 19:27:43.552585 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.552501 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm" event={"ID":"61e90396-8c3a-49a0-b0da-b380b08e467b","Type":"ContainerDied","Data":"2de689bac62353a8212ee4939598e949a928ba77e92af604e8a5876dbcab20bd"} Jul 08 19:27:43.552585 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.552540 2577 scope.go:117] "RemoveContainer" containerID="26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283" Jul 08 19:27:43.561968 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.561949 2577 scope.go:117] "RemoveContainer" containerID="83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf" Jul 08 19:27:43.570046 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.570023 2577 scope.go:117] "RemoveContainer" containerID="26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283" Jul 08 19:27:43.570325 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:27:43.570308 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283\": container with ID starting with 26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283 not found: ID does not exist" containerID="26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283" Jul 08 19:27:43.570388 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.570333 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283"} err="failed to get container status \"26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283\": rpc error: code = NotFound desc = could not find container \"26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283\": container with ID starting with 26ced7bb642a59471bccae7f499088cca0ccd43239dc0dbac15482cf25fd3283 not found: ID does not exist" Jul 08 19:27:43.570388 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.570350 2577 scope.go:117] "RemoveContainer" containerID="83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf" Jul 08 19:27:43.570546 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:27:43.570528 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf\": container with ID starting with 83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf not found: ID does not exist" containerID="83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf" Jul 08 19:27:43.570586 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.570550 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf"} err="failed to get container status \"83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf\": rpc error: code = NotFound desc = could not find container \"83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf\": container with ID starting with 83cadeb12043cf8cbbd847165dd7b81d1efb705730a410634ae3699c91671bcf not found: ID does not exist" Jul 08 19:27:43.575296 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.574305 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm"] Jul 08 19:27:43.582038 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:43.582013 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-16aad909-openshift-default-74c5bb984f-g9ksm"] Jul 08 19:27:44.308090 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:44.308053 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:27:44.364068 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:44.364038 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:27:44.547653 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:44.547569 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:27:44.787368 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:44.787337 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61e90396-8c3a-49a0-b0da-b380b08e467b" path="/var/lib/kubelet/pods/61e90396-8c3a-49a0-b0da-b380b08e467b/volumes" Jul 08 19:27:50.227577 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.227527 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:27:50.281679 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.281646 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:27:50.418168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.418088 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8"] Jul 08 19:27:50.418624 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.418601 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerName="istio-proxy" Jul 08 19:27:50.418748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.418704 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerName="istio-proxy" Jul 08 19:27:50.418748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.418727 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerName="istio-proxy" Jul 08 19:27:50.418748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.418749 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerName="istio-proxy" Jul 08 19:27:50.418903 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.418859 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerName="istio-proxy" Jul 08 19:27:50.418903 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.418875 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e90396-8c3a-49a0-b0da-b380b08e467b" containerName="istio-proxy" Jul 08 19:27:50.422193 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.422173 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.424789 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.424768 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-693d5a39-openshift-default-dockercfg-mhtmp\"" Jul 08 19:27:50.436231 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.436209 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8"] Jul 08 19:27:50.456562 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.456517 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:27:50.556225 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.556192 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:27:50.560486 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.560462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-credential-socket\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.560596 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.560499 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh6cv\" (UniqueName: \"kubernetes.io/projected/a1327bef-b4d7-4e39-bb63-adc13c915ce7-kube-api-access-zh6cv\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.560596 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.560527 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-workload-certs\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.560596 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.560559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-token\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.560748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.560659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-data\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.560748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.560700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-envoy\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.560850 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.560765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istiod-ca-cert\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.560850 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.560834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-workload-socket\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.560943 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.560858 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-podinfo\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.661985 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.661952 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-credential-socket\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.661985 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.661993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh6cv\" (UniqueName: \"kubernetes.io/projected/a1327bef-b4d7-4e39-bb63-adc13c915ce7-kube-api-access-zh6cv\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.662216 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.662018 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-workload-certs\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.662216 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.662035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-token\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.662216 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.662065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-data\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.662216 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.662092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-envoy\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.662216 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.662133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istiod-ca-cert\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.662216 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.662195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-workload-socket\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.662216 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.662215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-podinfo\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.662627 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.662474 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-credential-socket\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.662627 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.662518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-data\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.662627 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.662573 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-workload-socket\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.662729 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.662631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-workload-certs\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.662942 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.662909 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istiod-ca-cert\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.664588 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.664559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-envoy\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.664971 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.664948 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-podinfo\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.672029 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.671999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-token\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.673026 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.673008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh6cv\" (UniqueName: \"kubernetes.io/projected/a1327bef-b4d7-4e39-bb63-adc13c915ce7-kube-api-access-zh6cv\") pod \"e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.733523 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.733483 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:50.881829 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.881756 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8"] Jul 08 19:27:50.884225 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:27:50.884192 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1327bef_b4d7_4e39_bb63_adc13c915ce7.slice/crio-24d66e0ed05a82071398cfea7119a604f7afe7038d636720cd45dc6f370b10a2 WatchSource:0}: Error finding container 24d66e0ed05a82071398cfea7119a604f7afe7038d636720cd45dc6f370b10a2: Status 404 returned error can't find the container with id 24d66e0ed05a82071398cfea7119a604f7afe7038d636720cd45dc6f370b10a2 Jul 08 19:27:50.886297 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.886240 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:27:50.886382 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.886333 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:27:50.886382 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:50.886360 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:27:51.592515 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:51.592465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" event={"ID":"a1327bef-b4d7-4e39-bb63-adc13c915ce7","Type":"ContainerStarted","Data":"a6a84970e3cac923fc8fa6d24f87a88fe6b8ecfdc4bee3f0024a59ada5cb6706"} Jul 08 19:27:51.592515 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:51.592523 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" event={"ID":"a1327bef-b4d7-4e39-bb63-adc13c915ce7","Type":"ContainerStarted","Data":"24d66e0ed05a82071398cfea7119a604f7afe7038d636720cd45dc6f370b10a2"} Jul 08 19:27:51.614923 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:51.614838 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" podStartSLOduration=1.6148201530000001 podStartE2EDuration="1.614820153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:27:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:27:51.613449235 +0000 UTC m=+1597.219362307" watchObservedRunningTime="2026-07-08 19:27:51.614820153 +0000 UTC m=+1597.220733226" Jul 08 19:27:51.734220 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:51.734184 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:51.739086 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:51.739062 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:52.596914 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:52.596885 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:52.598054 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:52.598037 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:27:53.641957 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:27:53.641927 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:29:38.283319 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:29:38.283185 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:29:38.368304 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:29:38.368227 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:30:55.231204 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.231161 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8"] Jul 08 19:30:55.231740 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.231409 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" podUID="a1327bef-b4d7-4e39-bb63-adc13c915ce7" containerName="istio-proxy" containerID="cri-o://a6a84970e3cac923fc8fa6d24f87a88fe6b8ecfdc4bee3f0024a59ada5cb6706" gracePeriod=30 Jul 08 19:30:55.266217 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.266187 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:30:55.627496 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.627466 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw"] Jul 08 19:30:55.630894 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.630872 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.633905 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.633878 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-3e4bf33f-openshift-default-dockercfg-9t94p\"" Jul 08 19:30:55.645119 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.645093 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw"] Jul 08 19:30:55.703307 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.703240 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-data\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.703307 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.703308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6hf4\" (UniqueName: \"kubernetes.io/projected/7ccb3232-369e-4254-8a16-aeadfbd03ae7-kube-api-access-x6hf4\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.703538 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.703376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-credential-socket\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.703538 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.703396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-workload-certs\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.703538 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.703425 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-envoy\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.703538 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.703453 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-podinfo\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.703538 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.703477 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-workload-socket\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.703538 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.703492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istiod-ca-cert\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.703538 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.703540 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-token\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804104 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-podinfo\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804342 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-workload-socket\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804342 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istiod-ca-cert\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804342 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-token\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804342 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-data\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804556 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6hf4\" (UniqueName: \"kubernetes.io/projected/7ccb3232-369e-4254-8a16-aeadfbd03ae7-kube-api-access-x6hf4\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804556 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-credential-socket\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804556 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-workload-certs\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804556 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-envoy\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804763 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804682 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-data\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804845 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804821 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-credential-socket\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804914 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-workload-certs\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.804976 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.804954 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-workload-socket\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.805114 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.805095 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istiod-ca-cert\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.806692 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.806675 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-envoy\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.806788 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.806772 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-podinfo\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.812984 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.812960 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-token\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.813065 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.813042 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6hf4\" (UniqueName: \"kubernetes.io/projected/7ccb3232-369e-4254-8a16-aeadfbd03ae7-kube-api-access-x6hf4\") pod \"e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:55.941855 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:55.941782 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:56.084179 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:56.084151 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw"] Jul 08 19:30:56.086386 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:30:56.086346 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ccb3232_369e_4254_8a16_aeadfbd03ae7.slice/crio-a59e39df513438f1ab2f373ad2d51c2f380e70bcd0bc167f812eb63c368edc13 WatchSource:0}: Error finding container a59e39df513438f1ab2f373ad2d51c2f380e70bcd0bc167f812eb63c368edc13: Status 404 returned error can't find the container with id a59e39df513438f1ab2f373ad2d51c2f380e70bcd0bc167f812eb63c368edc13 Jul 08 19:30:56.088645 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:56.088619 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:30:56.088713 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:56.088675 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:30:56.088713 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:56.088704 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:30:56.413698 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:56.413660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" event={"ID":"7ccb3232-369e-4254-8a16-aeadfbd03ae7","Type":"ContainerStarted","Data":"ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75"} Jul 08 19:30:56.414084 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:56.413741 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" event={"ID":"7ccb3232-369e-4254-8a16-aeadfbd03ae7","Type":"ContainerStarted","Data":"a59e39df513438f1ab2f373ad2d51c2f380e70bcd0bc167f812eb63c368edc13"} Jul 08 19:30:56.780328 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:56.780210 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:30:56.942386 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:56.942350 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:57.947339 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:57.947309 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:57.969174 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:57.969119 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" podStartSLOduration=2.969101429 podStartE2EDuration="2.969101429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:30:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:30:56.451940092 +0000 UTC m=+1782.057853165" watchObservedRunningTime="2026-07-08 19:30:57.969101429 +0000 UTC m=+1783.575014558" Jul 08 19:30:58.422982 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:58.422948 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:30:58.424148 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:30:58.424132 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:31:00.433818 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.433788 2577 generic.go:356] "Generic (PLEG): container finished" podID="a1327bef-b4d7-4e39-bb63-adc13c915ce7" containerID="a6a84970e3cac923fc8fa6d24f87a88fe6b8ecfdc4bee3f0024a59ada5cb6706" exitCode=0 Jul 08 19:31:00.434181 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.433866 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" event={"ID":"a1327bef-b4d7-4e39-bb63-adc13c915ce7","Type":"ContainerDied","Data":"a6a84970e3cac923fc8fa6d24f87a88fe6b8ecfdc4bee3f0024a59ada5cb6706"} Jul 08 19:31:00.488089 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.488066 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:31:00.549930 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.549894 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh6cv\" (UniqueName: \"kubernetes.io/projected/a1327bef-b4d7-4e39-bb63-adc13c915ce7-kube-api-access-zh6cv\") pod \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " Jul 08 19:31:00.550077 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.549953 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-envoy\") pod \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " Jul 08 19:31:00.550077 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.549983 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-credential-socket\") pod \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " Jul 08 19:31:00.550077 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.550064 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-workload-socket\") pod \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " Jul 08 19:31:00.550230 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.550141 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-workload-certs\") pod \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " Jul 08 19:31:00.550230 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.550169 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-data\") pod \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " Jul 08 19:31:00.550230 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.550214 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istiod-ca-cert\") pod \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " Jul 08 19:31:00.550397 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.550243 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-token\") pod \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " Jul 08 19:31:00.550397 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.550288 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-podinfo\") pod \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\" (UID: \"a1327bef-b4d7-4e39-bb63-adc13c915ce7\") " Jul 08 19:31:00.550498 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.550381 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a1327bef-b4d7-4e39-bb63-adc13c915ce7" (UID: "a1327bef-b4d7-4e39-bb63-adc13c915ce7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:31:00.550498 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.550409 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a1327bef-b4d7-4e39-bb63-adc13c915ce7" (UID: "a1327bef-b4d7-4e39-bb63-adc13c915ce7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:31:00.550602 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.550566 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-data" (OuterVolumeSpecName: "istio-data") pod "a1327bef-b4d7-4e39-bb63-adc13c915ce7" (UID: "a1327bef-b4d7-4e39-bb63-adc13c915ce7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:31:00.550660 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.550618 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a1327bef-b4d7-4e39-bb63-adc13c915ce7" (UID: "a1327bef-b4d7-4e39-bb63-adc13c915ce7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:31:00.550939 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.550897 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a1327bef-b4d7-4e39-bb63-adc13c915ce7" (UID: "a1327bef-b4d7-4e39-bb63-adc13c915ce7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:31:00.551075 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.550989 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-credential-socket\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:31:00.551075 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.551007 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-workload-socket\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:31:00.551075 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.551022 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-workload-certs\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:31:00.551075 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.551037 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-data\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:31:00.551075 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.551067 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istiod-ca-cert\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:31:00.552985 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.552960 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a1327bef-b4d7-4e39-bb63-adc13c915ce7" (UID: "a1327bef-b4d7-4e39-bb63-adc13c915ce7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:31:00.553129 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.553107 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1327bef-b4d7-4e39-bb63-adc13c915ce7-kube-api-access-zh6cv" (OuterVolumeSpecName: "kube-api-access-zh6cv") pod "a1327bef-b4d7-4e39-bb63-adc13c915ce7" (UID: "a1327bef-b4d7-4e39-bb63-adc13c915ce7"). InnerVolumeSpecName "kube-api-access-zh6cv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:31:00.553209 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.553194 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a1327bef-b4d7-4e39-bb63-adc13c915ce7" (UID: "a1327bef-b4d7-4e39-bb63-adc13c915ce7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 19:31:00.553324 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.553310 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-token" (OuterVolumeSpecName: "istio-token") pod "a1327bef-b4d7-4e39-bb63-adc13c915ce7" (UID: "a1327bef-b4d7-4e39-bb63-adc13c915ce7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:31:00.652106 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.652057 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-token\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:31:00.652106 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.652096 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-podinfo\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:31:00.652106 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.652106 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh6cv\" (UniqueName: \"kubernetes.io/projected/a1327bef-b4d7-4e39-bb63-adc13c915ce7-kube-api-access-zh6cv\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:31:00.652106 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:00.652115 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1327bef-b4d7-4e39-bb63-adc13c915ce7-istio-envoy\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:31:01.439676 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:01.439634 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" event={"ID":"a1327bef-b4d7-4e39-bb63-adc13c915ce7","Type":"ContainerDied","Data":"24d66e0ed05a82071398cfea7119a604f7afe7038d636720cd45dc6f370b10a2"} Jul 08 19:31:01.439676 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:01.439659 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8" Jul 08 19:31:01.440138 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:01.439709 2577 scope.go:117] "RemoveContainer" containerID="a6a84970e3cac923fc8fa6d24f87a88fe6b8ecfdc4bee3f0024a59ada5cb6706" Jul 08 19:31:01.459394 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:01.459360 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8"] Jul 08 19:31:01.463614 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:01.463587 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-693d5a39-openshift-default-594dbf768c-d7kq8"] Jul 08 19:31:02.789070 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:02.789033 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1327bef-b4d7-4e39-bb63-adc13c915ce7" path="/var/lib/kubelet/pods/a1327bef-b4d7-4e39-bb63-adc13c915ce7/volumes" Jul 08 19:31:06.818428 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:06.818392 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:31:06.910548 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:06.910515 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:31:10.192786 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:31:10.192746 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:10.132998 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:32:10.132963 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:10.187230 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:32:10.187194 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:59.033441 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:32:59.033403 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw"] Jul 08 19:32:59.034012 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:32:59.033608 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" podUID="7ccb3232-369e-4254-8a16-aeadfbd03ae7" containerName="istio-proxy" containerID="cri-o://ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75" gracePeriod=30 Jul 08 19:32:59.053056 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:32:59.053023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:59.680392 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:32:59.680351 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:59.798320 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:32:59.798286 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:59.899235 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:32:59.899202 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:01.559301 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:01.559244 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:04.286742 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.286709 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:33:04.311996 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.311967 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-data\") pod \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " Jul 08 19:33:04.312194 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312006 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-credential-socket\") pod \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " Jul 08 19:33:04.312194 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312026 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-podinfo\") pod \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " Jul 08 19:33:04.312194 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312052 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-workload-socket\") pod \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " Jul 08 19:33:04.312194 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312087 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-envoy\") pod \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " Jul 08 19:33:04.312194 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312110 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istiod-ca-cert\") pod \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " Jul 08 19:33:04.312194 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312144 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6hf4\" (UniqueName: \"kubernetes.io/projected/7ccb3232-369e-4254-8a16-aeadfbd03ae7-kube-api-access-x6hf4\") pod \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " Jul 08 19:33:04.312493 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312202 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-token\") pod \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " Jul 08 19:33:04.312493 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312279 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-workload-certs\") pod \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\" (UID: \"7ccb3232-369e-4254-8a16-aeadfbd03ae7\") " Jul 08 19:33:04.312493 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312309 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-data" (OuterVolumeSpecName: "istio-data") pod "7ccb3232-369e-4254-8a16-aeadfbd03ae7" (UID: "7ccb3232-369e-4254-8a16-aeadfbd03ae7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:33:04.312493 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312321 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7ccb3232-369e-4254-8a16-aeadfbd03ae7" (UID: "7ccb3232-369e-4254-8a16-aeadfbd03ae7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:33:04.312764 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312604 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-data\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:33:04.312764 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312624 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-credential-socket\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:33:04.312764 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312643 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7ccb3232-369e-4254-8a16-aeadfbd03ae7" (UID: "7ccb3232-369e-4254-8a16-aeadfbd03ae7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:33:04.312903 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312817 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7ccb3232-369e-4254-8a16-aeadfbd03ae7" (UID: "7ccb3232-369e-4254-8a16-aeadfbd03ae7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:33:04.312953 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.312898 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7ccb3232-369e-4254-8a16-aeadfbd03ae7" (UID: "7ccb3232-369e-4254-8a16-aeadfbd03ae7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:33:04.314826 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.314796 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ccb3232-369e-4254-8a16-aeadfbd03ae7-kube-api-access-x6hf4" (OuterVolumeSpecName: "kube-api-access-x6hf4") pod "7ccb3232-369e-4254-8a16-aeadfbd03ae7" (UID: "7ccb3232-369e-4254-8a16-aeadfbd03ae7"). InnerVolumeSpecName "kube-api-access-x6hf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:33:04.315206 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.315173 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7ccb3232-369e-4254-8a16-aeadfbd03ae7" (UID: "7ccb3232-369e-4254-8a16-aeadfbd03ae7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 19:33:04.315322 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.315280 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ccb3232-369e-4254-8a16-aeadfbd03ae7" (UID: "7ccb3232-369e-4254-8a16-aeadfbd03ae7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:33:04.315719 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.315688 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7ccb3232-369e-4254-8a16-aeadfbd03ae7" (UID: "7ccb3232-369e-4254-8a16-aeadfbd03ae7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:33:04.413069 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.413024 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-podinfo\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:33:04.413069 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.413061 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-workload-socket\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:33:04.413069 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.413071 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-envoy\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:33:04.413069 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.413079 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istiod-ca-cert\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:33:04.413377 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.413088 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6hf4\" (UniqueName: \"kubernetes.io/projected/7ccb3232-369e-4254-8a16-aeadfbd03ae7-kube-api-access-x6hf4\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:33:04.413377 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.413097 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ccb3232-369e-4254-8a16-aeadfbd03ae7-istio-token\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:33:04.413377 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.413105 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ccb3232-369e-4254-8a16-aeadfbd03ae7-workload-certs\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:33:04.988772 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.988734 2577 generic.go:356] "Generic (PLEG): container finished" podID="7ccb3232-369e-4254-8a16-aeadfbd03ae7" containerID="ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75" exitCode=0 Jul 08 19:33:04.988959 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.988780 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" event={"ID":"7ccb3232-369e-4254-8a16-aeadfbd03ae7","Type":"ContainerDied","Data":"ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75"} Jul 08 19:33:04.988959 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.988786 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" Jul 08 19:33:04.988959 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.988831 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw" event={"ID":"7ccb3232-369e-4254-8a16-aeadfbd03ae7","Type":"ContainerDied","Data":"a59e39df513438f1ab2f373ad2d51c2f380e70bcd0bc167f812eb63c368edc13"} Jul 08 19:33:04.988959 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.988857 2577 scope.go:117] "RemoveContainer" containerID="ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75" Jul 08 19:33:04.997804 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.997786 2577 scope.go:117] "RemoveContainer" containerID="ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75" Jul 08 19:33:04.998153 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:33:04.998132 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75\": container with ID starting with ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75 not found: ID does not exist" containerID="ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75" Jul 08 19:33:04.998220 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:04.998166 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75"} err="failed to get container status \"ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75\": rpc error: code = NotFound desc = could not find container \"ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75\": container with ID starting with ebacb6d517122d8b617b01adcedf86aca192f18abbcc6cf67d3b01a63ca88d75 not found: ID does not exist" Jul 08 19:33:05.010162 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:05.010124 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw"] Jul 08 19:33:05.016995 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:05.016970 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-3e4bf33f-openshift-default-859db7c87-9zjtw"] Jul 08 19:33:06.789159 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:06.789122 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ccb3232-369e-4254-8a16-aeadfbd03ae7" path="/var/lib/kubelet/pods/7ccb3232-369e-4254-8a16-aeadfbd03ae7/volumes" Jul 08 19:33:07.608787 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:07.608753 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:07.705846 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:07.705811 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:07.830369 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:07.830334 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:07.931147 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:07.931064 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:08.323984 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:08.323951 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:13.599334 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:13.599293 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:20.240311 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:20.240242 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:34.348099 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:34.348063 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:40.218041 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:40.218006 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:40.285728 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:40.285691 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:40.366776 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:40.366728 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:40.475000 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:40.474909 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:56.353646 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:33:56.353606 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:01.430706 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:01.430670 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:02.301855 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:02.301818 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:02.359942 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:02.359903 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:02.434710 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:02.434675 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:02.534554 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:02.534519 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:13.089119 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:13.089042 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:13.877184 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:13.877150 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:19.832976 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:19.832936 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:19.894707 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:19.894675 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:19.986100 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:19.986066 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:20.080826 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:20.080790 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:20.181843 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:20.181747 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:20.979133 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:20.979100 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:21.080055 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:21.080025 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:21.178906 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:21.178864 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:22.852049 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:22.852018 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:28.967059 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:28.967023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:29.025884 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:29.025847 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:29.660380 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:29.660344 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:35.725956 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:35.725925 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:35.787828 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:35.787797 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:35.978225 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:35.978138 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:36.292632 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.290013 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz"] Jul 08 19:34:36.292632 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.290842 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ccb3232-369e-4254-8a16-aeadfbd03ae7" containerName="istio-proxy" Jul 08 19:34:36.292632 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.290862 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ccb3232-369e-4254-8a16-aeadfbd03ae7" containerName="istio-proxy" Jul 08 19:34:36.292632 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.290875 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1327bef-b4d7-4e39-bb63-adc13c915ce7" containerName="istio-proxy" Jul 08 19:34:36.292632 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.290885 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1327bef-b4d7-4e39-bb63-adc13c915ce7" containerName="istio-proxy" Jul 08 19:34:36.292632 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.291035 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1327bef-b4d7-4e39-bb63-adc13c915ce7" containerName="istio-proxy" Jul 08 19:34:36.292632 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.291047 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ccb3232-369e-4254-8a16-aeadfbd03ae7" containerName="istio-proxy" Jul 08 19:34:36.294890 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.294866 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.297894 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.297866 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cddeca0a-openshift-default-dockercfg-kn5t6\"" Jul 08 19:34:36.305853 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.305831 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:36.314528 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.314504 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz"] Jul 08 19:34:36.353486 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.353445 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-envoy\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.353486 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.353493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-workload-socket\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.353706 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.353517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-podinfo\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.353706 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.353641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbbkq\" (UniqueName: \"kubernetes.io/projected/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-kube-api-access-qbbkq\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.353706 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.353677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-data\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.353706 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.353694 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-token\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.353965 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.353760 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-credential-socket\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.353965 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.353811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istiod-ca-cert\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.353965 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.353837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-workload-certs\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.454653 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.454613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbbkq\" (UniqueName: \"kubernetes.io/projected/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-kube-api-access-qbbkq\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.454653 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.454649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-data\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.454890 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.454762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-token\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.454890 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.454836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-credential-socket\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.454890 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.454879 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istiod-ca-cert\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.455044 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.454913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-workload-certs\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.455044 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.454952 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-envoy\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.455044 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.454991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-workload-socket\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.455044 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.455024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-podinfo\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.455286 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.454992 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-data\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.455286 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.455216 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-credential-socket\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.455379 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.455354 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-workload-socket\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.455457 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.455429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-workload-certs\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.455624 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.455598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istiod-ca-cert\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.457724 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.457696 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-envoy\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.457860 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.457841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-podinfo\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.463834 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.463809 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-token\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.464058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.464038 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbbkq\" (UniqueName: \"kubernetes.io/projected/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-kube-api-access-qbbkq\") pod \"e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.495968 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.495934 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:36.605650 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.605620 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:36.744950 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.744832 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz"] Jul 08 19:34:36.747368 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:34:36.747338 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76c69bc_25f0_4bb6_8c3c_2b517ab3a532.slice/crio-8dd72b58e15b9a2cf2da11b2dd3c9cd0664e7ac58da5bbbafd4cb5b14a7dd31e WatchSource:0}: Error finding container 8dd72b58e15b9a2cf2da11b2dd3c9cd0664e7ac58da5bbbafd4cb5b14a7dd31e: Status 404 returned error can't find the container with id 8dd72b58e15b9a2cf2da11b2dd3c9cd0664e7ac58da5bbbafd4cb5b14a7dd31e Jul 08 19:34:36.749581 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.749548 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:34:36.749649 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.749633 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:34:36.749696 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:36.749679 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:34:37.396209 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:37.396170 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" event={"ID":"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532","Type":"ContainerStarted","Data":"5d7634db14f310d9dc9583166211ee9774c2bbe055aaaa084aea2145113387df"} Jul 08 19:34:37.396411 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:37.396222 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" event={"ID":"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532","Type":"ContainerStarted","Data":"8dd72b58e15b9a2cf2da11b2dd3c9cd0664e7ac58da5bbbafd4cb5b14a7dd31e"} Jul 08 19:34:37.417711 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:37.417660 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" podStartSLOduration=1.417641125 podStartE2EDuration="1.417641125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:34:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:34:37.415364057 +0000 UTC m=+2003.021277130" watchObservedRunningTime="2026-07-08 19:34:37.417641125 +0000 UTC m=+2003.023554196" Jul 08 19:34:37.605965 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:37.605927 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:37.611882 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:37.611850 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:38.402353 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:38.402305 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:34:38.403226 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:34:38.403205 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:36:27.793650 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:36:27.793610 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:44.041121 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:44.041083 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz"] Jul 08 19:37:44.043716 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:44.041334 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" podUID="e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" containerName="istio-proxy" containerID="cri-o://5d7634db14f310d9dc9583166211ee9774c2bbe055aaaa084aea2145113387df" gracePeriod=30 Jul 08 19:37:44.060666 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:44.060630 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:44.475166 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:44.475129 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:44.574093 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:44.574059 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:44.723504 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:44.723462 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:49.252666 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.252628 2577 generic.go:356] "Generic (PLEG): container finished" podID="e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" containerID="5d7634db14f310d9dc9583166211ee9774c2bbe055aaaa084aea2145113387df" exitCode=0 Jul 08 19:37:49.253021 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.252702 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" event={"ID":"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532","Type":"ContainerDied","Data":"5d7634db14f310d9dc9583166211ee9774c2bbe055aaaa084aea2145113387df"} Jul 08 19:37:49.299671 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.299607 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:37:49.442668 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.442632 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-workload-socket\") pod \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " Jul 08 19:37:49.442668 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.442670 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istiod-ca-cert\") pod \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " Jul 08 19:37:49.442887 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.442699 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-data\") pod \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " Jul 08 19:37:49.442887 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.442742 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-envoy\") pod \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " Jul 08 19:37:49.442887 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.442761 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-podinfo\") pod \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " Jul 08 19:37:49.442887 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.442776 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-workload-certs\") pod \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " Jul 08 19:37:49.442887 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.442866 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbbkq\" (UniqueName: \"kubernetes.io/projected/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-kube-api-access-qbbkq\") pod \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " Jul 08 19:37:49.443149 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.442900 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-token\") pod \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " Jul 08 19:37:49.443149 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.442943 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-credential-socket\") pod \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\" (UID: \"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532\") " Jul 08 19:37:49.443149 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.443023 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" (UID: "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:37:49.443347 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.443222 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" (UID: "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:37:49.443347 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.443236 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" (UID: "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:37:49.443465 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.443370 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-data" (OuterVolumeSpecName: "istio-data") pod "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" (UID: "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:37:49.443465 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.443421 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-workload-socket\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:37:49.443710 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.443535 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" (UID: "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:37:49.445228 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.445197 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-token" (OuterVolumeSpecName: "istio-token") pod "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" (UID: "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:37:49.445343 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.445282 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" (UID: "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 19:37:49.445392 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.445337 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" (UID: "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:37:49.445392 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.445331 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-kube-api-access-qbbkq" (OuterVolumeSpecName: "kube-api-access-qbbkq") pod "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" (UID: "e76c69bc-25f0-4bb6-8c3c-2b517ab3a532"). InnerVolumeSpecName "kube-api-access-qbbkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:37:49.544875 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.544840 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbbkq\" (UniqueName: \"kubernetes.io/projected/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-kube-api-access-qbbkq\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:37:49.544875 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.544870 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-token\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:37:49.544875 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.544879 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-credential-socket\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:37:49.544875 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.544887 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istiod-ca-cert\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:37:49.545125 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.544896 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-data\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:37:49.545125 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.544903 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-envoy\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:37:49.545125 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.544911 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-istio-podinfo\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:37:49.545125 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:49.544918 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532-workload-certs\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:37:50.265420 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:50.265384 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" Jul 08 19:37:50.265420 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:50.265415 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz" event={"ID":"e76c69bc-25f0-4bb6-8c3c-2b517ab3a532","Type":"ContainerDied","Data":"8dd72b58e15b9a2cf2da11b2dd3c9cd0664e7ac58da5bbbafd4cb5b14a7dd31e"} Jul 08 19:37:50.266105 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:50.265497 2577 scope.go:117] "RemoveContainer" containerID="5d7634db14f310d9dc9583166211ee9774c2bbe055aaaa084aea2145113387df" Jul 08 19:37:50.290209 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:50.290176 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz"] Jul 08 19:37:50.294141 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:50.294114 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cddeca0a-openshift-default-c869c6799-w7flz"] Jul 08 19:37:50.715325 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:50.715285 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:50.788422 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:50.788389 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" path="/var/lib/kubelet/pods/e76c69bc-25f0-4bb6-8c3c-2b517ab3a532/volumes" Jul 08 19:37:50.791038 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:50.791013 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:50.867543 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:50.867509 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:51.089734 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:51.089701 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:57.030921 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:57.030888 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:57.091675 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:37:57.091640 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:03.910622 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:03.910583 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:04.221383 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.221293 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv"] Jul 08 19:38:04.221678 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.221663 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" containerName="istio-proxy" Jul 08 19:38:04.221743 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.221680 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" containerName="istio-proxy" Jul 08 19:38:04.221743 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.221740 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e76c69bc-25f0-4bb6-8c3c-2b517ab3a532" containerName="istio-proxy" Jul 08 19:38:04.225883 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.225860 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.228487 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.228468 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f3245bf3-openshift-default-dockercfg-mngdn\"" Jul 08 19:38:04.233729 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.233702 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:04.237676 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.237644 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv"] Jul 08 19:38:04.276563 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.276517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-credential-socket\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.276563 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.276566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8g4c\" (UniqueName: \"kubernetes.io/projected/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-kube-api-access-w8g4c\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.277032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.276647 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-podinfo\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.277032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.276715 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-workload-certs\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.277032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.276741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istiod-ca-cert\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.277032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.276768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-envoy\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.277032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.276827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-workload-socket\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.277032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.276856 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-data\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.277032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.276880 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-token\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.377479 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.377444 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-envoy\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.377684 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.377492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-workload-socket\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.377684 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.377522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-data\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.377684 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.377549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-token\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.377684 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.377588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-credential-socket\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.377684 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.377619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8g4c\" (UniqueName: \"kubernetes.io/projected/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-kube-api-access-w8g4c\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.377684 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.377671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-podinfo\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.377989 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.377732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-workload-certs\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.377989 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.377766 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istiod-ca-cert\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.377989 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.377980 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-workload-socket\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.378117 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.378009 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-data\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.378448 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.378418 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istiod-ca-cert\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.378448 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.378439 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-workload-certs\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.378647 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.378512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-credential-socket\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.379939 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.379920 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-envoy\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.380443 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.380426 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-podinfo\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.386848 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.386821 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-token\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.387138 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.387105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8g4c\" (UniqueName: \"kubernetes.io/projected/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-kube-api-access-w8g4c\") pod \"e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.537633 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.537532 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:04.626398 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.626361 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:04.694297 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.694253 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv"] Jul 08 19:38:04.697653 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:38:04.697610 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6515c0a_d8cb_413d_b316_3c88e7b60eb4.slice/crio-726e94dd2b9f665cc92e026c29ab407decc549db4737a078e91f853064b7ba7c WatchSource:0}: Error finding container 726e94dd2b9f665cc92e026c29ab407decc549db4737a078e91f853064b7ba7c: Status 404 returned error can't find the container with id 726e94dd2b9f665cc92e026c29ab407decc549db4737a078e91f853064b7ba7c Jul 08 19:38:04.699766 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.699730 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:38:04.699882 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.699816 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:38:04.699882 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:04.699855 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:38:05.336222 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:05.336187 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" event={"ID":"a6515c0a-d8cb-413d-b316-3c88e7b60eb4","Type":"ContainerStarted","Data":"f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865"} Jul 08 19:38:05.336646 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:05.336239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" event={"ID":"a6515c0a-d8cb-413d-b316-3c88e7b60eb4","Type":"ContainerStarted","Data":"726e94dd2b9f665cc92e026c29ab407decc549db4737a078e91f853064b7ba7c"} Jul 08 19:38:05.356874 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:05.356812 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" podStartSLOduration=1.356771534 podStartE2EDuration="1.356771534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:38:05.356127448 +0000 UTC m=+2210.962040583" watchObservedRunningTime="2026-07-08 19:38:05.356771534 +0000 UTC m=+2210.962684605" Jul 08 19:38:05.538379 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:05.538335 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:05.543484 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:05.543459 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:06.346834 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:06.346793 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:38:06.347929 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:38:06.347910 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:39:28.701464 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:39:28.701427 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:39.541171 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:40:39.541087 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:39.641110 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:40:39.641078 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:11.769732 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:11.769695 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv"] Jul 08 19:41:11.770359 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:11.769957 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" podUID="a6515c0a-d8cb-413d-b316-3c88e7b60eb4" containerName="istio-proxy" containerID="cri-o://f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865" gracePeriod=30 Jul 08 19:41:11.789168 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:11.789131 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:13.138579 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:13.138504 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:13.234221 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:13.234185 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:13.339131 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:13.339097 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:14.071219 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:14.071185 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:14.164464 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:14.164430 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:14.263480 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:14.263443 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:15.646097 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:15.646060 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:17.044620 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.044585 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:41:17.180294 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.180234 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6515c0a-d8cb-413d-b316-3c88e7b60eb4" containerID="f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865" exitCode=0 Jul 08 19:41:17.180294 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.180295 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" Jul 08 19:41:17.180488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.180324 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" event={"ID":"a6515c0a-d8cb-413d-b316-3c88e7b60eb4","Type":"ContainerDied","Data":"f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865"} Jul 08 19:41:17.180488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.180386 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv" event={"ID":"a6515c0a-d8cb-413d-b316-3c88e7b60eb4","Type":"ContainerDied","Data":"726e94dd2b9f665cc92e026c29ab407decc549db4737a078e91f853064b7ba7c"} Jul 08 19:41:17.180488 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.180412 2577 scope.go:117] "RemoveContainer" containerID="f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865" Jul 08 19:41:17.189388 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.189368 2577 scope.go:117] "RemoveContainer" containerID="f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865" Jul 08 19:41:17.189697 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:41:17.189668 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865\": container with ID starting with f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865 not found: ID does not exist" containerID="f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865" Jul 08 19:41:17.189749 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.189711 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865"} err="failed to get container status \"f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865\": rpc error: code = NotFound desc = could not find container \"f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865\": container with ID starting with f3f20219ff18c1544fabb4dca9573213676009934bcfef956f07e163272bd865 not found: ID does not exist" Jul 08 19:41:17.192008 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.191988 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8g4c\" (UniqueName: \"kubernetes.io/projected/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-kube-api-access-w8g4c\") pod \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " Jul 08 19:41:17.192102 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192016 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istiod-ca-cert\") pod \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " Jul 08 19:41:17.192102 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192052 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-data\") pod \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " Jul 08 19:41:17.192102 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192083 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-credential-socket\") pod \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " Jul 08 19:41:17.192288 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192124 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-envoy\") pod \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " Jul 08 19:41:17.192288 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192140 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-workload-socket\") pod \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " Jul 08 19:41:17.192288 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192163 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-podinfo\") pod \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " Jul 08 19:41:17.192288 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192179 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-workload-certs\") pod \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " Jul 08 19:41:17.192288 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192243 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-token\") pod \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\" (UID: \"a6515c0a-d8cb-413d-b316-3c88e7b60eb4\") " Jul 08 19:41:17.192556 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192368 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6515c0a-d8cb-413d-b316-3c88e7b60eb4" (UID: "a6515c0a-d8cb-413d-b316-3c88e7b60eb4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:41:17.192556 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192455 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6515c0a-d8cb-413d-b316-3c88e7b60eb4" (UID: "a6515c0a-d8cb-413d-b316-3c88e7b60eb4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:41:17.192556 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192456 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6515c0a-d8cb-413d-b316-3c88e7b60eb4" (UID: "a6515c0a-d8cb-413d-b316-3c88e7b60eb4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:41:17.192717 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192608 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istiod-ca-cert\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:41:17.192717 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192625 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-data\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:41:17.192717 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192637 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-workload-socket\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:41:17.192717 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192697 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6515c0a-d8cb-413d-b316-3c88e7b60eb4" (UID: "a6515c0a-d8cb-413d-b316-3c88e7b60eb4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:41:17.192887 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.192720 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6515c0a-d8cb-413d-b316-3c88e7b60eb4" (UID: "a6515c0a-d8cb-413d-b316-3c88e7b60eb4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:41:17.194824 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.194794 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6515c0a-d8cb-413d-b316-3c88e7b60eb4" (UID: "a6515c0a-d8cb-413d-b316-3c88e7b60eb4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:41:17.195027 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.195006 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-kube-api-access-w8g4c" (OuterVolumeSpecName: "kube-api-access-w8g4c") pod "a6515c0a-d8cb-413d-b316-3c88e7b60eb4" (UID: "a6515c0a-d8cb-413d-b316-3c88e7b60eb4"). InnerVolumeSpecName "kube-api-access-w8g4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:41:17.195154 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.195134 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6515c0a-d8cb-413d-b316-3c88e7b60eb4" (UID: "a6515c0a-d8cb-413d-b316-3c88e7b60eb4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:41:17.195211 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.195161 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6515c0a-d8cb-413d-b316-3c88e7b60eb4" (UID: "a6515c0a-d8cb-413d-b316-3c88e7b60eb4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 19:41:17.293930 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.293837 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8g4c\" (UniqueName: \"kubernetes.io/projected/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-kube-api-access-w8g4c\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:41:17.293930 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.293867 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-credential-socket\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:41:17.293930 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.293878 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-envoy\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:41:17.293930 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.293887 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-podinfo\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:41:17.293930 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.293897 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-workload-certs\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:41:17.293930 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.293905 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6515c0a-d8cb-413d-b316-3c88e7b60eb4-istio-token\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:41:17.505274 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.505215 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv"] Jul 08 19:41:17.512748 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:17.512717 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f3245bf3-openshift-default-6c588cc98c-hwgmv"] Jul 08 19:41:18.789000 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:18.788955 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6515c0a-d8cb-413d-b316-3c88e7b60eb4" path="/var/lib/kubelet/pods/a6515c0a-d8cb-413d-b316-3c88e7b60eb4/volumes" Jul 08 19:41:21.660617 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:21.660582 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:21.722676 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:21.722643 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:22.347212 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:22.347177 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:28.893099 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:28.893066 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:30.157133 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:30.157096 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:39.689805 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:39.689707 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:40.054937 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:41:40.054899 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:01.526099 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:01.526063 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:06.715716 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:06.715680 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:07.356787 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:07.356754 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:07.462158 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:07.462122 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:07.721040 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:07.720949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:08.028693 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.028602 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4"] Jul 08 19:42:08.028939 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.028927 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6515c0a-d8cb-413d-b316-3c88e7b60eb4" containerName="istio-proxy" Jul 08 19:42:08.028990 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.028940 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6515c0a-d8cb-413d-b316-3c88e7b60eb4" containerName="istio-proxy" Jul 08 19:42:08.029025 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.028998 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6515c0a-d8cb-413d-b316-3c88e7b60eb4" containerName="istio-proxy" Jul 08 19:42:08.032112 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.032093 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.034807 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.034780 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-6511a5-openshift-default-dockercfg-fxtjt\"" Jul 08 19:42:08.047216 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.047189 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4"] Jul 08 19:42:08.055223 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.055187 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:08.058483 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.058440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-workload-certs\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.058483 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.058490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp6jn\" (UniqueName: \"kubernetes.io/projected/75843b53-c3c0-4927-a2f3-288024205d96-kube-api-access-bp6jn\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.058662 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.058520 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-istio-envoy\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.058662 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.058548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75843b53-c3c0-4927-a2f3-288024205d96-istio-token\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.058662 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.058584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-credential-socket\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.058662 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.058629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-istio-data\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.058801 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.058701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75843b53-c3c0-4927-a2f3-288024205d96-istiod-ca-cert\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.058801 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.058723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-workload-socket\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.058801 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.058764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75843b53-c3c0-4927-a2f3-288024205d96-istio-podinfo\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.159422 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.159385 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75843b53-c3c0-4927-a2f3-288024205d96-istiod-ca-cert\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.159622 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.159429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-workload-socket\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.159622 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.159466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75843b53-c3c0-4927-a2f3-288024205d96-istio-podinfo\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.159622 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.159506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-workload-certs\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.159622 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.159531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp6jn\" (UniqueName: \"kubernetes.io/projected/75843b53-c3c0-4927-a2f3-288024205d96-kube-api-access-bp6jn\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.159622 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.159558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-istio-envoy\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.159622 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.159575 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75843b53-c3c0-4927-a2f3-288024205d96-istio-token\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.159981 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.159631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-credential-socket\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.160153 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.160113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-istio-data\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.160354 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.160303 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-workload-certs\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.160472 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.160360 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-credential-socket\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.160472 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.160458 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-workload-socket\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.160607 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.160554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-istio-data\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.160919 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.160898 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75843b53-c3c0-4927-a2f3-288024205d96-istiod-ca-cert\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.162796 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.162767 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-istio-envoy\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.162928 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.162911 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75843b53-c3c0-4927-a2f3-288024205d96-istio-podinfo\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.171699 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.171668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp6jn\" (UniqueName: \"kubernetes.io/projected/75843b53-c3c0-4927-a2f3-288024205d96-kube-api-access-bp6jn\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.171854 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.171713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75843b53-c3c0-4927-a2f3-288024205d96-istio-token\") pod \"e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.208396 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.208349 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:08.343000 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.342967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:08.487567 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.487438 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4"] Jul 08 19:42:08.489867 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:42:08.489837 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75843b53_c3c0_4927_a2f3_288024205d96.slice/crio-7101a538b6b66ad6791e86eb2ec55e9d52afc3c50d19fafcc2ab79b138d8e639 WatchSource:0}: Error finding container 7101a538b6b66ad6791e86eb2ec55e9d52afc3c50d19fafcc2ab79b138d8e639: Status 404 returned error can't find the container with id 7101a538b6b66ad6791e86eb2ec55e9d52afc3c50d19fafcc2ab79b138d8e639 Jul 08 19:42:08.492133 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.492084 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:42:08.492355 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.492175 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:42:08.492355 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:08.492231 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:42:09.430127 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:09.430093 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" event={"ID":"75843b53-c3c0-4927-a2f3-288024205d96","Type":"ContainerStarted","Data":"48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c"} Jul 08 19:42:09.430555 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:09.430143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" event={"ID":"75843b53-c3c0-4927-a2f3-288024205d96","Type":"ContainerStarted","Data":"7101a538b6b66ad6791e86eb2ec55e9d52afc3c50d19fafcc2ab79b138d8e639"} Jul 08 19:42:09.455440 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:09.455375 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" podStartSLOduration=1.455352725 podStartE2EDuration="1.455352725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:42:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:42:09.453882266 +0000 UTC m=+2455.059795339" watchObservedRunningTime="2026-07-08 19:42:09.455352725 +0000 UTC m=+2455.061265796" Jul 08 19:42:10.343154 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:10.343108 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:10.348047 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:10.348020 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:10.435200 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:10.435171 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:10.436292 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:10.436243 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:42:12.652054 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:12.652013 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:12.751164 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:42:12.751124 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:15.842594 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:15.842554 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4"] Jul 08 19:45:15.845518 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:15.842813 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" podUID="75843b53-c3c0-4927-a2f3-288024205d96" containerName="istio-proxy" containerID="cri-o://48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c" gracePeriod=30 Jul 08 19:45:15.881275 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:15.881224 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:17.563586 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:17.563550 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574447f8b8-6wxcb_1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8/authorino/0.log" Jul 08 19:45:21.099125 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.099098 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:45:21.157337 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157237 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75843b53-c3c0-4927-a2f3-288024205d96-istio-podinfo\") pod \"75843b53-c3c0-4927-a2f3-288024205d96\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " Jul 08 19:45:21.157337 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157319 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-credential-socket\") pod \"75843b53-c3c0-4927-a2f3-288024205d96\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " Jul 08 19:45:21.157558 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157361 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-workload-certs\") pod \"75843b53-c3c0-4927-a2f3-288024205d96\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " Jul 08 19:45:21.157558 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157384 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-istio-data\") pod \"75843b53-c3c0-4927-a2f3-288024205d96\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " Jul 08 19:45:21.157558 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157417 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-workload-socket\") pod \"75843b53-c3c0-4927-a2f3-288024205d96\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " Jul 08 19:45:21.157558 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157484 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp6jn\" (UniqueName: \"kubernetes.io/projected/75843b53-c3c0-4927-a2f3-288024205d96-kube-api-access-bp6jn\") pod \"75843b53-c3c0-4927-a2f3-288024205d96\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " Jul 08 19:45:21.157769 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157558 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75843b53-c3c0-4927-a2f3-288024205d96-istio-token\") pod \"75843b53-c3c0-4927-a2f3-288024205d96\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " Jul 08 19:45:21.157769 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157587 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-istio-envoy\") pod \"75843b53-c3c0-4927-a2f3-288024205d96\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " Jul 08 19:45:21.157769 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157614 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75843b53-c3c0-4927-a2f3-288024205d96-istiod-ca-cert\") pod \"75843b53-c3c0-4927-a2f3-288024205d96\" (UID: \"75843b53-c3c0-4927-a2f3-288024205d96\") " Jul 08 19:45:21.157769 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157663 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "75843b53-c3c0-4927-a2f3-288024205d96" (UID: "75843b53-c3c0-4927-a2f3-288024205d96"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:45:21.157769 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157750 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "75843b53-c3c0-4927-a2f3-288024205d96" (UID: "75843b53-c3c0-4927-a2f3-288024205d96"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:45:21.158030 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157763 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-istio-data" (OuterVolumeSpecName: "istio-data") pod "75843b53-c3c0-4927-a2f3-288024205d96" (UID: "75843b53-c3c0-4927-a2f3-288024205d96"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:45:21.158030 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.157941 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "75843b53-c3c0-4927-a2f3-288024205d96" (UID: "75843b53-c3c0-4927-a2f3-288024205d96"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:45:21.158133 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.158030 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-credential-socket\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:45:21.158133 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.158043 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75843b53-c3c0-4927-a2f3-288024205d96-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "75843b53-c3c0-4927-a2f3-288024205d96" (UID: "75843b53-c3c0-4927-a2f3-288024205d96"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:45:21.158133 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.158049 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-workload-certs\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:45:21.158133 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.158084 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-istio-data\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:45:21.158133 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.158098 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-workload-socket\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:45:21.159589 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.159565 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75843b53-c3c0-4927-a2f3-288024205d96-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "75843b53-c3c0-4927-a2f3-288024205d96" (UID: "75843b53-c3c0-4927-a2f3-288024205d96"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 19:45:21.159842 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.159821 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75843b53-c3c0-4927-a2f3-288024205d96-istio-token" (OuterVolumeSpecName: "istio-token") pod "75843b53-c3c0-4927-a2f3-288024205d96" (UID: "75843b53-c3c0-4927-a2f3-288024205d96"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:45:21.160275 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.160234 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75843b53-c3c0-4927-a2f3-288024205d96-kube-api-access-bp6jn" (OuterVolumeSpecName: "kube-api-access-bp6jn") pod "75843b53-c3c0-4927-a2f3-288024205d96" (UID: "75843b53-c3c0-4927-a2f3-288024205d96"). InnerVolumeSpecName "kube-api-access-bp6jn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:45:21.160383 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.160249 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "75843b53-c3c0-4927-a2f3-288024205d96" (UID: "75843b53-c3c0-4927-a2f3-288024205d96"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:45:21.258784 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.258736 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp6jn\" (UniqueName: \"kubernetes.io/projected/75843b53-c3c0-4927-a2f3-288024205d96-kube-api-access-bp6jn\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:45:21.258784 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.258776 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75843b53-c3c0-4927-a2f3-288024205d96-istio-token\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:45:21.258784 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.258785 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75843b53-c3c0-4927-a2f3-288024205d96-istio-envoy\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:45:21.258784 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.258793 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75843b53-c3c0-4927-a2f3-288024205d96-istiod-ca-cert\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:45:21.259063 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.258801 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75843b53-c3c0-4927-a2f3-288024205d96-istio-podinfo\") on node \"ip-10-0-128-32.ec2.internal\" DevicePath \"\"" Jul 08 19:45:21.283646 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.283613 2577 generic.go:356] "Generic (PLEG): container finished" podID="75843b53-c3c0-4927-a2f3-288024205d96" containerID="48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c" exitCode=0 Jul 08 19:45:21.283761 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.283660 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" Jul 08 19:45:21.283761 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.283672 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" event={"ID":"75843b53-c3c0-4927-a2f3-288024205d96","Type":"ContainerDied","Data":"48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c"} Jul 08 19:45:21.283761 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.283714 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4" event={"ID":"75843b53-c3c0-4927-a2f3-288024205d96","Type":"ContainerDied","Data":"7101a538b6b66ad6791e86eb2ec55e9d52afc3c50d19fafcc2ab79b138d8e639"} Jul 08 19:45:21.283761 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.283736 2577 scope.go:117] "RemoveContainer" containerID="48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c" Jul 08 19:45:21.294701 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.294674 2577 scope.go:117] "RemoveContainer" containerID="48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c" Jul 08 19:45:21.295153 ip-10-0-128-32 kubenswrapper[2577]: E0708 19:45:21.295129 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c\": container with ID starting with 48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c not found: ID does not exist" containerID="48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c" Jul 08 19:45:21.295216 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.295165 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c"} err="failed to get container status \"48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c\": rpc error: code = NotFound desc = could not find container \"48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c\": container with ID starting with 48eb513ac8792b367d38c1bd9e33112babab0a9562ea143085b896e25ace392c not found: ID does not exist" Jul 08 19:45:21.306741 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.306707 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4"] Jul 08 19:45:21.310625 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:21.310601 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-6511a5-openshift-default-7cfd7ff44c-qkdn4"] Jul 08 19:45:22.522294 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:22.522246 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-t74g8_6f847f97-b488-476b-9ab8-1a7ac75e056b/manager/0.log" Jul 08 19:45:22.788142 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:22.788046 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75843b53-c3c0-4927-a2f3-288024205d96" path="/var/lib/kubelet/pods/75843b53-c3c0-4927-a2f3-288024205d96/volumes" Jul 08 19:45:23.336158 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:23.336123 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9dc45487-zshsx_19a589fd-4ec9-4cbb-9306-0298123c10bf/copy-manifests/0.log" Jul 08 19:45:23.351436 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:23.351410 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9dc45487-zshsx_19a589fd-4ec9-4cbb-9306-0298123c10bf/manager/0.log" Jul 08 19:45:24.833041 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:24.833008 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574447f8b8-6wxcb_1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8/authorino/0.log" Jul 08 19:45:25.216058 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:25.215980 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bhprs_802aae78-644d-489e-b12f-bc326e6c3d77/kuadrant-console-plugin/0.log" Jul 08 19:45:26.152227 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:26.152143 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wc7ch_776f7577-6c4e-4121-865e-91f50b0131a3/istio-proxy/0.log" Jul 08 19:45:26.521944 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:26.521858 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cd5f7d96-8vmlt_0a7b251a-612a-4904-82b4-2e50b7f0a3cb/kube-auth-proxy/0.log" Jul 08 19:45:26.651989 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:26.651961 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-45cbk_ce1676c4-ad5f-40c1-995c-2780154a68a7/istio-proxy/1.log" Jul 08 19:45:26.775195 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:26.775116 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-vgxqr_d44af44c-c368-4ef9-acf5-8b53fc97bd5f/payload-pre-processing/0.log" Jul 08 19:45:27.520084 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:27.520056 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bq7gd_01e198c3-c4a8-4327-a20b-c51f368ffb78/main/0.log" Jul 08 19:45:27.638601 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:27.638570 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-w4j2l_08036fd6-ed30-49ac-89ae-7a8193dc58dc/main/0.log" Jul 08 19:45:32.772785 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:32.772739 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:32.868335 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:32.868301 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:35.605431 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:35.605396 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fxx2m_f961bcd4-9cc9-45fd-bf10-6c82cf845d0a/global-pull-secret-syncer/0.log" Jul 08 19:45:35.720729 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:35.720695 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" Jul 08 19:45:35.834560 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:35.834504 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-32.ec2.internal_c64d84b2ff9c3bb74e9379c477de15a9/haproxy/0.log" Jul 08 19:45:40.962535 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:40.962502 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574447f8b8-6wxcb_1d1a6ea6-17bd-4943-ba91-3c6aaba4d3d8/authorino/0.log" Jul 08 19:45:41.066490 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:41.066463 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bhprs_802aae78-644d-489e-b12f-bc326e6c3d77/kuadrant-console-plugin/0.log" Jul 08 19:45:41.613448 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:41.613410 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mb8t_561fd62e-f32c-4ebc-82da-ffba58319ef2/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:43.333928 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.333900 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5988d766d8-v25r9_0cbaeed2-305d-4d24-84ff-a6e27e6546fa/metrics-server/0.log" Jul 08 19:45:43.362202 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.362174 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-xrh9z_c55987b2-5fa3-48f0-9176-ca8450bbda1a/monitoring-plugin/0.log" Jul 08 19:45:43.393877 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.393848 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-btc88_5885f7bd-c9e5-4798-8426-90b3e0d96fed/node-exporter/0.log" Jul 08 19:45:43.418141 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.418110 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-btc88_5885f7bd-c9e5-4798-8426-90b3e0d96fed/kube-rbac-proxy/0.log" Jul 08 19:45:43.442608 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.442581 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-btc88_5885f7bd-c9e5-4798-8426-90b3e0d96fed/init-textfile/0.log" Jul 08 19:45:43.738496 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.738465 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_959dacf0-da8f-4b82-9eeb-5548452ae6a7/prometheus/0.log" Jul 08 19:45:43.763273 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.763241 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_959dacf0-da8f-4b82-9eeb-5548452ae6a7/config-reloader/0.log" Jul 08 19:45:43.786385 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.786358 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_959dacf0-da8f-4b82-9eeb-5548452ae6a7/thanos-sidecar/0.log" Jul 08 19:45:43.809011 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.808988 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_959dacf0-da8f-4b82-9eeb-5548452ae6a7/kube-rbac-proxy-web/0.log" Jul 08 19:45:43.831088 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.831058 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_959dacf0-da8f-4b82-9eeb-5548452ae6a7/kube-rbac-proxy/0.log" Jul 08 19:45:43.853070 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.853041 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_959dacf0-da8f-4b82-9eeb-5548452ae6a7/kube-rbac-proxy-thanos/0.log" Jul 08 19:45:43.873858 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.873830 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_959dacf0-da8f-4b82-9eeb-5548452ae6a7/init-config-reloader/0.log" Jul 08 19:45:43.916801 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.916766 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-l4xzl_ba7db034-b031-4a77-bac9-9482d27606fd/prometheus-operator/0.log" Jul 08 19:45:43.935904 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.935877 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-l4xzl_ba7db034-b031-4a77-bac9-9482d27606fd/kube-rbac-proxy/0.log" Jul 08 19:45:43.960914 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:43.960885 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-zgkl4_112cb826-3e85-44e0-b16c-d56afcdd1a24/prometheus-operator-admission-webhook/0.log" Jul 08 19:45:45.732780 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.732741 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj"] Jul 08 19:45:45.733163 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.733066 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75843b53-c3c0-4927-a2f3-288024205d96" containerName="istio-proxy" Jul 08 19:45:45.733163 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.733076 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="75843b53-c3c0-4927-a2f3-288024205d96" containerName="istio-proxy" Jul 08 19:45:45.733163 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.733138 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="75843b53-c3c0-4927-a2f3-288024205d96" containerName="istio-proxy" Jul 08 19:45:45.736525 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.736502 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.739126 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.739101 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hlh8b\"/\"kube-root-ca.crt\"" Jul 08 19:45:45.739231 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.739149 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hlh8b\"/\"openshift-service-ca.crt\"" Jul 08 19:45:45.740106 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.740089 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hlh8b\"/\"default-dockercfg-b6282\"" Jul 08 19:45:45.746212 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.746190 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj"] Jul 08 19:45:45.778824 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.778792 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e24717b8-c02b-453f-b574-9a2b6c0a2804-podres\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.778824 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.778825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e24717b8-c02b-453f-b574-9a2b6c0a2804-proc\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.779035 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.778868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k92hb\" (UniqueName: \"kubernetes.io/projected/e24717b8-c02b-453f-b574-9a2b6c0a2804-kube-api-access-k92hb\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.779035 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.778891 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e24717b8-c02b-453f-b574-9a2b6c0a2804-sys\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.779035 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.778916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e24717b8-c02b-453f-b574-9a2b6c0a2804-lib-modules\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.879427 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.879395 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k92hb\" (UniqueName: \"kubernetes.io/projected/e24717b8-c02b-453f-b574-9a2b6c0a2804-kube-api-access-k92hb\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.879663 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.879445 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e24717b8-c02b-453f-b574-9a2b6c0a2804-sys\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.879663 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.879487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e24717b8-c02b-453f-b574-9a2b6c0a2804-lib-modules\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.879663 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.879578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e24717b8-c02b-453f-b574-9a2b6c0a2804-podres\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.879663 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.879584 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e24717b8-c02b-453f-b574-9a2b6c0a2804-sys\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.879663 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.879608 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e24717b8-c02b-453f-b574-9a2b6c0a2804-proc\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.879874 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.879698 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e24717b8-c02b-453f-b574-9a2b6c0a2804-lib-modules\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.879874 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.879715 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e24717b8-c02b-453f-b574-9a2b6c0a2804-podres\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.879874 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.879708 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e24717b8-c02b-453f-b574-9a2b6c0a2804-proc\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:45.887905 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:45.887879 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k92hb\" (UniqueName: \"kubernetes.io/projected/e24717b8-c02b-453f-b574-9a2b6c0a2804-kube-api-access-k92hb\") pod \"perf-node-gather-daemonset-kg6mj\" (UID: \"e24717b8-c02b-453f-b574-9a2b6c0a2804\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:46.046989 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:46.046898 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:46.181630 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:46.181563 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj"] Jul 08 19:45:46.183865 ip-10-0-128-32 kubenswrapper[2577]: W0708 19:45:46.183833 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode24717b8_c02b_453f_b574_9a2b6c0a2804.slice/crio-d9d18315c1356af0dae951071a03484c74d308e2be92f7ac5d9c11c5d025e8a4 WatchSource:0}: Error finding container d9d18315c1356af0dae951071a03484c74d308e2be92f7ac5d9c11c5d025e8a4: Status 404 returned error can't find the container with id d9d18315c1356af0dae951071a03484c74d308e2be92f7ac5d9c11c5d025e8a4 Jul 08 19:45:46.399823 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:46.399787 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" event={"ID":"e24717b8-c02b-453f-b574-9a2b6c0a2804","Type":"ContainerStarted","Data":"db8165c0eab34f7d07c6c1ecd6a4d5adab81d8d3b338c6afaefdc1160f71783f"} Jul 08 19:45:46.400032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:46.399848 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" event={"ID":"e24717b8-c02b-453f-b574-9a2b6c0a2804","Type":"ContainerStarted","Data":"d9d18315c1356af0dae951071a03484c74d308e2be92f7ac5d9c11c5d025e8a4"} Jul 08 19:45:46.400032 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:46.399902 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:46.415993 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:46.415938 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" podStartSLOduration=1.41591866 podStartE2EDuration="1.41591866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:46.415158199 +0000 UTC m=+2672.021071272" watchObservedRunningTime="2026-07-08 19:45:46.41591866 +0000 UTC m=+2672.021831728" Jul 08 19:45:48.255508 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:48.255476 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s9kjr_8ed4d741-aa0d-4288-9c64-0e6e1e152c1d/dns/0.log" Jul 08 19:45:48.279922 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:48.279888 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s9kjr_8ed4d741-aa0d-4288-9c64-0e6e1e152c1d/kube-rbac-proxy/0.log" Jul 08 19:45:48.429084 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:48.429054 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jf5mb_0a16935f-0d0d-481f-b13d-d795748d25a1/dns-node-resolver/0.log" Jul 08 19:45:48.997135 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:48.997106 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-569654c8c9-q4ckr_0977f4c9-db1e-4e12-afb6-8bb9d513051c/registry/0.log" Jul 08 19:45:49.068704 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:49.068676 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mtzxd_3a33998b-fe43-48ce-ba28-19cfa98a95df/node-ca/0.log" Jul 08 19:45:50.051376 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:50.051343 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wc7ch_776f7577-6c4e-4121-865e-91f50b0131a3/istio-proxy/0.log" Jul 08 19:45:50.217838 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:50.217813 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cd5f7d96-8vmlt_0a7b251a-612a-4904-82b4-2e50b7f0a3cb/kube-auth-proxy/0.log" Jul 08 19:45:50.248573 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:50.248532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-45cbk_ce1676c4-ad5f-40c1-995c-2780154a68a7/istio-proxy/0.log" Jul 08 19:45:50.281409 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:50.281374 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-45cbk_ce1676c4-ad5f-40c1-995c-2780154a68a7/istio-proxy/1.log" Jul 08 19:45:50.321895 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:50.321801 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-vgxqr_d44af44c-c368-4ef9-acf5-8b53fc97bd5f/payload-pre-processing/0.log" Jul 08 19:45:51.096393 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:51.096370 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7v7vg_608f0288-cf38-4eec-832f-f1c1aad2502c/serve-healthcheck-canary/0.log" Jul 08 19:45:51.736962 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:51.736930 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tf76k_717273ff-6667-4f9b-acbb-05b250e4358c/kube-rbac-proxy/0.log" Jul 08 19:45:51.761889 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:51.761858 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tf76k_717273ff-6667-4f9b-acbb-05b250e4358c/exporter/0.log" Jul 08 19:45:51.783132 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:51.783104 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tf76k_717273ff-6667-4f9b-acbb-05b250e4358c/extractor/0.log" Jul 08 19:45:52.414670 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:52.414643 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-kg6mj" Jul 08 19:45:54.101776 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:54.101741 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-t74g8_6f847f97-b488-476b-9ab8-1a7ac75e056b/manager/0.log" Jul 08 19:45:54.479881 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:54.479847 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9dc45487-zshsx_19a589fd-4ec9-4cbb-9306-0298123c10bf/manager/0.log" Jul 08 19:45:54.496737 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:54.496709 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9dc45487-zshsx_19a589fd-4ec9-4cbb-9306-0298123c10bf/copy-manifests/0.log" Jul 08 19:45:55.965175 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:55.965097 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-ff8fc7d87-kzrmv_3da0796d-e92d-4d64-8f45-659c3fd2d10f/manager/0.log" Jul 08 19:45:56.542981 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:56.542946 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wc7ch_776f7577-6c4e-4121-865e-91f50b0131a3/istio-proxy/0.log" Jul 08 19:45:56.666739 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:56.666709 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cd5f7d96-8vmlt_0a7b251a-612a-4904-82b4-2e50b7f0a3cb/kube-auth-proxy/0.log" Jul 08 19:45:56.688769 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:56.688734 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-45cbk_ce1676c4-ad5f-40c1-995c-2780154a68a7/istio-proxy/0.log" Jul 08 19:45:56.718281 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:56.718227 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-45cbk_ce1676c4-ad5f-40c1-995c-2780154a68a7/istio-proxy/1.log" Jul 08 19:45:56.745068 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:56.745034 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-vgxqr_d44af44c-c368-4ef9-acf5-8b53fc97bd5f/payload-pre-processing/0.log" Jul 08 19:45:58.031455 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:58.031425 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wc7ch_776f7577-6c4e-4121-865e-91f50b0131a3/istio-proxy/0.log" Jul 08 19:45:58.167590 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:58.167560 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cd5f7d96-8vmlt_0a7b251a-612a-4904-82b4-2e50b7f0a3cb/kube-auth-proxy/0.log" Jul 08 19:45:58.188622 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:58.188591 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-45cbk_ce1676c4-ad5f-40c1-995c-2780154a68a7/istio-proxy/0.log" Jul 08 19:45:58.222406 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:58.222368 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-45cbk_ce1676c4-ad5f-40c1-995c-2780154a68a7/istio-proxy/1.log" Jul 08 19:45:58.251239 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:45:58.251209 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-vgxqr_d44af44c-c368-4ef9-acf5-8b53fc97bd5f/payload-pre-processing/0.log" Jul 08 19:46:02.789851 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:46:02.789819 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5mjl_1306beae-2a22-4c5b-a1a3-cf0faf472251/kube-multus-additional-cni-plugins/0.log" Jul 08 19:46:02.814831 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:46:02.814797 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5mjl_1306beae-2a22-4c5b-a1a3-cf0faf472251/egress-router-binary-copy/0.log" Jul 08 19:46:02.835987 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:46:02.835962 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5mjl_1306beae-2a22-4c5b-a1a3-cf0faf472251/cni-plugins/0.log" Jul 08 19:46:02.859948 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:46:02.859917 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5mjl_1306beae-2a22-4c5b-a1a3-cf0faf472251/bond-cni-plugin/0.log" Jul 08 19:46:02.882717 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:46:02.882694 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5mjl_1306beae-2a22-4c5b-a1a3-cf0faf472251/routeoverride-cni/0.log" Jul 08 19:46:02.906721 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:46:02.906685 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5mjl_1306beae-2a22-4c5b-a1a3-cf0faf472251/whereabouts-cni-bincopy/0.log" Jul 08 19:46:02.927881 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:46:02.927848 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5mjl_1306beae-2a22-4c5b-a1a3-cf0faf472251/whereabouts-cni/0.log" Jul 08 19:46:03.121095 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:46:03.121066 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bmxct_0567a65b-384d-4e96-80cb-2387578db093/kube-multus/0.log" Jul 08 19:46:03.140650 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:46:03.140619 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gkpxk_7578bca4-894d-4728-91c6-58a80610d546/network-metrics-daemon/0.log" Jul 08 19:46:03.160809 ip-10-0-128-32 kubenswrapper[2577]: I0708 19:46:03.160778 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gkpxk_7578bca4-894d-4728-91c6-58a80610d546/kube-rbac-proxy/0.log"