Jul 24 00:13:58.901352 ip-10-0-130-20 systemd[1]: Starting Kubernetes Kubelet... Jul 24 00:13:59.223882 ip-10-0-130-20 kubenswrapper[2588]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 00:13:59.223882 ip-10-0-130-20 kubenswrapper[2588]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 00:13:59.223882 ip-10-0-130-20 kubenswrapper[2588]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 00:13:59.223882 ip-10-0-130-20 kubenswrapper[2588]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 00:13:59.223882 ip-10-0-130-20 kubenswrapper[2588]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 00:13:59.224650 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.224564 2588 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 00:13:59.228472 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228457 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 00:13:59.228472 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228472 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228477 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228481 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228483 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228486 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228489 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228491 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228494 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228497 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228499 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228502 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228504 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228507 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228511 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228515 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228518 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228526 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228530 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 00:13:59.228525 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228533 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228536 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228539 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228541 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228544 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228546 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228549 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228552 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228554 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228557 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228559 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228562 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228565 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228567 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228570 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228572 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228575 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228578 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228581 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228583 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 00:13:59.228960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228586 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228588 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228591 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228593 2588 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228596 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228598 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228600 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228603 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228605 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228608 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228610 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228613 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228615 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228618 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228622 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228625 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228627 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228630 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228632 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 00:13:59.229448 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228635 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228637 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228640 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228642 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228645 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228647 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228650 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228662 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228666 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228668 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228671 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228674 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228676 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228679 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228681 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228684 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228686 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228689 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228691 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228694 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 00:13:59.229892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228697 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228700 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228702 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228707 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228710 2588 feature_gate.go:328] unrecognized feature gate: Example Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228714 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228717 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228720 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228723 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228726 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228729 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228732 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228735 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228737 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228740 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228742 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228745 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228748 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228750 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 00:13:59.230548 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228753 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.228755 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229458 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229464 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229467 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229470 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229472 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229475 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229478 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229480 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229483 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229486 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229488 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229491 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229493 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229496 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229499 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229502 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229504 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229508 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 00:13:59.231224 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229511 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229516 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229519 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229522 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229525 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229528 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229531 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229534 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229537 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229540 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229542 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229545 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229547 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229550 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229552 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229555 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229558 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229560 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229563 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229566 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 00:13:59.231741 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229568 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229571 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229574 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229576 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229579 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229581 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229584 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229586 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229589 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229592 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229594 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229598 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229601 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229604 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229606 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229609 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229611 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229614 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229616 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 00:13:59.232237 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229619 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229621 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229624 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229627 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229629 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229631 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229635 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229639 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229642 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229644 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229647 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229650 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229653 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229655 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229658 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229660 2588 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229663 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229665 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229671 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 00:13:59.232704 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229673 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229676 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229680 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229682 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229686 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229689 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229692 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229694 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229697 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229699 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229703 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229707 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229709 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229712 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229714 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229717 2588 feature_gate.go:328] unrecognized feature gate: Example Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229720 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229722 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229725 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 00:13:59.233193 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229727 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229729 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229732 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.229734 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230476 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230488 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230493 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230498 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230502 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230506 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230511 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230515 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230521 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230532 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230536 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230543 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230549 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230554 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230559 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230564 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 00:13:59.233641 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230570 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230575 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230579 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230584 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230588 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230597 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230601 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230605 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230609 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230614 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230618 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230623 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230626 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230631 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230635 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230640 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230644 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230648 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230656 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 00:13:59.234154 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230661 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230665 2588 feature_gate.go:328] unrecognized feature gate: Example Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230669 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230673 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230678 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230684 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230688 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230695 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230701 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230705 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230711 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230715 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230725 2588 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230729 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230735 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230739 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230745 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230752 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230758 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 00:13:59.234636 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230762 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230767 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230771 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230775 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230784 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230789 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230793 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230797 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230802 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230806 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230810 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230815 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230819 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230824 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230828 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230832 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230843 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230847 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230852 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230857 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 00:13:59.235277 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230861 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230866 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230871 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230875 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230879 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230883 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230887 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230892 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230902 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230906 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230910 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230915 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230919 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230923 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230927 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230932 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230936 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230941 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230982 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230988 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 00:13:59.235960 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.230992 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231002 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231006 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231011 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231015 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231270 2588 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231295 2588 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231304 2588 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231309 2588 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231313 2588 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231317 2588 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231321 2588 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231327 2588 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231330 2588 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231333 2588 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231336 2588 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231340 2588 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231343 2588 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231346 2588 flags.go:64] FLAG: --cgroup-root="" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231348 2588 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231352 2588 flags.go:64] FLAG: --client-ca-file="" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231354 2588 flags.go:64] FLAG: --cloud-provider="external" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231357 2588 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231362 2588 flags.go:64] FLAG: --cluster-domain="" Jul 24 00:13:59.236772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231365 2588 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231369 2588 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231372 2588 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231376 2588 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231379 2588 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231382 2588 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231385 2588 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231389 2588 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231392 2588 flags.go:64] FLAG: --contention-profiling="false" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231395 2588 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231398 2588 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231401 2588 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231404 2588 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231408 2588 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231411 2588 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231414 2588 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231417 2588 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231420 2588 flags.go:64] FLAG: --enable-server="true" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231423 2588 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231433 2588 flags.go:64] FLAG: --event-burst="100" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231438 2588 flags.go:64] FLAG: --event-qps="50" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231441 2588 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231444 2588 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231447 2588 flags.go:64] FLAG: --eviction-hard="" Jul 24 00:13:59.237742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231451 2588 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231454 2588 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231457 2588 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231460 2588 flags.go:64] FLAG: --eviction-soft="" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231462 2588 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231465 2588 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231468 2588 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231471 2588 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231474 2588 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231477 2588 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231480 2588 flags.go:64] FLAG: --feature-gates="" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231484 2588 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231486 2588 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231489 2588 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231492 2588 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231495 2588 flags.go:64] FLAG: --healthz-port="10248" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231498 2588 flags.go:64] FLAG: --help="false" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231502 2588 flags.go:64] FLAG: --hostname-override="ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231505 2588 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231508 2588 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231511 2588 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231514 2588 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231518 2588 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231522 2588 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 00:13:59.238669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231525 2588 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231527 2588 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231530 2588 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231533 2588 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231537 2588 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231540 2588 flags.go:64] FLAG: --kube-reserved="" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231543 2588 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231546 2588 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231549 2588 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231552 2588 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231554 2588 flags.go:64] FLAG: --lock-file="" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231557 2588 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231560 2588 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231563 2588 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231568 2588 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231571 2588 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231580 2588 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231583 2588 flags.go:64] FLAG: --logging-format="text" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231586 2588 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231589 2588 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231592 2588 flags.go:64] FLAG: --manifest-url="" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231595 2588 flags.go:64] FLAG: --manifest-url-header="" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231600 2588 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231603 2588 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231607 2588 flags.go:64] FLAG: --max-pods="110" Jul 24 00:13:59.239759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231611 2588 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231614 2588 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231617 2588 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231620 2588 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231623 2588 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231625 2588 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231628 2588 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231636 2588 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231639 2588 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231642 2588 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231645 2588 flags.go:64] FLAG: --pod-cidr="" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231650 2588 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231656 2588 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231659 2588 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231662 2588 flags.go:64] FLAG: --pods-per-core="0" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231665 2588 flags.go:64] FLAG: --port="10250" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231668 2588 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231671 2588 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-098b37a12489340e3" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231674 2588 flags.go:64] FLAG: --qos-reserved="" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231677 2588 flags.go:64] FLAG: --read-only-port="10255" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231680 2588 flags.go:64] FLAG: --register-node="true" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231683 2588 flags.go:64] FLAG: --register-with-taints="" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231687 2588 flags.go:64] FLAG: --registry-burst="10" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231689 2588 flags.go:64] FLAG: --registry-qps="5" Jul 24 00:13:59.240817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231698 2588 flags.go:64] FLAG: --reserved-cpus="" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231701 2588 flags.go:64] FLAG: --reserved-memory="" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231704 2588 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231707 2588 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231710 2588 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231713 2588 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231716 2588 flags.go:64] FLAG: --runonce="false" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231718 2588 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231722 2588 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231725 2588 flags.go:64] FLAG: --seccomp-default="false" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231728 2588 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231731 2588 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231734 2588 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231737 2588 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231740 2588 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231742 2588 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231745 2588 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231748 2588 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231751 2588 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231755 2588 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231760 2588 flags.go:64] FLAG: --system-cgroups="" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231763 2588 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231769 2588 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231772 2588 flags.go:64] FLAG: --tls-cert-file="" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231775 2588 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 00:13:59.241853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231781 2588 flags.go:64] FLAG: --tls-min-version="" Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231784 2588 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231787 2588 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231790 2588 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231792 2588 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231795 2588 flags.go:64] FLAG: --v="2" Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231799 2588 flags.go:64] FLAG: --version="false" Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231803 2588 flags.go:64] FLAG: --vmodule="" Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231812 2588 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.231816 2588 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231929 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231933 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231937 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231941 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231944 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231948 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231951 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231954 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231956 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231959 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231961 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231964 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 00:13:59.242892 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231967 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231969 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231972 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231975 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231977 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231981 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231984 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231986 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231989 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231992 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231994 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231997 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.231999 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232002 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232005 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232007 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232010 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232013 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232015 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232023 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 00:13:59.243620 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232026 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232028 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232031 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232034 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232036 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232040 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232043 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232045 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232047 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232050 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232053 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232056 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232058 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232060 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232063 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232065 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232068 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232073 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232092 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232095 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 00:13:59.244535 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232098 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232100 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232103 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232106 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232108 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232111 2588 feature_gate.go:328] unrecognized feature gate: Example Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232114 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232116 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232119 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232121 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232124 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232126 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232135 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232137 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232140 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232143 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232147 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232152 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232155 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 00:13:59.245188 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232158 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232161 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232164 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232167 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232170 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232172 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232175 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232177 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232180 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232183 2588 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232186 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232189 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232192 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232194 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232197 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232199 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232202 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232204 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232207 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 00:13:59.245799 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232209 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232212 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232215 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232217 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232220 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232222 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232226 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232234 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.232238 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.232781 2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.241240 2588 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.241261 2588 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.241288 2588 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.241301 2588 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 00:13:59.246330 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241391 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241399 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241405 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241410 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241414 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241419 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241423 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241428 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241432 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241436 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241440 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241445 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241449 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241453 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241458 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241462 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241466 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241470 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241474 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 00:13:59.246678 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241478 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241483 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241487 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241491 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241495 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241500 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241504 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241508 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241512 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241517 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241523 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241528 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241533 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241539 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241545 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241550 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241554 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241558 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241562 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 00:13:59.247207 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241566 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241571 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241575 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241580 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241584 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241588 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241592 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241597 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241601 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241605 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241609 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241614 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241619 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241623 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241627 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241632 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241637 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241641 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241645 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241649 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 00:13:59.247720 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241653 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241657 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241662 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241666 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241675 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241680 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241684 2588 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241689 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241693 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241697 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241701 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241706 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241710 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241714 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241719 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241723 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241728 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241732 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241736 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241741 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 00:13:59.248265 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241746 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241752 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241758 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241763 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241768 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241772 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241777 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241781 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241786 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241790 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241794 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241798 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241802 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241806 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241810 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241815 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241819 2588 feature_gate.go:328] unrecognized feature gate: Example Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241827 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241833 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 00:13:59.248750 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241838 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.241842 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.241850 2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242053 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242061 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242066 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242071 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242093 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242098 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242102 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242106 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242111 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242118 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242124 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 00:13:59.249537 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242129 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242136 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242142 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242146 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242151 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242155 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242160 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242164 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242169 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242173 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242177 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242182 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242186 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242190 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242194 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242198 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242202 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242208 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242212 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 00:13:59.249936 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242216 2588 feature_gate.go:328] unrecognized feature gate: Example Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242220 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242224 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242228 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242233 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242237 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242241 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242245 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242250 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242254 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242258 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242263 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242267 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242271 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242275 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242279 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242284 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242289 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242296 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 00:13:59.250568 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242301 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242305 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242309 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242314 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242318 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242322 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242326 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242330 2588 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242335 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242339 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242343 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242347 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242353 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242357 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242361 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242365 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242369 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242374 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242378 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242382 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 00:13:59.251192 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242386 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242390 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242394 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242398 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242402 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242406 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242411 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242415 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242419 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242423 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242428 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242432 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242437 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242441 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242445 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242449 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242454 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242458 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242462 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242466 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 00:13:59.251765 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242470 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242474 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242479 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242482 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242487 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242496 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242500 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242505 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242509 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:13:59.242513 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.242521 2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.242686 2588 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.245406 2588 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.246727 2588 server.go:1019] "Starting client certificate rotation" Jul 24 00:13:59.252599 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.246833 2588 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 00:13:59.252978 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.246870 2588 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 00:13:59.252978 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.249584 2588 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 00:13:59.253057 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.253041 2588 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 00:13:59.263347 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.263324 2588 log.go:25] "Validated CRI v1 runtime API" Jul 24 00:13:59.265485 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.265468 2588 log.go:25] "Validated CRI v1 image API" Jul 24 00:13:59.266407 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.266384 2588 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 00:13:59.271470 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.271450 2588 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e1025a72-d09b-4196-ba5a-b3f5738a3c47:/dev/nvme0n1p4 f3a815e5-56ee-4bad-95ff-acbdcdca1f9c:/dev/nvme0n1p3] Jul 24 00:13:59.271531 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.271469 2588 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 00:13:59.275954 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.275937 2588 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 00:13:59.276606 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.276498 2588 manager.go:216] Machine: {Timestamp:2026-07-24 00:13:59.275368058 +0000 UTC m=+0.278927397 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3080334 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec241d599e549474bec59527fc0b0e3d SystemUUID:ec241d59-9e54-9474-bec5-9527fc0b0e3d BootID:2b759345-dcb0-4210-8ddf-13910338f963 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fa:b9:29:c9:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fa:b9:29:c9:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:7d:44:c2:bf:1a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 00:13:59.276606 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.276603 2588 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 00:13:59.276720 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.276708 2588 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 00:13:59.279104 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.279060 2588 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 00:13:59.279243 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.279108 2588 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-20.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 00:13:59.279774 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.279765 2588 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 00:13:59.279806 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.279777 2588 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 00:13:59.279806 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.279784 2588 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 00:13:59.280368 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.280358 2588 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 00:13:59.281640 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.281629 2588 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 00:13:59.285783 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.285771 2588 state_mem.go:36] "Initialized new in-memory state store" Jul 24 00:13:59.285926 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.285917 2588 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 00:13:59.285963 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.285955 2588 kubelet.go:486] "Attempting to sync node with API server" Jul 24 00:13:59.285991 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.285967 2588 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 00:13:59.285991 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.285978 2588 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 00:13:59.285991 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.285986 2588 kubelet.go:398] "Adding apiserver pod source" Jul 24 00:13:59.286072 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.285994 2588 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 00:13:59.286445 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.286435 2588 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 00:13:59.286492 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.286452 2588 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 00:13:59.288407 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.288387 2588 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 00:13:59.290029 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290016 2588 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 00:13:59.290065 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290046 2588 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 00:13:59.290686 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290674 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 00:13:59.290724 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290692 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 00:13:59.290724 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290702 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 00:13:59.290724 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290709 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 00:13:59.290724 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290722 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 00:13:59.290827 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290729 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 00:13:59.290827 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290741 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 00:13:59.290827 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290750 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 00:13:59.290827 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290760 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 00:13:59.290827 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290767 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 00:13:59.290827 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290786 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 00:13:59.290827 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.290792 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 00:13:59.291389 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.291379 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 00:13:59.291389 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.291390 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 00:13:59.294858 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.294834 2588 server.go:1268] "Started kubelet" Jul 24 00:13:59.295135 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.294973 2588 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 00:13:59.295135 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.294950 2588 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 00:13:59.295135 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.295030 2588 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 00:13:59.297339 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.297309 2588 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 00:13:59.297442 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.297373 2588 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-20.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 00:13:59.297410 ip-10-0-130-20 systemd[1]: Started Kubernetes Kubelet. Jul 24 00:13:59.297681 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.297485 2588 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 00:13:59.297681 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.297493 2588 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-20.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 00:13:59.299529 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.299440 2588 server.go:310] "Adding debug handlers to kubelet server" Jul 24 00:13:59.302414 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.302393 2588 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 00:13:59.302812 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.302090 2588 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-20.ec2.internal.18c5117922c970d1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-20.ec2.internal,UID:ip-10-0-130-20.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-20.ec2.internal,},FirstTimestamp:2026-07-24 00:13:59.294611665 +0000 UTC m=+0.298171003,LastTimestamp:2026-07-24 00:13:59.294611665 +0000 UTC m=+0.298171003,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-20.ec2.internal,}" Jul 24 00:13:59.303445 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.303431 2588 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zx222" Jul 24 00:13:59.307104 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.307069 2588 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 00:13:59.307104 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.307097 2588 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 00:13:59.307246 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.307166 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:13:59.307586 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.307570 2588 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 00:13:59.307697 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.307672 2588 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 00:13:59.307795 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.307574 2588 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 00:13:59.307795 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.307783 2588 reconstruct.go:97] "Volume reconstruction finished" Jul 24 00:13:59.307795 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.307789 2588 reconciler.go:29] "Reconciler: start to sync state" Jul 24 00:13:59.308096 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.308068 2588 factory.go:153] Registering CRI-O factory Jul 24 00:13:59.308096 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.308096 2588 factory.go:223] Registration of the crio container factory successfully Jul 24 00:13:59.308264 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.308142 2588 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 00:13:59.308264 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.308152 2588 factory.go:55] Registering systemd factory Jul 24 00:13:59.308264 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.308159 2588 factory.go:223] Registration of the systemd container factory successfully Jul 24 00:13:59.308264 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.308179 2588 factory.go:103] Registering Raw factory Jul 24 00:13:59.308264 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.308190 2588 manager.go:1196] Started watching for new ooms in manager Jul 24 00:13:59.308584 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.308572 2588 manager.go:349] Starting recovery of all containers Jul 24 00:13:59.308995 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.308973 2588 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zx222" Jul 24 00:13:59.317909 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.317885 2588 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 00:13:59.318707 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.318688 2588 manager.go:354] Recovery completed Jul 24 00:13:59.320969 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.320949 2588 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-20.ec2.internal\" not found" node="ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.323268 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.323254 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 00:13:59.325147 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.325131 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientMemory" Jul 24 00:13:59.325230 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.325165 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 00:13:59.325230 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.325183 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientPID" Jul 24 00:13:59.325825 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.325811 2588 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 00:13:59.325906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.325824 2588 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 00:13:59.325906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.325844 2588 state_mem.go:36] "Initialized new in-memory state store" Jul 24 00:13:59.325906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.325851 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 00:13:59.326624 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.326609 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientMemory" Jul 24 00:13:59.326684 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.326630 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 00:13:59.326684 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.326644 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientPID" Jul 24 00:13:59.328113 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.328072 2588 policy_none.go:49] "None policy: Start" Jul 24 00:13:59.328189 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.328117 2588 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 00:13:59.328189 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.328131 2588 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 00:13:59.330302 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.330288 2588 policy_none.go:47] "Start" Jul 24 00:13:59.371793 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.371653 2588 manager.go:337] "Starting Device Plugin manager" Jul 24 00:13:59.371896 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.371815 2588 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 00:13:59.371896 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.371828 2588 server.go:87] "Starting device plugin registration server" Jul 24 00:13:59.372124 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.372111 2588 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 00:13:59.372187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.372126 2588 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 00:13:59.372260 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.372236 2588 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 00:13:59.372337 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.372324 2588 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 00:13:59.372337 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.372338 2588 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 00:13:59.372871 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.372844 2588 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 00:13:59.372950 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.372887 2588 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:13:59.469522 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.469488 2588 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 00:13:59.471689 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.470652 2588 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 00:13:59.471689 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.470687 2588 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 00:13:59.471689 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.470708 2588 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 00:13:59.471689 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.470739 2588 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 00:13:59.472330 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.472309 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 00:13:59.473240 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.473220 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientMemory" Jul 24 00:13:59.473319 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.473258 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 00:13:59.473319 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.473277 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientPID" Jul 24 00:13:59.473319 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.473314 2588 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.473427 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.473227 2588 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 00:13:59.480170 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.480126 2588 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.480170 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.480147 2588 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-20.ec2.internal\": node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:13:59.496483 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.496464 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:13:59.571682 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.571644 2588 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-20.ec2.internal"] Jul 24 00:13:59.571792 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.571727 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 00:13:59.573069 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.573052 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientMemory" Jul 24 00:13:59.573168 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.573100 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 00:13:59.573168 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.573111 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientPID" Jul 24 00:13:59.575513 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.575499 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 00:13:59.575637 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.575624 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.575674 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.575655 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 00:13:59.576753 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.576739 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientMemory" Jul 24 00:13:59.576808 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.576760 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientMemory" Jul 24 00:13:59.576808 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.576782 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 00:13:59.576808 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.576792 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientPID" Jul 24 00:13:59.576909 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.576765 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 00:13:59.576909 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.576844 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientPID" Jul 24 00:13:59.579152 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.579135 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.579205 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.579168 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 00:13:59.579895 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.579882 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientMemory" Jul 24 00:13:59.579954 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.579917 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 00:13:59.579954 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.579926 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeHasSufficientPID" Jul 24 00:13:59.597577 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.597556 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:13:59.605860 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.605839 2588 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-20.ec2.internal\" not found" node="ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.609321 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.609295 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22fd7258d42e3c88809b91d36bbeabd9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal\" (UID: \"22fd7258d42e3c88809b91d36bbeabd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.609396 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.609328 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22fd7258d42e3c88809b91d36bbeabd9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal\" (UID: \"22fd7258d42e3c88809b91d36bbeabd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.609396 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.609348 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/37633424d4f98b6e44a2f77092ebb963-config\") pod \"kube-apiserver-proxy-ip-10-0-130-20.ec2.internal\" (UID: \"37633424d4f98b6e44a2f77092ebb963\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.610470 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.610455 2588 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-20.ec2.internal\" not found" node="ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.697976 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.697938 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:13:59.710339 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.710310 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/37633424d4f98b6e44a2f77092ebb963-config\") pod \"kube-apiserver-proxy-ip-10-0-130-20.ec2.internal\" (UID: \"37633424d4f98b6e44a2f77092ebb963\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.710437 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.710346 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22fd7258d42e3c88809b91d36bbeabd9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal\" (UID: \"22fd7258d42e3c88809b91d36bbeabd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.710437 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.710369 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22fd7258d42e3c88809b91d36bbeabd9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal\" (UID: \"22fd7258d42e3c88809b91d36bbeabd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.710437 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.710407 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/37633424d4f98b6e44a2f77092ebb963-config\") pod \"kube-apiserver-proxy-ip-10-0-130-20.ec2.internal\" (UID: \"37633424d4f98b6e44a2f77092ebb963\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.710437 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.710429 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22fd7258d42e3c88809b91d36bbeabd9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal\" (UID: \"22fd7258d42e3c88809b91d36bbeabd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.710586 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.710493 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22fd7258d42e3c88809b91d36bbeabd9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal\" (UID: \"22fd7258d42e3c88809b91d36bbeabd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.798310 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.798236 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:13:59.905616 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:13:59.905573 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:13:59.907954 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.907927 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" Jul 24 00:13:59.913954 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:13:59.913616 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-20.ec2.internal" Jul 24 00:14:00.008497 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:00.008438 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:14:00.114901 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:00.114828 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:14:00.214955 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:00.214913 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:14:00.247565 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:00.247513 2588 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 00:14:00.248056 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:00.247749 2588 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 00:14:00.248056 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:00.247778 2588 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 00:14:00.313862 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:00.313818 2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 00:08:59 +0000 UTC" deadline="2028-04-23 22:01:03.866792162 +0000 UTC" Jul 24 00:14:00.313862 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:00.313855 2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15357h47m3.55294258s" Jul 24 00:14:00.315003 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:00.314978 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:14:00.342498 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:00.342471 2588 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 00:14:00.415372 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:00.415298 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:14:00.516381 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:00.516350 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:14:00.617102 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:00.617065 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:14:00.717442 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:00.717359 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-20.ec2.internal\" not found" Jul 24 00:14:00.731320 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:00.731299 2588 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 00:14:00.739748 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:00.739719 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37633424d4f98b6e44a2f77092ebb963.slice/crio-1b77ab69e3820c4865abe475bf0a587fdbaf8096ef8e6331bb9e52bf110f1195 WatchSource:0}: Error finding container 1b77ab69e3820c4865abe475bf0a587fdbaf8096ef8e6331bb9e52bf110f1195: Status 404 returned error can't find the container with id 1b77ab69e3820c4865abe475bf0a587fdbaf8096ef8e6331bb9e52bf110f1195 Jul 24 00:14:00.744922 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:00.744905 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 00:14:00.808758 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:00.808726 2588 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" Jul 24 00:14:00.819956 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:00.819935 2588 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 00:14:00.820815 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:00.820801 2588 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-20.ec2.internal" Jul 24 00:14:00.829430 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:00.829416 2588 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 00:14:01.231440 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.231414 2588 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 00:14:01.289441 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.289415 2588 apiserver.go:52] "Watching apiserver" Jul 24 00:14:01.297622 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.297596 2588 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 00:14:01.298565 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.298542 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jnljx","openshift-cluster-node-tuning-operator/tuned-m7wqq","openshift-dns/node-resolver-b2mj5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal","openshift-multus/multus-f9gwf","openshift-multus/network-metrics-daemon-xbmxv","openshift-network-diagnostics/network-check-target-z6qkx","openshift-network-operator/iptables-alerter-gjthg","kube-system/konnectivity-agent-2zcbw","kube-system/kube-apiserver-proxy-ip-10-0-130-20.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555","openshift-image-registry/node-ca-p45bc","openshift-multus/multus-additional-cni-plugins-8b9tv","openshift-ovn-kubernetes/ovnkube-node-48hd9"] Jul 24 00:14:01.302439 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.302416 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.304712 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.304684 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.304969 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.304947 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 00:14:01.305173 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.305140 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xd2hx\"" Jul 24 00:14:01.305394 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.305377 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 00:14:01.305474 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.305458 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 00:14:01.305515 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.305470 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 00:14:01.305558 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.305459 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 00:14:01.306954 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.306929 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b2mj5" Jul 24 00:14:01.307043 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.307025 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 00:14:01.307400 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.307379 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j92ws\"" Jul 24 00:14:01.307506 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.307439 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 00:14:01.308265 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.308246 2588 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 00:14:01.309193 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.309169 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:01.309354 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.309265 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:01.309503 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.309376 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 00:14:01.311593 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.311571 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.313887 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.313869 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:01.313963 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.313948 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:01.316285 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.316268 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:01.316639 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.316593 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:01.319843 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.319824 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8l6np\"" Jul 24 00:14:01.320224 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320204 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-lib-modules\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.320305 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320242 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-var-lib-kubelet\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.320305 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320273 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjlhw\" (UniqueName: \"kubernetes.io/projected/f96ed08f-e197-4605-9703-822195dec9c7-kube-api-access-zjlhw\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.320383 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320327 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f96ed08f-e197-4605-9703-822195dec9c7-system-cni-dir\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.320383 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320353 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-run\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.320447 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320384 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08c5b538-ad01-4f75-968c-29815481568b-etc-tuned\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.320447 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320400 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08c5b538-ad01-4f75-968c-29815481568b-tmp\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.320447 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320414 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-kubernetes\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.320447 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320427 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-sysctl-d\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.320447 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320442 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff5b60fa-0e53-444d-935f-7aaae67eee3e-hosts-file\") pod \"node-resolver-b2mj5\" (UID: \"ff5b60fa-0e53-444d-935f-7aaae67eee3e\") " pod="openshift-dns/node-resolver-b2mj5" Jul 24 00:14:01.320690 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320457 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-dbus\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:01.320690 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320472 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:01.320690 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320499 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-modprobe-d\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.320690 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320544 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-sysctl-conf\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.320690 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320578 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-systemd\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.320690 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320605 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-sys\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.320690 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320624 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kprzk\" (UniqueName: \"kubernetes.io/projected/ff5b60fa-0e53-444d-935f-7aaae67eee3e-kube-api-access-kprzk\") pod \"node-resolver-b2mj5\" (UID: \"ff5b60fa-0e53-444d-935f-7aaae67eee3e\") " pod="openshift-dns/node-resolver-b2mj5" Jul 24 00:14:01.320690 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320645 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f96ed08f-e197-4605-9703-822195dec9c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.320690 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320660 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f96ed08f-e197-4605-9703-822195dec9c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.320690 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320675 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7djgp\" (UniqueName: \"kubernetes.io/projected/08c5b538-ad01-4f75-968c-29815481568b-kube-api-access-7djgp\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.320690 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320692 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-kubelet-config\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:01.321217 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320714 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gjthg" Jul 24 00:14:01.321217 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320718 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f96ed08f-e197-4605-9703-822195dec9c7-os-release\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.321217 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320941 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f96ed08f-e197-4605-9703-822195dec9c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.321217 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320961 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-sysconfig\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.321217 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320975 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-host\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.321217 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.320990 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff5b60fa-0e53-444d-935f-7aaae67eee3e-tmp-dir\") pod \"node-resolver-b2mj5\" (UID: \"ff5b60fa-0e53-444d-935f-7aaae67eee3e\") " pod="openshift-dns/node-resolver-b2mj5" Jul 24 00:14:01.321217 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.321004 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f96ed08f-e197-4605-9703-822195dec9c7-cnibin\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.321217 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.321019 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f96ed08f-e197-4605-9703-822195dec9c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.322865 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.322845 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 00:14:01.323067 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.323053 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2zcbw" Jul 24 00:14:01.325611 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.325585 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.328068 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.328049 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.330540 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.330521 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p45bc" Jul 24 00:14:01.334639 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.334493 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 00:14:01.335261 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.335226 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fkmfl\"" Jul 24 00:14:01.335650 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.335627 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 00:14:01.335760 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.335699 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 00:14:01.335760 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.335712 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 00:14:01.336074 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.336056 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 00:14:01.336391 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.336376 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 00:14:01.336478 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.336388 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 00:14:01.336478 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.336414 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 00:14:01.336478 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.336380 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 00:14:01.336478 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.336433 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 00:14:01.336976 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.336956 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 00:14:01.336976 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.336969 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 00:14:01.337129 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.337036 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 00:14:01.337129 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.337066 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 00:14:01.337250 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.337148 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 00:14:01.337316 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.337293 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 00:14:01.337593 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.337575 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 00:14:01.337692 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.337621 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-42ml2\"" Jul 24 00:14:01.337918 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.337897 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zlm2t\"" Jul 24 00:14:01.337993 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.337932 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6r6tj\"" Jul 24 00:14:01.337993 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.337939 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 00:14:01.338098 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.337896 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c4vct\"" Jul 24 00:14:01.340173 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.340154 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9fc75\"" Jul 24 00:14:01.353875 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.353855 2588 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 00:14:01.382426 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.382400 2588 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8xjnj" Jul 24 00:14:01.390349 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.390327 2588 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8xjnj" Jul 24 00:14:01.408642 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.408621 2588 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 00:14:01.421215 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421185 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49d3d12c-13f1-42ff-8685-40a6a459b43f-ovnkube-config\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.421309 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421221 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-kubelet-config\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:01.421309 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421241 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-host\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.421309 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421259 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/520a9c02-7a49-49ae-a98e-383f7d354eb6-cni-binary-copy\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.421309 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421276 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:01.421309 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421295 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-run-ovn\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.421309 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421310 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-cni-netd\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421316 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-kubelet-config\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421327 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f96ed08f-e197-4605-9703-822195dec9c7-cnibin\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421317 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-host\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421351 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-run-k8s-cni-cncf-io\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421368 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f96ed08f-e197-4605-9703-822195dec9c7-cnibin\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421375 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/520a9c02-7a49-49ae-a98e-383f7d354eb6-multus-daemon-config\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421396 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4kls\" (UniqueName: \"kubernetes.io/projected/520a9c02-7a49-49ae-a98e-383f7d354eb6-kube-api-access-s4kls\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421412 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-run-netns\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421426 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-run-openvswitch\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421460 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-cni-bin\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421497 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49d3d12c-13f1-42ff-8685-40a6a459b43f-env-overrides\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421532 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-lib-modules\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421560 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n92g9\" (UniqueName: \"kubernetes.io/projected/49d3d12c-13f1-42ff-8685-40a6a459b43f-kube-api-access-n92g9\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.421590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421586 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-etc-selinux\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421610 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw2kh\" (UniqueName: \"kubernetes.io/projected/a60f006d-3574-472d-85b1-ae2921f52ac3-kube-api-access-lw2kh\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421626 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-lib-modules\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421638 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqqvb\" (UniqueName: \"kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb\") pod \"network-check-target-z6qkx\" (UID: \"f7fe8ab4-f1db-40ab-8c20-92c6210bfe59\") " pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421664 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l78rq\" (UniqueName: \"kubernetes.io/projected/c680d364-22c9-4026-8364-19ad2fa7a6c7-kube-api-access-l78rq\") pod \"node-ca-p45bc\" (UID: \"c680d364-22c9-4026-8364-19ad2fa7a6c7\") " pod="openshift-image-registry/node-ca-p45bc" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421691 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-device-dir\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421718 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-run\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421783 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-slash\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421810 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-node-log\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421835 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-log-socket\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421852 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-run\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421859 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-sys-fs\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421889 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-sysctl-d\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421909 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-dbus\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421942 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421985 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-system-cni-dir\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.421991 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-sysctl-d\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.422187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422009 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-var-lib-cni-multus\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422039 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-modprobe-d\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422058 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-systemd\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.422078 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422127 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-dbus\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422079 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kprzk\" (UniqueName: \"kubernetes.io/projected/ff5b60fa-0e53-444d-935f-7aaae67eee3e-kube-api-access-kprzk\") pod \"node-resolver-b2mj5\" (UID: \"ff5b60fa-0e53-444d-935f-7aaae67eee3e\") " pod="openshift-dns/node-resolver-b2mj5" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.422163 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret podName:4dda38d3-0c29-499b-93bd-b9accf7c4cb3 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:01.922143784 +0000 UTC m=+2.925703134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret") pod "global-pull-secret-syncer-jnljx" (UID: "4dda38d3-0c29-499b-93bd-b9accf7c4cb3") : object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422177 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-systemd\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422178 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-modprobe-d\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422215 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f96ed08f-e197-4605-9703-822195dec9c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422245 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f96ed08f-e197-4605-9703-822195dec9c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422263 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-multus-conf-dir\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422278 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-etc-kubernetes\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422307 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-run-systemd\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422357 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7djgp\" (UniqueName: \"kubernetes.io/projected/08c5b538-ad01-4f75-968c-29815481568b-kube-api-access-7djgp\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422382 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f96ed08f-e197-4605-9703-822195dec9c7-os-release\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422412 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f96ed08f-e197-4605-9703-822195dec9c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.423014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422433 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f96ed08f-e197-4605-9703-822195dec9c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422440 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-cnibin\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422466 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-multus-socket-dir-parent\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422501 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1c4df35-cf17-44bf-b476-7b25c1c95397-host-slash\") pod \"iptables-alerter-gjthg\" (UID: \"f1c4df35-cf17-44bf-b476-7b25c1c95397\") " pod="openshift-network-operator/iptables-alerter-gjthg" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422501 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f96ed08f-e197-4605-9703-822195dec9c7-os-release\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422551 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422599 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49d3d12c-13f1-42ff-8685-40a6a459b43f-ovn-node-metrics-cert\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422633 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-sysconfig\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422660 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff5b60fa-0e53-444d-935f-7aaae67eee3e-tmp-dir\") pod \"node-resolver-b2mj5\" (UID: \"ff5b60fa-0e53-444d-935f-7aaae67eee3e\") " pod="openshift-dns/node-resolver-b2mj5" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422686 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-os-release\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422709 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-sysconfig\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422714 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b7d8694d-a56d-416e-9fcb-174284b8afc1-konnectivity-ca\") pod \"konnectivity-agent-2zcbw\" (UID: \"b7d8694d-a56d-416e-9fcb-174284b8afc1\") " pod="kube-system/konnectivity-agent-2zcbw" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422762 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-socket-dir\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422787 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f96ed08f-e197-4605-9703-822195dec9c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422793 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f96ed08f-e197-4605-9703-822195dec9c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422828 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-kubelet\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422873 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c680d364-22c9-4026-8364-19ad2fa7a6c7-serviceca\") pod \"node-ca-p45bc\" (UID: \"c680d364-22c9-4026-8364-19ad2fa7a6c7\") " pod="openshift-image-registry/node-ca-p45bc" Jul 24 00:14:01.423757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422911 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-var-lib-kubelet\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422960 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlhw\" (UniqueName: \"kubernetes.io/projected/f96ed08f-e197-4605-9703-822195dec9c7-kube-api-access-zjlhw\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422980 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff5b60fa-0e53-444d-935f-7aaae67eee3e-tmp-dir\") pod \"node-resolver-b2mj5\" (UID: \"ff5b60fa-0e53-444d-935f-7aaae67eee3e\") " pod="openshift-dns/node-resolver-b2mj5" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423009 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-var-lib-kubelet\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.422978 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f96ed08f-e197-4605-9703-822195dec9c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423054 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-multus-cni-dir\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423132 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-var-lib-kubelet\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423164 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1c4df35-cf17-44bf-b476-7b25c1c95397-iptables-alerter-script\") pod \"iptables-alerter-gjthg\" (UID: \"f1c4df35-cf17-44bf-b476-7b25c1c95397\") " pod="openshift-network-operator/iptables-alerter-gjthg" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423191 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-systemd-units\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423215 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-var-lib-openvswitch\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423238 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-etc-openvswitch\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423275 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f96ed08f-e197-4605-9703-822195dec9c7-system-cni-dir\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423254 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f96ed08f-e197-4605-9703-822195dec9c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423312 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423327 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f96ed08f-e197-4605-9703-822195dec9c7-system-cni-dir\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423331 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08c5b538-ad01-4f75-968c-29815481568b-etc-tuned\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423386 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08c5b538-ad01-4f75-968c-29815481568b-tmp\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.424362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423404 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-run-netns\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423429 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-var-lib-cni-bin\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423447 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-hostroot\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423463 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-run-multus-certs\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423481 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfgzr\" (UniqueName: \"kubernetes.io/projected/f1c4df35-cf17-44bf-b476-7b25c1c95397-kube-api-access-qfgzr\") pod \"iptables-alerter-gjthg\" (UID: \"f1c4df35-cf17-44bf-b476-7b25c1c95397\") " pod="openshift-network-operator/iptables-alerter-gjthg" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423506 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-run-ovn-kubernetes\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423532 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b7d8694d-a56d-416e-9fcb-174284b8afc1-agent-certs\") pod \"konnectivity-agent-2zcbw\" (UID: \"b7d8694d-a56d-416e-9fcb-174284b8afc1\") " pod="kube-system/konnectivity-agent-2zcbw" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423551 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-kubernetes\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423569 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff5b60fa-0e53-444d-935f-7aaae67eee3e-hosts-file\") pod \"node-resolver-b2mj5\" (UID: \"ff5b60fa-0e53-444d-935f-7aaae67eee3e\") " pod="openshift-dns/node-resolver-b2mj5" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423588 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4t58\" (UniqueName: \"kubernetes.io/projected/08af4545-5d43-4166-b9e7-c98b4af01da9-kube-api-access-j4t58\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423612 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49d3d12c-13f1-42ff-8685-40a6a459b43f-ovnkube-script-lib\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423612 2588 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423629 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-registration-dir\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423634 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff5b60fa-0e53-444d-935f-7aaae67eee3e-hosts-file\") pod \"node-resolver-b2mj5\" (UID: \"ff5b60fa-0e53-444d-935f-7aaae67eee3e\") " pod="openshift-dns/node-resolver-b2mj5" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423644 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c680d364-22c9-4026-8364-19ad2fa7a6c7-host\") pod \"node-ca-p45bc\" (UID: \"c680d364-22c9-4026-8364-19ad2fa7a6c7\") " pod="openshift-image-registry/node-ca-p45bc" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423649 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-kubernetes\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423663 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-sysctl-conf\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.424877 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423695 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-sys\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.425393 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423774 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-sys\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.425393 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.423784 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08c5b538-ad01-4f75-968c-29815481568b-etc-sysctl-conf\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.426817 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.426798 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08c5b538-ad01-4f75-968c-29815481568b-etc-tuned\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.426901 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.426838 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08c5b538-ad01-4f75-968c-29815481568b-tmp\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.432868 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.432837 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kprzk\" (UniqueName: \"kubernetes.io/projected/ff5b60fa-0e53-444d-935f-7aaae67eee3e-kube-api-access-kprzk\") pod \"node-resolver-b2mj5\" (UID: \"ff5b60fa-0e53-444d-935f-7aaae67eee3e\") " pod="openshift-dns/node-resolver-b2mj5" Jul 24 00:14:01.432868 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.432857 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7djgp\" (UniqueName: \"kubernetes.io/projected/08c5b538-ad01-4f75-968c-29815481568b-kube-api-access-7djgp\") pod \"tuned-m7wqq\" (UID: \"08c5b538-ad01-4f75-968c-29815481568b\") " pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.432974 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.432831 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjlhw\" (UniqueName: \"kubernetes.io/projected/f96ed08f-e197-4605-9703-822195dec9c7-kube-api-access-zjlhw\") pod \"multus-additional-cni-plugins-8b9tv\" (UID: \"f96ed08f-e197-4605-9703-822195dec9c7\") " pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.476239 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.476183 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-20.ec2.internal" event={"ID":"37633424d4f98b6e44a2f77092ebb963","Type":"ContainerStarted","Data":"1b77ab69e3820c4865abe475bf0a587fdbaf8096ef8e6331bb9e52bf110f1195"} Jul 24 00:14:01.524257 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524165 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-cnibin\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.524257 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524226 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-multus-socket-dir-parent\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.524475 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524313 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-cnibin\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.524475 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524311 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1c4df35-cf17-44bf-b476-7b25c1c95397-host-slash\") pod \"iptables-alerter-gjthg\" (UID: \"f1c4df35-cf17-44bf-b476-7b25c1c95397\") " pod="openshift-network-operator/iptables-alerter-gjthg" Jul 24 00:14:01.524475 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524350 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-multus-socket-dir-parent\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.524475 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524379 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.524475 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524407 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49d3d12c-13f1-42ff-8685-40a6a459b43f-ovn-node-metrics-cert\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.524475 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524434 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-os-release\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.524475 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524359 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1c4df35-cf17-44bf-b476-7b25c1c95397-host-slash\") pod \"iptables-alerter-gjthg\" (UID: \"f1c4df35-cf17-44bf-b476-7b25c1c95397\") " pod="openshift-network-operator/iptables-alerter-gjthg" Jul 24 00:14:01.524475 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524460 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b7d8694d-a56d-416e-9fcb-174284b8afc1-konnectivity-ca\") pod \"konnectivity-agent-2zcbw\" (UID: \"b7d8694d-a56d-416e-9fcb-174284b8afc1\") " pod="kube-system/konnectivity-agent-2zcbw" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524514 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-os-release\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524503 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524624 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-socket-dir\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524650 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-kubelet\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524667 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c680d364-22c9-4026-8364-19ad2fa7a6c7-serviceca\") pod \"node-ca-p45bc\" (UID: \"c680d364-22c9-4026-8364-19ad2fa7a6c7\") " pod="openshift-image-registry/node-ca-p45bc" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524691 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-multus-cni-dir\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524717 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-var-lib-kubelet\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524732 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-kubelet\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524744 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1c4df35-cf17-44bf-b476-7b25c1c95397-iptables-alerter-script\") pod \"iptables-alerter-gjthg\" (UID: \"f1c4df35-cf17-44bf-b476-7b25c1c95397\") " pod="openshift-network-operator/iptables-alerter-gjthg" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524776 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-systemd-units\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524803 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-var-lib-openvswitch\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524829 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-etc-openvswitch\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524860 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.524878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524863 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-socket-dir\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.525553 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524891 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-var-lib-kubelet\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.525553 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524941 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-run-netns\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.525553 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525382 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-var-lib-cni-bin\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.525553 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525412 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-var-lib-openvswitch\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.525553 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.524971 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-var-lib-cni-bin\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.525553 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525493 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-hostroot\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.525553 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525495 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.525553 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525533 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-run-multus-certs\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.525999 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525582 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-etc-openvswitch\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.525999 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525572 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-multus-cni-dir\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.525999 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525606 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-hostroot\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.525999 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525493 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-run-netns\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.525999 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525628 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfgzr\" (UniqueName: \"kubernetes.io/projected/f1c4df35-cf17-44bf-b476-7b25c1c95397-kube-api-access-qfgzr\") pod \"iptables-alerter-gjthg\" (UID: \"f1c4df35-cf17-44bf-b476-7b25c1c95397\") " pod="openshift-network-operator/iptables-alerter-gjthg" Jul 24 00:14:01.525999 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525705 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-systemd-units\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.525999 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525736 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-run-ovn-kubernetes\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.525999 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525770 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b7d8694d-a56d-416e-9fcb-174284b8afc1-agent-certs\") pod \"konnectivity-agent-2zcbw\" (UID: \"b7d8694d-a56d-416e-9fcb-174284b8afc1\") " pod="kube-system/konnectivity-agent-2zcbw" Jul 24 00:14:01.525999 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525806 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4t58\" (UniqueName: \"kubernetes.io/projected/08af4545-5d43-4166-b9e7-c98b4af01da9-kube-api-access-j4t58\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:01.525999 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525858 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49d3d12c-13f1-42ff-8685-40a6a459b43f-ovnkube-script-lib\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.526648 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.526057 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b7d8694d-a56d-416e-9fcb-174284b8afc1-konnectivity-ca\") pod \"konnectivity-agent-2zcbw\" (UID: \"b7d8694d-a56d-416e-9fcb-174284b8afc1\") " pod="kube-system/konnectivity-agent-2zcbw" Jul 24 00:14:01.526648 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.526204 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1c4df35-cf17-44bf-b476-7b25c1c95397-iptables-alerter-script\") pod \"iptables-alerter-gjthg\" (UID: \"f1c4df35-cf17-44bf-b476-7b25c1c95397\") " pod="openshift-network-operator/iptables-alerter-gjthg" Jul 24 00:14:01.526648 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.526279 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-run-multus-certs\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.526648 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.526403 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-run-ovn-kubernetes\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.526857 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.526775 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c680d364-22c9-4026-8364-19ad2fa7a6c7-serviceca\") pod \"node-ca-p45bc\" (UID: \"c680d364-22c9-4026-8364-19ad2fa7a6c7\") " pod="openshift-image-registry/node-ca-p45bc" Jul 24 00:14:01.526934 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.526853 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49d3d12c-13f1-42ff-8685-40a6a459b43f-ovnkube-script-lib\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.527231 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.527150 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-registration-dir\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.527540 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.527515 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49d3d12c-13f1-42ff-8685-40a6a459b43f-ovn-node-metrics-cert\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.527616 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.525890 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-registration-dir\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.527723 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.527706 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c680d364-22c9-4026-8364-19ad2fa7a6c7-host\") pod \"node-ca-p45bc\" (UID: \"c680d364-22c9-4026-8364-19ad2fa7a6c7\") " pod="openshift-image-registry/node-ca-p45bc" Jul 24 00:14:01.527806 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.527753 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49d3d12c-13f1-42ff-8685-40a6a459b43f-ovnkube-config\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.527861 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.527813 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c680d364-22c9-4026-8364-19ad2fa7a6c7-host\") pod \"node-ca-p45bc\" (UID: \"c680d364-22c9-4026-8364-19ad2fa7a6c7\") " pod="openshift-image-registry/node-ca-p45bc" Jul 24 00:14:01.527918 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.527857 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/520a9c02-7a49-49ae-a98e-383f7d354eb6-cni-binary-copy\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.527918 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.527892 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:01.528025 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.527925 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-run-ovn\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528025 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.527948 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-cni-netd\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528025 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.527981 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-run-k8s-cni-cncf-io\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.528025 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528013 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/520a9c02-7a49-49ae-a98e-383f7d354eb6-multus-daemon-config\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.528290 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528045 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4kls\" (UniqueName: \"kubernetes.io/projected/520a9c02-7a49-49ae-a98e-383f7d354eb6-kube-api-access-s4kls\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.528290 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528079 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-run-netns\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528290 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528122 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-run-openvswitch\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528290 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528153 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-cni-bin\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528290 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528184 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49d3d12c-13f1-42ff-8685-40a6a459b43f-env-overrides\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528290 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528218 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n92g9\" (UniqueName: \"kubernetes.io/projected/49d3d12c-13f1-42ff-8685-40a6a459b43f-kube-api-access-n92g9\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528290 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528250 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-etc-selinux\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.528290 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528277 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw2kh\" (UniqueName: \"kubernetes.io/projected/a60f006d-3574-472d-85b1-ae2921f52ac3-kube-api-access-lw2kh\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.528695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528308 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqvb\" (UniqueName: \"kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb\") pod \"network-check-target-z6qkx\" (UID: \"f7fe8ab4-f1db-40ab-8c20-92c6210bfe59\") " pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:01.528695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528340 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78rq\" (UniqueName: \"kubernetes.io/projected/c680d364-22c9-4026-8364-19ad2fa7a6c7-kube-api-access-l78rq\") pod \"node-ca-p45bc\" (UID: \"c680d364-22c9-4026-8364-19ad2fa7a6c7\") " pod="openshift-image-registry/node-ca-p45bc" Jul 24 00:14:01.528695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528374 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-device-dir\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.528695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528405 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-slash\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528430 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-node-log\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528433 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49d3d12c-13f1-42ff-8685-40a6a459b43f-ovnkube-config\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528496 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-node-log\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528504 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-log-socket\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528546 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-sys-fs\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.528695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528552 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-log-socket\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.528695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528685 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-run-k8s-cni-cncf-io\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.529234 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528948 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-etc-selinux\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.529234 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.528985 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49d3d12c-13f1-42ff-8685-40a6a459b43f-env-overrides\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.529234 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529011 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b7d8694d-a56d-416e-9fcb-174284b8afc1-agent-certs\") pod \"konnectivity-agent-2zcbw\" (UID: \"b7d8694d-a56d-416e-9fcb-174284b8afc1\") " pod="kube-system/konnectivity-agent-2zcbw" Jul 24 00:14:01.529234 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.529053 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:01.529234 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529066 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-sys-fs\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.529234 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529111 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a60f006d-3574-472d-85b1-ae2921f52ac3-device-dir\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.529234 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.529127 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs podName:08af4545-5d43-4166-b9e7-c98b4af01da9 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:02.029100764 +0000 UTC m=+3.032660092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs") pod "network-metrics-daemon-xbmxv" (UID: "08af4545-5d43-4166-b9e7-c98b4af01da9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:01.529234 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529115 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-run-ovn\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.529234 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529184 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-system-cni-dir\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.529234 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529223 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-var-lib-cni-multus\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.529751 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529265 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-multus-conf-dir\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.529751 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529299 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-etc-kubernetes\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.529751 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529338 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-run-openvswitch\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.529751 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529357 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-system-cni-dir\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.529751 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529416 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-host-var-lib-cni-multus\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.529751 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529510 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-run-systemd\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.529751 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529571 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-cni-bin\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.531104 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529514 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-multus-conf-dir\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.531203 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529524 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-run-netns\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.531203 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529633 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-slash\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.531203 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529761 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/520a9c02-7a49-49ae-a98e-383f7d354eb6-etc-kubernetes\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.531203 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529792 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/520a9c02-7a49-49ae-a98e-383f7d354eb6-cni-binary-copy\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.531363 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529809 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-run-systemd\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.531363 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.529877 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49d3d12c-13f1-42ff-8685-40a6a459b43f-host-cni-netd\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.531363 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.530113 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/520a9c02-7a49-49ae-a98e-383f7d354eb6-multus-daemon-config\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.535579 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.535554 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfgzr\" (UniqueName: \"kubernetes.io/projected/f1c4df35-cf17-44bf-b476-7b25c1c95397-kube-api-access-qfgzr\") pod \"iptables-alerter-gjthg\" (UID: \"f1c4df35-cf17-44bf-b476-7b25c1c95397\") " pod="openshift-network-operator/iptables-alerter-gjthg" Jul 24 00:14:01.535681 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.535644 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4t58\" (UniqueName: \"kubernetes.io/projected/08af4545-5d43-4166-b9e7-c98b4af01da9-kube-api-access-j4t58\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:01.537282 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.537259 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 00:14:01.537387 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.537288 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 00:14:01.537387 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.537304 2588 projected.go:196] Error preparing data for projected volume kube-api-access-rqqvb for pod openshift-network-diagnostics/network-check-target-z6qkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:01.537387 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.537376 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb podName:f7fe8ab4-f1db-40ab-8c20-92c6210bfe59 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:02.037354348 +0000 UTC m=+3.040913696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqvb" (UniqueName: "kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb") pod "network-check-target-z6qkx" (UID: "f7fe8ab4-f1db-40ab-8c20-92c6210bfe59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:01.538559 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.538538 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw2kh\" (UniqueName: \"kubernetes.io/projected/a60f006d-3574-472d-85b1-ae2921f52ac3-kube-api-access-lw2kh\") pod \"aws-ebs-csi-driver-node-bs555\" (UID: \"a60f006d-3574-472d-85b1-ae2921f52ac3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.538923 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.538902 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l78rq\" (UniqueName: \"kubernetes.io/projected/c680d364-22c9-4026-8364-19ad2fa7a6c7-kube-api-access-l78rq\") pod \"node-ca-p45bc\" (UID: \"c680d364-22c9-4026-8364-19ad2fa7a6c7\") " pod="openshift-image-registry/node-ca-p45bc" Jul 24 00:14:01.539141 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.539116 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n92g9\" (UniqueName: \"kubernetes.io/projected/49d3d12c-13f1-42ff-8685-40a6a459b43f-kube-api-access-n92g9\") pod \"ovnkube-node-48hd9\" (UID: \"49d3d12c-13f1-42ff-8685-40a6a459b43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.539276 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.539258 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4kls\" (UniqueName: \"kubernetes.io/projected/520a9c02-7a49-49ae-a98e-383f7d354eb6-kube-api-access-s4kls\") pod \"multus-f9gwf\" (UID: \"520a9c02-7a49-49ae-a98e-383f7d354eb6\") " pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.585366 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.585334 2588 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 00:14:01.612650 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.612618 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8b9tv" Jul 24 00:14:01.619376 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.619346 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" Jul 24 00:14:01.625066 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:01.625030 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96ed08f_e197_4605_9703_822195dec9c7.slice/crio-e7b8d9ce4335e9f1cbc39ff2d83c6b33c9cf38244bd495d99670f5ea4e0b006c WatchSource:0}: Error finding container e7b8d9ce4335e9f1cbc39ff2d83c6b33c9cf38244bd495d99670f5ea4e0b006c: Status 404 returned error can't find the container with id e7b8d9ce4335e9f1cbc39ff2d83c6b33c9cf38244bd495d99670f5ea4e0b006c Jul 24 00:14:01.627608 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.627519 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b2mj5" Jul 24 00:14:01.631323 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:01.631286 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08c5b538_ad01_4f75_968c_29815481568b.slice/crio-c3d0bead5933f7193435d8f9adf078ebeafe9ea68f28585a990f3aa99da2ee5b WatchSource:0}: Error finding container c3d0bead5933f7193435d8f9adf078ebeafe9ea68f28585a990f3aa99da2ee5b: Status 404 returned error can't find the container with id c3d0bead5933f7193435d8f9adf078ebeafe9ea68f28585a990f3aa99da2ee5b Jul 24 00:14:01.632133 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.632085 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f9gwf" Jul 24 00:14:01.638824 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.638796 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gjthg" Jul 24 00:14:01.640031 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:01.640007 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5b60fa_0e53_444d_935f_7aaae67eee3e.slice/crio-ce641eb89ff8821b336110183cc71f482c3e60783f82b863055a7d90b89127e2 WatchSource:0}: Error finding container ce641eb89ff8821b336110183cc71f482c3e60783f82b863055a7d90b89127e2: Status 404 returned error can't find the container with id ce641eb89ff8821b336110183cc71f482c3e60783f82b863055a7d90b89127e2 Jul 24 00:14:01.644672 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.644630 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2zcbw" Jul 24 00:14:01.645680 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:01.645651 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520a9c02_7a49_49ae_a98e_383f7d354eb6.slice/crio-7d3fc2c994e391825f02292511e9cf620b2b8837a26f7c045cdfba72602461af WatchSource:0}: Error finding container 7d3fc2c994e391825f02292511e9cf620b2b8837a26f7c045cdfba72602461af: Status 404 returned error can't find the container with id 7d3fc2c994e391825f02292511e9cf620b2b8837a26f7c045cdfba72602461af Jul 24 00:14:01.650417 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.650370 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:01.654136 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:01.654109 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c4df35_cf17_44bf_b476_7b25c1c95397.slice/crio-020dc7ed6788b4c48d1a73a4ee88cba754efd0504d75a13862593ca92d8d9ff2 WatchSource:0}: Error finding container 020dc7ed6788b4c48d1a73a4ee88cba754efd0504d75a13862593ca92d8d9ff2: Status 404 returned error can't find the container with id 020dc7ed6788b4c48d1a73a4ee88cba754efd0504d75a13862593ca92d8d9ff2 Jul 24 00:14:01.654854 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:01.654834 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d8694d_a56d_416e_9fcb_174284b8afc1.slice/crio-b76bbd41018e78ea7506149c6d6dd0e602cec6142ff7a2f613421688318e0f73 WatchSource:0}: Error finding container b76bbd41018e78ea7506149c6d6dd0e602cec6142ff7a2f613421688318e0f73: Status 404 returned error can't find the container with id b76bbd41018e78ea7506149c6d6dd0e602cec6142ff7a2f613421688318e0f73 Jul 24 00:14:01.656189 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.656127 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" Jul 24 00:14:01.660248 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:01.660224 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d3d12c_13f1_42ff_8685_40a6a459b43f.slice/crio-f101f926b383f225c0dab92a8a29af5536d96bcf30726fbee8084c6c5593697e WatchSource:0}: Error finding container f101f926b383f225c0dab92a8a29af5536d96bcf30726fbee8084c6c5593697e: Status 404 returned error can't find the container with id f101f926b383f225c0dab92a8a29af5536d96bcf30726fbee8084c6c5593697e Jul 24 00:14:01.661324 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.661307 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p45bc" Jul 24 00:14:01.667074 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:01.667042 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60f006d_3574_472d_85b1_ae2921f52ac3.slice/crio-e4d3b2ab899a12566e5982e156b60161358d559e817189741904ea0ad176847d WatchSource:0}: Error finding container e4d3b2ab899a12566e5982e156b60161358d559e817189741904ea0ad176847d: Status 404 returned error can't find the container with id e4d3b2ab899a12566e5982e156b60161358d559e817189741904ea0ad176847d Jul 24 00:14:01.672883 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:01.672853 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc680d364_22c9_4026_8364_19ad2fa7a6c7.slice/crio-1be255d49f04407298804ba2242b8a0f484de6fd519df553e7dd52ac940760cb WatchSource:0}: Error finding container 1be255d49f04407298804ba2242b8a0f484de6fd519df553e7dd52ac940760cb: Status 404 returned error can't find the container with id 1be255d49f04407298804ba2242b8a0f484de6fd519df553e7dd52ac940760cb Jul 24 00:14:01.699482 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:01.699435 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22fd7258d42e3c88809b91d36bbeabd9.slice/crio-1eaa2d691ffa66bc316ff9f1a6afc4d589c9d7445030f50327cda4bc48381614 WatchSource:0}: Error finding container 1eaa2d691ffa66bc316ff9f1a6afc4d589c9d7445030f50327cda4bc48381614: Status 404 returned error can't find the container with id 1eaa2d691ffa66bc316ff9f1a6afc4d589c9d7445030f50327cda4bc48381614 Jul 24 00:14:01.932586 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:01.932474 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:01.932757 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.932650 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:01.932757 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:01.932722 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret podName:4dda38d3-0c29-499b-93bd-b9accf7c4cb3 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:02.932704789 +0000 UTC m=+3.936264121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret") pod "global-pull-secret-syncer-jnljx" (UID: "4dda38d3-0c29-499b-93bd-b9accf7c4cb3") : object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:02.033809 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.033769 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:02.033990 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:02.033910 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:02.033990 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:02.033982 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs podName:08af4545-5d43-4166-b9e7-c98b4af01da9 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:03.033966079 +0000 UTC m=+4.037525411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs") pod "network-metrics-daemon-xbmxv" (UID: "08af4545-5d43-4166-b9e7-c98b4af01da9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:02.134464 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.134412 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqvb\" (UniqueName: \"kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb\") pod \"network-check-target-z6qkx\" (UID: \"f7fe8ab4-f1db-40ab-8c20-92c6210bfe59\") " pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:02.134703 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:02.134679 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 00:14:02.134816 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:02.134710 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 00:14:02.134816 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:02.134725 2588 projected.go:196] Error preparing data for projected volume kube-api-access-rqqvb for pod openshift-network-diagnostics/network-check-target-z6qkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:02.134816 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:02.134788 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb podName:f7fe8ab4-f1db-40ab-8c20-92c6210bfe59 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:03.134766583 +0000 UTC m=+4.138325917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqvb" (UniqueName: "kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb") pod "network-check-target-z6qkx" (UID: "f7fe8ab4-f1db-40ab-8c20-92c6210bfe59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:02.393913 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.393809 2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 00:09:01 +0000 UTC" deadline="2028-01-30 05:08:44.542628142 +0000 UTC" Jul 24 00:14:02.393913 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.393858 2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13324h54m42.148775173s" Jul 24 00:14:02.513249 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.509324 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2zcbw" event={"ID":"b7d8694d-a56d-416e-9fcb-174284b8afc1","Type":"ContainerStarted","Data":"b76bbd41018e78ea7506149c6d6dd0e602cec6142ff7a2f613421688318e0f73"} Jul 24 00:14:02.519602 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.519564 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b2mj5" event={"ID":"ff5b60fa-0e53-444d-935f-7aaae67eee3e","Type":"ContainerStarted","Data":"ce641eb89ff8821b336110183cc71f482c3e60783f82b863055a7d90b89127e2"} Jul 24 00:14:02.526548 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.526508 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" event={"ID":"08c5b538-ad01-4f75-968c-29815481568b","Type":"ContainerStarted","Data":"c3d0bead5933f7193435d8f9adf078ebeafe9ea68f28585a990f3aa99da2ee5b"} Jul 24 00:14:02.554325 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.554283 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b9tv" event={"ID":"f96ed08f-e197-4605-9703-822195dec9c7","Type":"ContainerStarted","Data":"e7b8d9ce4335e9f1cbc39ff2d83c6b33c9cf38244bd495d99670f5ea4e0b006c"} Jul 24 00:14:02.564793 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.564745 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" event={"ID":"22fd7258d42e3c88809b91d36bbeabd9","Type":"ContainerStarted","Data":"1eaa2d691ffa66bc316ff9f1a6afc4d589c9d7445030f50327cda4bc48381614"} Jul 24 00:14:02.566945 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.566910 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p45bc" event={"ID":"c680d364-22c9-4026-8364-19ad2fa7a6c7","Type":"ContainerStarted","Data":"1be255d49f04407298804ba2242b8a0f484de6fd519df553e7dd52ac940760cb"} Jul 24 00:14:02.569856 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.569821 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gjthg" event={"ID":"f1c4df35-cf17-44bf-b476-7b25c1c95397","Type":"ContainerStarted","Data":"020dc7ed6788b4c48d1a73a4ee88cba754efd0504d75a13862593ca92d8d9ff2"} Jul 24 00:14:02.590734 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.590692 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f9gwf" event={"ID":"520a9c02-7a49-49ae-a98e-383f7d354eb6","Type":"ContainerStarted","Data":"7d3fc2c994e391825f02292511e9cf620b2b8837a26f7c045cdfba72602461af"} Jul 24 00:14:02.598048 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.598006 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" event={"ID":"a60f006d-3574-472d-85b1-ae2921f52ac3","Type":"ContainerStarted","Data":"e4d3b2ab899a12566e5982e156b60161358d559e817189741904ea0ad176847d"} Jul 24 00:14:02.613544 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.613505 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" event={"ID":"49d3d12c-13f1-42ff-8685-40a6a459b43f","Type":"ContainerStarted","Data":"f101f926b383f225c0dab92a8a29af5536d96bcf30726fbee8084c6c5593697e"} Jul 24 00:14:02.940421 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:02.940382 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:02.940618 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:02.940570 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:02.940682 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:02.940664 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret podName:4dda38d3-0c29-499b-93bd-b9accf7c4cb3 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:04.940642868 +0000 UTC m=+5.944202196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret") pod "global-pull-secret-syncer-jnljx" (UID: "4dda38d3-0c29-499b-93bd-b9accf7c4cb3") : object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:03.042288 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:03.041603 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:03.042288 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:03.041825 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:03.042288 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:03.041900 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs podName:08af4545-5d43-4166-b9e7-c98b4af01da9 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:05.041880163 +0000 UTC m=+6.045439504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs") pod "network-metrics-daemon-xbmxv" (UID: "08af4545-5d43-4166-b9e7-c98b4af01da9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:03.142040 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:03.141996 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqvb\" (UniqueName: \"kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb\") pod \"network-check-target-z6qkx\" (UID: \"f7fe8ab4-f1db-40ab-8c20-92c6210bfe59\") " pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:03.142274 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:03.142255 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 00:14:03.142339 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:03.142296 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 00:14:03.142339 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:03.142311 2588 projected.go:196] Error preparing data for projected volume kube-api-access-rqqvb for pod openshift-network-diagnostics/network-check-target-z6qkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:03.142450 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:03.142371 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb podName:f7fe8ab4-f1db-40ab-8c20-92c6210bfe59 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:05.142351414 +0000 UTC m=+6.145910755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqvb" (UniqueName: "kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb") pod "network-check-target-z6qkx" (UID: "f7fe8ab4-f1db-40ab-8c20-92c6210bfe59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:03.394959 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:03.394849 2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 00:09:01 +0000 UTC" deadline="2028-03-02 13:15:46.393418428 +0000 UTC" Jul 24 00:14:03.394959 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:03.394896 2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14101h1m42.998527741s" Jul 24 00:14:03.491905 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:03.491873 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:03.492072 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:03.492008 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:03.492480 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:03.492460 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:03.492601 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:03.492567 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:03.492707 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:03.492664 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:03.492782 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:03.492764 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:04.957351 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:04.957292 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:04.957835 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:04.957467 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:04.957835 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:04.957533 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret podName:4dda38d3-0c29-499b-93bd-b9accf7c4cb3 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:08.957514387 +0000 UTC m=+9.961073729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret") pod "global-pull-secret-syncer-jnljx" (UID: "4dda38d3-0c29-499b-93bd-b9accf7c4cb3") : object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:05.057957 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:05.057912 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:05.058162 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:05.058095 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:05.058248 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:05.058168 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs podName:08af4545-5d43-4166-b9e7-c98b4af01da9 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:09.058148548 +0000 UTC m=+10.061707898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs") pod "network-metrics-daemon-xbmxv" (UID: "08af4545-5d43-4166-b9e7-c98b4af01da9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:05.159000 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:05.158964 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqvb\" (UniqueName: \"kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb\") pod \"network-check-target-z6qkx\" (UID: \"f7fe8ab4-f1db-40ab-8c20-92c6210bfe59\") " pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:05.159653 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:05.159192 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 00:14:05.159653 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:05.159227 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 00:14:05.159653 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:05.159242 2588 projected.go:196] Error preparing data for projected volume kube-api-access-rqqvb for pod openshift-network-diagnostics/network-check-target-z6qkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:05.159653 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:05.159310 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb podName:f7fe8ab4-f1db-40ab-8c20-92c6210bfe59 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:09.159288466 +0000 UTC m=+10.162847806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqvb" (UniqueName: "kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb") pod "network-check-target-z6qkx" (UID: "f7fe8ab4-f1db-40ab-8c20-92c6210bfe59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:05.475603 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:05.475571 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:05.475765 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:05.475571 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:05.475765 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:05.475735 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:05.475885 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:05.475780 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:05.475937 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:05.475915 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:05.476046 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:05.476013 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:07.472051 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:07.471864 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:07.472051 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:07.471899 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:07.472051 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:07.471864 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:07.472051 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:07.472001 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:07.472664 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:07.472112 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:07.472664 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:07.472209 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:08.990415 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:08.990375 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:08.990901 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:08.990500 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:08.990901 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:08.990582 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret podName:4dda38d3-0c29-499b-93bd-b9accf7c4cb3 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:16.990559291 +0000 UTC m=+17.994118625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret") pod "global-pull-secret-syncer-jnljx" (UID: "4dda38d3-0c29-499b-93bd-b9accf7c4cb3") : object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:09.091645 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:09.091612 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:09.091789 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:09.091769 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:09.091862 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:09.091850 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs podName:08af4545-5d43-4166-b9e7-c98b4af01da9 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:17.091831368 +0000 UTC m=+18.095390693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs") pod "network-metrics-daemon-xbmxv" (UID: "08af4545-5d43-4166-b9e7-c98b4af01da9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:09.192907 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:09.192866 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqvb\" (UniqueName: \"kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb\") pod \"network-check-target-z6qkx\" (UID: \"f7fe8ab4-f1db-40ab-8c20-92c6210bfe59\") " pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:09.193096 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:09.193064 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 00:14:09.193164 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:09.193107 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 00:14:09.193164 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:09.193122 2588 projected.go:196] Error preparing data for projected volume kube-api-access-rqqvb for pod openshift-network-diagnostics/network-check-target-z6qkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:09.193274 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:09.193188 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb podName:f7fe8ab4-f1db-40ab-8c20-92c6210bfe59 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:17.193168471 +0000 UTC m=+18.196727802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqvb" (UniqueName: "kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb") pod "network-check-target-z6qkx" (UID: "f7fe8ab4-f1db-40ab-8c20-92c6210bfe59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:09.472553 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:09.472247 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:09.472553 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:09.472368 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:09.472553 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:09.472539 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:09.473261 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:09.473122 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:09.473261 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:09.473262 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:09.473448 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:09.473414 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:11.470948 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:11.470916 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:11.471440 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:11.471060 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:11.471440 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:11.471163 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:11.471440 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:11.471184 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:11.471440 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:11.471246 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:11.471440 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:11.471314 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:13.471738 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:13.471654 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:13.471738 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:13.471680 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:13.472203 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:13.471756 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:13.472203 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:13.471770 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:13.472203 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:13.471867 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:13.472203 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:13.471959 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:15.474382 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:15.474341 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:15.474382 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:15.474366 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:15.474874 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:15.474472 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:15.474874 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:15.474529 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:15.474874 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:15.474669 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:15.474874 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:15.474751 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:17.051038 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:17.050995 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:17.051576 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:17.051161 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:17.051576 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:17.051256 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret podName:4dda38d3-0c29-499b-93bd-b9accf7c4cb3 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:33.051224332 +0000 UTC m=+34.054783659 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret") pod "global-pull-secret-syncer-jnljx" (UID: "4dda38d3-0c29-499b-93bd-b9accf7c4cb3") : object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:17.152097 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:17.152045 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:17.152259 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:17.152188 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:17.152259 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:17.152254 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs podName:08af4545-5d43-4166-b9e7-c98b4af01da9 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:33.152234772 +0000 UTC m=+34.155794117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs") pod "network-metrics-daemon-xbmxv" (UID: "08af4545-5d43-4166-b9e7-c98b4af01da9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:17.253380 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:17.253329 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqvb\" (UniqueName: \"kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb\") pod \"network-check-target-z6qkx\" (UID: \"f7fe8ab4-f1db-40ab-8c20-92c6210bfe59\") " pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:17.253565 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:17.253498 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 00:14:17.253565 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:17.253518 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 00:14:17.253565 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:17.253530 2588 projected.go:196] Error preparing data for projected volume kube-api-access-rqqvb for pod openshift-network-diagnostics/network-check-target-z6qkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:17.253738 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:17.253593 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb podName:f7fe8ab4-f1db-40ab-8c20-92c6210bfe59 nodeName:}" failed. No retries permitted until 2026-07-24 00:14:33.253575121 +0000 UTC m=+34.257134485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqvb" (UniqueName: "kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb") pod "network-check-target-z6qkx" (UID: "f7fe8ab4-f1db-40ab-8c20-92c6210bfe59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:17.471666 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:17.471632 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:17.471666 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:17.471654 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:17.471889 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:17.471644 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:17.471889 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:17.471759 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:17.471889 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:17.471830 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:17.472046 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:17.471918 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:19.475031 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:19.474996 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:19.475537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:19.474996 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:19.475537 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:19.475125 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:19.475537 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:19.475208 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:19.475537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:19.475000 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:19.475537 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:19.475310 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:21.471489 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:21.471290 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:21.471939 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:21.471308 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:21.471939 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:21.471585 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:21.471939 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:21.471642 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:21.471939 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:21.471338 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:21.471939 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:21.471723 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:21.673276 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:21.672890 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" event={"ID":"49d3d12c-13f1-42ff-8685-40a6a459b43f","Type":"ContainerStarted","Data":"3a2f9ba6b66a7d35980120ffb4fa9cfff1993289823e60474b4efba830932d2f"} Jul 24 00:14:21.673667 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:21.673635 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" event={"ID":"49d3d12c-13f1-42ff-8685-40a6a459b43f","Type":"ContainerStarted","Data":"593541e0fcf2ac40acc2524a9e5c932f842635473b2104f194db7d524ba56cd3"} Jul 24 00:14:21.675544 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:21.675486 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" event={"ID":"08c5b538-ad01-4f75-968c-29815481568b","Type":"ContainerStarted","Data":"1d45cee359f59b9745565ec04bd9227c09618cfb5d30d9626f23c2cff933614c"} Jul 24 00:14:21.680329 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:21.680206 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-20.ec2.internal" event={"ID":"37633424d4f98b6e44a2f77092ebb963","Type":"ContainerStarted","Data":"8dcacaf100f4bccb5fbb83b2351c836e8018a63facf17b28162ee8c31bf9ae16"} Jul 24 00:14:21.686289 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:21.685692 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f9gwf" event={"ID":"520a9c02-7a49-49ae-a98e-383f7d354eb6","Type":"ContainerStarted","Data":"93207ff6a5617c801eda2a19f6c7d4c54648106cb252086bfb4d589640f4fdb5"} Jul 24 00:14:21.714760 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:21.714703 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m7wqq" podStartSLOduration=3.015312692 podStartE2EDuration="22.714685892s" totalImagesPullingTime="19.6993732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 00:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:14:21.700026516 +0000 UTC m=+22.703585864" watchObservedRunningTime="2026-07-24 00:14:21.714685892 +0000 UTC m=+22.718245239" Jul 24 00:14:21.715072 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:21.715050 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-20.ec2.internal" podStartSLOduration=20.715045077 podStartE2EDuration="20.715045077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 00:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:14:21.714677341 +0000 UTC m=+22.718236689" watchObservedRunningTime="2026-07-24 00:14:21.715045077 +0000 UTC m=+22.718604424" Jul 24 00:14:21.734702 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:21.734650 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f9gwf" podStartSLOduration=2.994882622 podStartE2EDuration="22.73463005s" totalImagesPullingTime="19.739747428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 00:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:14:21.734566703 +0000 UTC m=+22.738126050" watchObservedRunningTime="2026-07-24 00:14:21.73463005 +0000 UTC m=+22.738189397" Jul 24 00:14:22.689287 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.689247 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" event={"ID":"a60f006d-3574-472d-85b1-ae2921f52ac3","Type":"ContainerStarted","Data":"4028c68ab05edd00e68719cecbe863744ef0efb69c212541b8c9c815c6ebf5a8"} Jul 24 00:14:22.692033 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.692008 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" event={"ID":"49d3d12c-13f1-42ff-8685-40a6a459b43f","Type":"ContainerStarted","Data":"18b322f4ae44576df8a8e1a271bce876c2c0ead4afb13a1ac83fe2537f104579"} Jul 24 00:14:22.692166 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.692071 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" event={"ID":"49d3d12c-13f1-42ff-8685-40a6a459b43f","Type":"ContainerStarted","Data":"da1bc9b305c22bf327bba7ea75a9b3e642741b0a56a72cf722ebe6a26bd93fbd"} Jul 24 00:14:22.692166 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.692133 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" event={"ID":"49d3d12c-13f1-42ff-8685-40a6a459b43f","Type":"ContainerStarted","Data":"645535a1ef69dbe7dab101aa71645e7bb49da744c880c88d90ff46b1657c9eb4"} Jul 24 00:14:22.692261 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.692179 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" event={"ID":"49d3d12c-13f1-42ff-8685-40a6a459b43f","Type":"ContainerStarted","Data":"f27b20d3d11428c04345bc06cb174f973b3158be78d004d6d9cd967d474778eb"} Jul 24 00:14:22.693412 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.693385 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2zcbw" event={"ID":"b7d8694d-a56d-416e-9fcb-174284b8afc1","Type":"ContainerStarted","Data":"e7c341e8b4e2bc09b0e45bdcbf93903dc9c5c59d178636b838614562b443c3b1"} Jul 24 00:14:22.694828 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.694799 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b2mj5" event={"ID":"ff5b60fa-0e53-444d-935f-7aaae67eee3e","Type":"ContainerStarted","Data":"e9f6b94bef157cf7123c77459d4e427d38e77b7b371a9010857f678f652ddce8"} Jul 24 00:14:22.696269 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.696249 2588 generic.go:356] "Generic (PLEG): container finished" podID="f96ed08f-e197-4605-9703-822195dec9c7" containerID="7bd00d38617e4b6345e0107e0d68172e5bb67e8b056771bbca16511dc85c1893" exitCode=0 Jul 24 00:14:22.696349 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.696308 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b9tv" event={"ID":"f96ed08f-e197-4605-9703-822195dec9c7","Type":"ContainerDied","Data":"7bd00d38617e4b6345e0107e0d68172e5bb67e8b056771bbca16511dc85c1893"} Jul 24 00:14:22.697843 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.697826 2588 generic.go:356] "Generic (PLEG): container finished" podID="22fd7258d42e3c88809b91d36bbeabd9" containerID="fb8d418fcbe80b5b651904a105707b69d21693d68b4c113a495515734759e23e" exitCode=0 Jul 24 00:14:22.697898 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.697855 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" event={"ID":"22fd7258d42e3c88809b91d36bbeabd9","Type":"ContainerDied","Data":"fb8d418fcbe80b5b651904a105707b69d21693d68b4c113a495515734759e23e"} Jul 24 00:14:22.699491 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.699251 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p45bc" event={"ID":"c680d364-22c9-4026-8364-19ad2fa7a6c7","Type":"ContainerStarted","Data":"6ae04809fae94f42af51863ba3306f149c5735c63f020f65e8eb5d1e1038b818"} Jul 24 00:14:22.700730 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.700710 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gjthg" event={"ID":"f1c4df35-cf17-44bf-b476-7b25c1c95397","Type":"ContainerStarted","Data":"9b06a8b7c8aca4c13c3432f200dd92938fdf55cf4d0e9aa1eb0e0b587b1e0e78"} Jul 24 00:14:22.707620 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.707583 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2zcbw" podStartSLOduration=4.039048811 podStartE2EDuration="23.707572397s" totalImagesPullingTime="19.668523586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:14:22.70726507 +0000 UTC m=+23.710824417" watchObservedRunningTime="2026-07-24 00:14:22.707572397 +0000 UTC m=+23.711131743" Jul 24 00:14:22.720506 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.720451 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p45bc" podStartSLOduration=8.025072741 podStartE2EDuration="23.720436566s" totalImagesPullingTime="15.695363825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 00:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:14:22.720428018 +0000 UTC m=+23.723987364" watchObservedRunningTime="2026-07-24 00:14:22.720436566 +0000 UTC m=+23.723995913" Jul 24 00:14:22.747928 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.747888 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:22.750016 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.749963 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b2mj5" podStartSLOduration=4.064977219 podStartE2EDuration="23.749942596s" totalImagesPullingTime="19.684965377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 00:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:14:22.749198161 +0000 UTC m=+23.752757509" watchObservedRunningTime="2026-07-24 00:14:22.749942596 +0000 UTC m=+23.753501945" Jul 24 00:14:22.763549 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.763505 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gjthg" podStartSLOduration=4.090853679 podStartE2EDuration="23.763491323s" totalImagesPullingTime="19.672637644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 00:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:14:22.763414581 +0000 UTC m=+23.766973927" watchObservedRunningTime="2026-07-24 00:14:22.763491323 +0000 UTC m=+23.767050669" Jul 24 00:14:22.819607 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.819575 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:22.918201 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.918173 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:22.918669 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:22.918652 2588 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 00:14:23.390238 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:23.390007 2588 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T00:14:22.918666597Z","UUID":"33d70afb-eb06-4e23-bd8d-dae8453b02e3","Handler":null,"Name":"","Endpoint":""} Jul 24 00:14:23.391663 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:23.391626 2588 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 00:14:23.391779 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:23.391674 2588 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 00:14:23.449189 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:23.449154 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:23.471838 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:23.471765 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:23.471838 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:23.471775 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:23.472073 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:23.471899 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:23.472233 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:23.472195 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:23.472373 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:23.472296 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:23.472434 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:23.472386 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:23.705303 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:23.705216 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" event={"ID":"22fd7258d42e3c88809b91d36bbeabd9","Type":"ContainerStarted","Data":"e47954e18eb0d6999752b72118f13daafd6c15244089119bf6f5be488ada502f"} Jul 24 00:14:23.708136 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:23.708098 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" event={"ID":"a60f006d-3574-472d-85b1-ae2921f52ac3","Type":"ContainerStarted","Data":"3c09ac424869249b38908e002eae174fd26de1daa3a7a3ffe83f3ea29f269e70"} Jul 24 00:14:23.719664 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:23.719613 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-20.ec2.internal" podStartSLOduration=22.719593025 podStartE2EDuration="22.719593025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 00:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:14:23.719559029 +0000 UTC m=+24.723118378" watchObservedRunningTime="2026-07-24 00:14:23.719593025 +0000 UTC m=+24.723152372" Jul 24 00:14:23.725354 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:23.725283 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:23.784848 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:23.784799 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:24.503243 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:24.503161 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:24.560011 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:24.559984 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:24.650691 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:24.650659 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:24.712347 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:24.712310 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" event={"ID":"a60f006d-3574-472d-85b1-ae2921f52ac3","Type":"ContainerStarted","Data":"a4e3da1f7bd2caf2afd8eb5097c8d723cc4c7ade9c6e7e3d2bd58be37327134f"} Jul 24 00:14:24.716103 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:24.716063 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" event={"ID":"49d3d12c-13f1-42ff-8685-40a6a459b43f","Type":"ContainerStarted","Data":"80455e86d16f7eb56da505286f7b749ebd1d26a34002ee345dc9d94a2bd32682"} Jul 24 00:14:24.730766 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:24.730673 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs555" podStartSLOduration=3.409299534 podStartE2EDuration="25.730654073s" totalImagesPullingTime="22.321354539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 00:13:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:14:24.730158866 +0000 UTC m=+25.733718214" watchObservedRunningTime="2026-07-24 00:14:24.730654073 +0000 UTC m=+25.734213422" Jul 24 00:14:25.045750 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:25.045665 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:25.101115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:25.101067 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:25.471623 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:25.471538 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:25.471814 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:25.471538 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:25.471814 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:25.471673 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:25.471814 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:25.471538 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:25.471814 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:25.471755 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:25.472029 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:25.471836 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:26.050878 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:26.050840 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2zcbw" Jul 24 00:14:26.051587 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:26.051559 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2zcbw" Jul 24 00:14:26.278980 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:26.278947 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:26.333184 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:26.333103 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:26.720791 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:26.720717 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2zcbw" Jul 24 00:14:26.721288 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:26.721267 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2zcbw" Jul 24 00:14:26.780722 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:26.780689 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:27.471055 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:27.471012 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:27.471055 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:27.471011 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:27.471536 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:27.471164 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:27.471536 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:27.471013 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:27.471536 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:27.471294 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:27.471536 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:27.471385 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:28.259042 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:28.258884 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:28.315847 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:28.315820 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:28.682918 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:28.682887 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:28.729272 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:28.729239 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" event={"ID":"49d3d12c-13f1-42ff-8685-40a6a459b43f","Type":"ContainerStarted","Data":"5b4b229f35fdbb56171e9170fe7fcf3e2a85b23d61979e3e626218a51c68533a"} Jul 24 00:14:28.729597 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:28.729569 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:28.731073 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:28.731049 2588 generic.go:356] "Generic (PLEG): container finished" podID="f96ed08f-e197-4605-9703-822195dec9c7" containerID="6c4f4a13f9d5c56a60be5f278e6b6cbc5ffa226fb2c694449b00382143eada03" exitCode=0 Jul 24 00:14:28.731188 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:28.731113 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b9tv" event={"ID":"f96ed08f-e197-4605-9703-822195dec9c7","Type":"ContainerDied","Data":"6c4f4a13f9d5c56a60be5f278e6b6cbc5ffa226fb2c694449b00382143eada03"} Jul 24 00:14:28.745712 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:28.745689 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:28.757824 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:28.757799 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:28.785331 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:28.785284 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" podStartSLOduration=10.046328826 podStartE2EDuration="29.785269638s" totalImagesPullingTime="19.738940812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 00:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:14:28.755538895 +0000 UTC m=+29.759098220" watchObservedRunningTime="2026-07-24 00:14:28.785269638 +0000 UTC m=+29.788828984" Jul 24 00:14:28.871118 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:28.871067 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:28.952864 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:28.952786 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:29.032234 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.032202 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:29.472614 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.472581 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:29.472780 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:29.472677 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:29.472780 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.472687 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:29.472780 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.472709 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:29.472920 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:29.472881 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:29.473011 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:29.472993 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:29.632426 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.632182 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:29.733755 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.733654 2588 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 24 00:14:29.734192 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.734062 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:29.749768 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.749744 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:29.811001 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.810963 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jnljx"] Jul 24 00:14:29.811199 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.811179 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:29.811313 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:29.811288 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:29.814454 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.814422 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z6qkx"] Jul 24 00:14:29.814581 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.814527 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:29.814647 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:29.814626 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:29.815339 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.815267 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xbmxv"] Jul 24 00:14:29.815466 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:29.815373 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:29.815525 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:29.815479 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:30.615434 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:30.615398 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:30.683210 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:30.683178 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:30.738238 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:30.738207 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b9tv" event={"ID":"f96ed08f-e197-4605-9703-822195dec9c7","Type":"ContainerStarted","Data":"5e0447c175d721f3847d58eb5f55cecb3a12a70c0379fa810470fdce3ae9732e"} Jul 24 00:14:30.738732 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:30.738295 2588 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 24 00:14:30.781099 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:30.781057 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:31.049434 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:31.049397 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:31.471248 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:31.471154 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:31.471248 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:31.471179 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:31.471248 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:31.471154 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:31.471508 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:31.471280 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:31.471508 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:31.471351 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:31.471508 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:31.471443 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:31.550919 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:31.550885 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:31.743116 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:31.743024 2588 generic.go:356] "Generic (PLEG): container finished" podID="f96ed08f-e197-4605-9703-822195dec9c7" containerID="5e0447c175d721f3847d58eb5f55cecb3a12a70c0379fa810470fdce3ae9732e" exitCode=0 Jul 24 00:14:31.743116 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:31.743100 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b9tv" event={"ID":"f96ed08f-e197-4605-9703-822195dec9c7","Type":"ContainerDied","Data":"5e0447c175d721f3847d58eb5f55cecb3a12a70c0379fa810470fdce3ae9732e"} Jul 24 00:14:31.975679 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:31.975648 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b2mj5_ff5b60fa-0e53-444d-935f-7aaae67eee3e/dns-node-resolver/0.log" Jul 24 00:14:32.485458 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:32.485426 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:32.725804 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:32.725768 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:32.759256 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:32.759179 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48hd9" Jul 24 00:14:33.072351 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:33.072323 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:33.072484 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:33.072467 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:33.072542 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:33.072531 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret podName:4dda38d3-0c29-499b-93bd-b9accf7c4cb3 nodeName:}" failed. No retries permitted until 2026-07-24 00:15:05.072516157 +0000 UTC m=+66.076075487 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret") pod "global-pull-secret-syncer-jnljx" (UID: "4dda38d3-0c29-499b-93bd-b9accf7c4cb3") : object "kube-system"/"original-pull-secret" not registered Jul 24 00:14:33.173245 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:33.173215 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:33.173388 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:33.173348 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:33.173435 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:33.173400 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs podName:08af4545-5d43-4166-b9e7-c98b4af01da9 nodeName:}" failed. No retries permitted until 2026-07-24 00:15:05.173386496 +0000 UTC m=+66.176945825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs") pod "network-metrics-daemon-xbmxv" (UID: "08af4545-5d43-4166-b9e7-c98b4af01da9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 00:14:33.174958 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:33.174942 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p45bc_c680d364-22c9-4026-8364-19ad2fa7a6c7/node-ca/0.log" Jul 24 00:14:33.274220 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:33.274158 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqvb\" (UniqueName: \"kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb\") pod \"network-check-target-z6qkx\" (UID: \"f7fe8ab4-f1db-40ab-8c20-92c6210bfe59\") " pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:33.274324 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:33.274309 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 00:14:33.274367 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:33.274330 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 00:14:33.274367 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:33.274339 2588 projected.go:196] Error preparing data for projected volume kube-api-access-rqqvb for pod openshift-network-diagnostics/network-check-target-z6qkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:33.274437 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:33.274388 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb podName:f7fe8ab4-f1db-40ab-8c20-92c6210bfe59 nodeName:}" failed. No retries permitted until 2026-07-24 00:15:05.274371098 +0000 UTC m=+66.277930425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqvb" (UniqueName: "kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb") pod "network-check-target-z6qkx" (UID: "f7fe8ab4-f1db-40ab-8c20-92c6210bfe59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 00:14:33.306811 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:33.306782 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:33.408493 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:33.408466 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:33.471664 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:33.471626 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:33.471826 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:33.471672 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:33.471826 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:33.471626 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:33.471826 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:33.471751 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:33.471941 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:33.471821 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:33.471984 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:33.471929 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:33.752240 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:33.752157 2588 generic.go:356] "Generic (PLEG): container finished" podID="f96ed08f-e197-4605-9703-822195dec9c7" containerID="4c629e5b3c9520c72e8c9f6c2c91d75cbbb723be255ddb9bff936c55e98f2025" exitCode=0 Jul 24 00:14:33.752365 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:33.752240 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b9tv" event={"ID":"f96ed08f-e197-4605-9703-822195dec9c7","Type":"ContainerDied","Data":"4c629e5b3c9520c72e8c9f6c2c91d75cbbb723be255ddb9bff936c55e98f2025"} Jul 24 00:14:34.190922 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:34.190850 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:34.391684 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:34.391656 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:34.492351 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:34.492274 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:34.814274 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:34.814198 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:34.985973 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:34.985938 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:35.471388 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:35.471174 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:35.471831 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:35.471175 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:35.471831 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:35.471480 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:35.471831 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:35.471558 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:35.471831 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:35.471226 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:35.471831 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:35.471639 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:35.596044 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:35.596000 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:35.985185 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:35.985154 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:36.193094 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:36.193049 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:36.392013 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:36.391970 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:36.495046 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:36.495000 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:36.596913 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:36.596877 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:36.742183 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:36.742106 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:36.990859 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:36.990819 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:37.044833 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:37.044753 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:37.389835 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:37.389803 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:37.446909 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:37.446872 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:37.472044 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:37.471973 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:37.472228 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:37.471975 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:37.472228 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:37.472126 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:37.472228 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:37.472122 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:37.472228 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:37.472218 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:37.472425 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:37.472307 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:37.632032 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:37.631996 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:37.988410 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:37.988375 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:38.387352 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:38.387319 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:38.706593 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:38.706509 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:38.807222 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:38.807194 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:38.983661 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:38.983582 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:39.382984 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:39.382960 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:39.472566 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:39.472535 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:39.472738 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:39.472633 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:39.472738 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:39.472652 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:39.472738 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:39.472679 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:39.472909 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:39.472762 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:39.472909 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:39.472866 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:39.768813 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:39.768746 2588 generic.go:356] "Generic (PLEG): container finished" podID="f96ed08f-e197-4605-9703-822195dec9c7" containerID="1fa1bc6614dc0a14a8daddb22877b24dc0ad2e3ee60e7c841942dfc6ddcc4c72" exitCode=0 Jul 24 00:14:39.768813 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:39.768805 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b9tv" event={"ID":"f96ed08f-e197-4605-9703-822195dec9c7","Type":"ContainerDied","Data":"1fa1bc6614dc0a14a8daddb22877b24dc0ad2e3ee60e7c841942dfc6ddcc4c72"} Jul 24 00:14:39.895629 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:39.895604 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:40.184898 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:40.184865 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:40.403673 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:40.403639 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:40.590710 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:40.590682 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:40.773959 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:40.773931 2588 generic.go:356] "Generic (PLEG): container finished" podID="f96ed08f-e197-4605-9703-822195dec9c7" containerID="af3ab948842952ed62f497c6207bc17a34f3be196468b7def66794d037d72d2c" exitCode=0 Jul 24 00:14:40.774338 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:40.773987 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b9tv" event={"ID":"f96ed08f-e197-4605-9703-822195dec9c7","Type":"ContainerDied","Data":"af3ab948842952ed62f497c6207bc17a34f3be196468b7def66794d037d72d2c"} Jul 24 00:14:40.790687 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:40.790662 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:41.471757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:41.471724 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:41.471933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:41.471723 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:41.471933 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:41.471825 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:41.471933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:41.471723 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:41.471933 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:41.471910 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:41.472098 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:41.471965 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:41.779851 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:41.779772 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b9tv" event={"ID":"f96ed08f-e197-4605-9703-822195dec9c7","Type":"ContainerStarted","Data":"4bcbe9766505d424cf3bc921c243c592c493b21ca7961c2a3d519e86cb7e1387"} Jul 24 00:14:41.788884 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:41.788859 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:41.803749 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:41.803707 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8b9tv" podStartSLOduration=9.35703418 podStartE2EDuration="42.803693179s" totalImagesPullingTime="33.446658999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 00:13:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:14:41.803560186 +0000 UTC m=+42.807119534" watchObservedRunningTime="2026-07-24 00:14:41.803693179 +0000 UTC m=+42.807252527" Jul 24 00:14:42.249278 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:42.249248 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:42.384876 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:42.384845 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:42.590694 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:42.590663 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:42.790556 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:42.790528 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:43.191404 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:43.191367 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:43.470928 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:43.470842 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:43.470928 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:43.470910 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:43.471171 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:43.470873 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:43.471171 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:43.470986 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:43.471171 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:43.471072 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:43.471171 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:43.471151 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:45.471209 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:45.471163 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:45.471775 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:45.471163 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:45.471775 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:45.471272 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:45.471775 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:45.471174 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:45.471775 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:45.471416 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:45.471775 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:45.471458 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:47.471463 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:47.471424 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:47.471833 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:47.471424 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:47.471833 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:47.471544 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:47.471833 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:47.471598 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:47.471833 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:47.471435 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:47.471833 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:47.471663 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:49.472522 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:49.472495 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:49.472898 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:49.472578 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:49.472898 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:49.472611 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:49.472898 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:49.472628 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:49.472898 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:49.472728 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:49.472898 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:49.472752 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:51.378576 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:51.378543 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:51.471923 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:51.471887 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:51.472106 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:51.471890 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:51.472106 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:51.472009 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:51.472106 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:51.471890 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:51.472106 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:51.472067 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:51.472243 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:51.472151 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:51.477731 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:51.477708 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:51.537946 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:51.537915 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:51.656661 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:51.656582 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:51.857675 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:51.857631 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:51.909906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:51.909832 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:52.434496 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:52.434469 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:52.535306 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:52.535276 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:52.666758 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:52.666727 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:52.867276 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:52.867243 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:52.916187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:52.916135 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:53.048752 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:53.048722 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:53.302947 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:53.302881 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:53.471552 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:53.471510 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:53.471914 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:53.471510 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:53.471914 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:53.471652 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:53.471914 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:53.471647 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnljx" podUID="4dda38d3-0c29-499b-93bd-b9accf7c4cb3" Jul 24 00:14:53.471914 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:53.471748 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbmxv" podUID="08af4545-5d43-4166-b9e7-c98b4af01da9" Jul 24 00:14:53.471914 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:14:53.471803 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6qkx" podUID="f7fe8ab4-f1db-40ab-8c20-92c6210bfe59" Jul 24 00:14:53.499290 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:53.499233 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:53.584087 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:53.584059 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:53.681072 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:53.681042 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:53.793712 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:53.793680 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:53.890040 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:53.890018 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:54.325605 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.325583 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-20.ec2.internal" event="NodeReady" Jul 24 00:14:54.325769 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.325717 2588 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 00:14:54.382711 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.382683 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fn7qt"] Jul 24 00:14:54.402499 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.402474 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qt8k5"] Jul 24 00:14:54.402623 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.402602 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fn7qt" Jul 24 00:14:54.404872 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.404843 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 00:14:54.404998 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.404884 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dwpqv\"" Jul 24 00:14:54.404998 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.404885 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 00:14:54.404998 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.404984 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 00:14:54.414416 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.414397 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fn7qt"] Jul 24 00:14:54.414511 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.414424 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qt8k5"] Jul 24 00:14:54.414511 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.414492 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.416846 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.416819 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dvjcq\"" Jul 24 00:14:54.416965 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.416879 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 00:14:54.416965 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.416930 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 00:14:54.436795 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.436769 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce0c13fa-1239-4b6c-92d0-bf1475b1ca64-config-volume\") pod \"dns-default-qt8k5\" (UID: \"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64\") " pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.436895 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.436800 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0c13fa-1239-4b6c-92d0-bf1475b1ca64-metrics-tls\") pod \"dns-default-qt8k5\" (UID: \"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64\") " pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.436895 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.436819 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mhvs\" (UniqueName: \"kubernetes.io/projected/ce0c13fa-1239-4b6c-92d0-bf1475b1ca64-kube-api-access-8mhvs\") pod \"dns-default-qt8k5\" (UID: \"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64\") " pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.436895 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.436839 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63bc5548-6bb1-4ce7-8fc4-a032536cfaa3-cert\") pod \"ingress-canary-fn7qt\" (UID: \"63bc5548-6bb1-4ce7-8fc4-a032536cfaa3\") " pod="openshift-ingress-canary/ingress-canary-fn7qt" Jul 24 00:14:54.436989 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.436898 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce0c13fa-1239-4b6c-92d0-bf1475b1ca64-tmp-dir\") pod \"dns-default-qt8k5\" (UID: \"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64\") " pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.437026 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.437000 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xkvp\" (UniqueName: \"kubernetes.io/projected/63bc5548-6bb1-4ce7-8fc4-a032536cfaa3-kube-api-access-8xkvp\") pod \"ingress-canary-fn7qt\" (UID: \"63bc5548-6bb1-4ce7-8fc4-a032536cfaa3\") " pod="openshift-ingress-canary/ingress-canary-fn7qt" Jul 24 00:14:54.479402 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.479372 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8cwl2"] Jul 24 00:14:54.501168 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.501146 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8cwl2"] Jul 24 00:14:54.501271 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.501257 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.503633 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.503614 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 00:14:54.503633 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.503630 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 00:14:54.503848 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.503678 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mtjsg\"" Jul 24 00:14:54.503848 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.503630 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 00:14:54.503848 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.503765 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 00:14:54.512293 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.512273 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:54.537916 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.537893 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkvp\" (UniqueName: \"kubernetes.io/projected/63bc5548-6bb1-4ce7-8fc4-a032536cfaa3-kube-api-access-8xkvp\") pod \"ingress-canary-fn7qt\" (UID: \"63bc5548-6bb1-4ce7-8fc4-a032536cfaa3\") " pod="openshift-ingress-canary/ingress-canary-fn7qt" Jul 24 00:14:54.538021 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.537937 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c700810b-d686-448a-adf3-c8d334aa2f01-data-volume\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.538021 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.537955 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c700810b-d686-448a-adf3-c8d334aa2f01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.538021 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.537970 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsfbv\" (UniqueName: \"kubernetes.io/projected/c700810b-d686-448a-adf3-c8d334aa2f01-kube-api-access-nsfbv\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.538021 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.538012 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce0c13fa-1239-4b6c-92d0-bf1475b1ca64-config-volume\") pod \"dns-default-qt8k5\" (UID: \"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64\") " pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.538228 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.538047 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0c13fa-1239-4b6c-92d0-bf1475b1ca64-metrics-tls\") pod \"dns-default-qt8k5\" (UID: \"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64\") " pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.538228 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.538073 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mhvs\" (UniqueName: \"kubernetes.io/projected/ce0c13fa-1239-4b6c-92d0-bf1475b1ca64-kube-api-access-8mhvs\") pod \"dns-default-qt8k5\" (UID: \"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64\") " pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.538228 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.538107 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63bc5548-6bb1-4ce7-8fc4-a032536cfaa3-cert\") pod \"ingress-canary-fn7qt\" (UID: \"63bc5548-6bb1-4ce7-8fc4-a032536cfaa3\") " pod="openshift-ingress-canary/ingress-canary-fn7qt" Jul 24 00:14:54.538228 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.538122 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce0c13fa-1239-4b6c-92d0-bf1475b1ca64-tmp-dir\") pod \"dns-default-qt8k5\" (UID: \"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64\") " pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.538228 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.538139 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c700810b-d686-448a-adf3-c8d334aa2f01-crio-socket\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.538228 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.538205 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c700810b-d686-448a-adf3-c8d334aa2f01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.538492 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.538475 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce0c13fa-1239-4b6c-92d0-bf1475b1ca64-tmp-dir\") pod \"dns-default-qt8k5\" (UID: \"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64\") " pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.538570 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.538555 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce0c13fa-1239-4b6c-92d0-bf1475b1ca64-config-volume\") pod \"dns-default-qt8k5\" (UID: \"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64\") " pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.541967 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.541940 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0c13fa-1239-4b6c-92d0-bf1475b1ca64-metrics-tls\") pod \"dns-default-qt8k5\" (UID: \"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64\") " pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.542048 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.541992 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63bc5548-6bb1-4ce7-8fc4-a032536cfaa3-cert\") pod \"ingress-canary-fn7qt\" (UID: \"63bc5548-6bb1-4ce7-8fc4-a032536cfaa3\") " pod="openshift-ingress-canary/ingress-canary-fn7qt" Jul 24 00:14:54.546064 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.546041 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mhvs\" (UniqueName: \"kubernetes.io/projected/ce0c13fa-1239-4b6c-92d0-bf1475b1ca64-kube-api-access-8mhvs\") pod \"dns-default-qt8k5\" (UID: \"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64\") " pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.546423 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.546404 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xkvp\" (UniqueName: \"kubernetes.io/projected/63bc5548-6bb1-4ce7-8fc4-a032536cfaa3-kube-api-access-8xkvp\") pod \"ingress-canary-fn7qt\" (UID: \"63bc5548-6bb1-4ce7-8fc4-a032536cfaa3\") " pod="openshift-ingress-canary/ingress-canary-fn7qt" Jul 24 00:14:54.577409 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.577342 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:14:54.638712 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.638682 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c700810b-d686-448a-adf3-c8d334aa2f01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.638869 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.638732 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c700810b-d686-448a-adf3-c8d334aa2f01-data-volume\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.638869 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.638751 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c700810b-d686-448a-adf3-c8d334aa2f01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.638869 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.638766 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsfbv\" (UniqueName: \"kubernetes.io/projected/c700810b-d686-448a-adf3-c8d334aa2f01-kube-api-access-nsfbv\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.638869 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.638795 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c700810b-d686-448a-adf3-c8d334aa2f01-crio-socket\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.638869 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.638859 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c700810b-d686-448a-adf3-c8d334aa2f01-crio-socket\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.639144 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.639123 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c700810b-d686-448a-adf3-c8d334aa2f01-data-volume\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.639329 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.639312 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c700810b-d686-448a-adf3-c8d334aa2f01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.641002 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.640974 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c700810b-d686-448a-adf3-c8d334aa2f01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.647291 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.647271 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsfbv\" (UniqueName: \"kubernetes.io/projected/c700810b-d686-448a-adf3-c8d334aa2f01-kube-api-access-nsfbv\") pod \"insights-runtime-extractor-8cwl2\" (UID: \"c700810b-d686-448a-adf3-c8d334aa2f01\") " pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.712299 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.712261 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fn7qt" Jul 24 00:14:54.722698 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.722669 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qt8k5" Jul 24 00:14:54.809141 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.809119 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8cwl2" Jul 24 00:14:54.853432 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.853330 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fn7qt"] Jul 24 00:14:54.857366 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:54.857303 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63bc5548_6bb1_4ce7_8fc4_a032536cfaa3.slice/crio-fa4c05316df3fbe71a3aa9ae711aa4975899c63cd7dfc86622cdec80a9200ca7 WatchSource:0}: Error finding container fa4c05316df3fbe71a3aa9ae711aa4975899c63cd7dfc86622cdec80a9200ca7: Status 404 returned error can't find the container with id fa4c05316df3fbe71a3aa9ae711aa4975899c63cd7dfc86622cdec80a9200ca7 Jul 24 00:14:54.866320 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.866296 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qt8k5"] Jul 24 00:14:54.873280 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:54.873258 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce0c13fa_1239_4b6c_92d0_bf1475b1ca64.slice/crio-215189c22d037e2f6359f4af92df758dccf68264ebbe300cc4bf76595b9cda4a WatchSource:0}: Error finding container 215189c22d037e2f6359f4af92df758dccf68264ebbe300cc4bf76595b9cda4a: Status 404 returned error can't find the container with id 215189c22d037e2f6359f4af92df758dccf68264ebbe300cc4bf76595b9cda4a Jul 24 00:14:54.935512 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:54.935484 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8cwl2"] Jul 24 00:14:54.938674 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:14:54.938648 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc700810b_d686_448a_adf3_c8d334aa2f01.slice/crio-1b696467f346c36c81457d9e056289987411e1d2371fb9904302feb98370a16a WatchSource:0}: Error finding container 1b696467f346c36c81457d9e056289987411e1d2371fb9904302feb98370a16a: Status 404 returned error can't find the container with id 1b696467f346c36c81457d9e056289987411e1d2371fb9904302feb98370a16a Jul 24 00:14:55.476144 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:55.476115 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:14:55.476530 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:55.476514 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:14:55.476961 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:55.476944 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:14:55.481725 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:55.481700 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gpdt7\"" Jul 24 00:14:55.482114 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:55.481759 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 00:14:55.482114 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:55.481911 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 00:14:55.482114 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:55.481921 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jq7gh\"" Jul 24 00:14:55.482114 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:55.482034 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 00:14:55.482320 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:55.482170 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 00:14:55.813948 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:55.813868 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cwl2" event={"ID":"c700810b-d686-448a-adf3-c8d334aa2f01","Type":"ContainerStarted","Data":"1b696467f346c36c81457d9e056289987411e1d2371fb9904302feb98370a16a"} Jul 24 00:14:55.815902 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:55.815870 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fn7qt" event={"ID":"63bc5548-6bb1-4ce7-8fc4-a032536cfaa3","Type":"ContainerStarted","Data":"fa4c05316df3fbe71a3aa9ae711aa4975899c63cd7dfc86622cdec80a9200ca7"} Jul 24 00:14:55.817435 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:55.817409 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qt8k5" event={"ID":"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64","Type":"ContainerStarted","Data":"215189c22d037e2f6359f4af92df758dccf68264ebbe300cc4bf76595b9cda4a"} Jul 24 00:14:59.281527 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.281492 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-744f65bdfb-4w7p5"] Jul 24 00:14:59.310645 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.310615 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-744f65bdfb-4w7p5"] Jul 24 00:14:59.310814 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.310726 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.314053 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.314027 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 00:14:59.314053 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.314062 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 00:14:59.314339 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.314139 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wgfmx\"" Jul 24 00:14:59.314339 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.314153 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 00:14:59.314493 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.314474 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 00:14:59.314596 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.314497 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 00:14:59.314760 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.314745 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 00:14:59.314803 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.314762 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 00:14:59.376349 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.376312 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpq7j\" (UniqueName: \"kubernetes.io/projected/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-kube-api-access-wpq7j\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.376512 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.376380 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-service-ca\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.376512 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.376456 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-oauth-config\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.376512 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.376479 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-config\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.376644 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.376513 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-oauth-serving-cert\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.376644 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.376581 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-serving-cert\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.477507 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.477476 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpq7j\" (UniqueName: \"kubernetes.io/projected/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-kube-api-access-wpq7j\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.477697 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.477548 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-service-ca\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.477697 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.477579 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-oauth-config\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.477697 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.477602 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-config\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.477697 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.477636 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-oauth-serving-cert\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.477697 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.477683 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-serving-cert\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.478858 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.478806 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-config\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.479300 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.479271 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-oauth-serving-cert\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.479434 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.479278 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-service-ca\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.480420 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.480394 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-serving-cert\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.480552 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.480531 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-oauth-config\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.486242 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.486208 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpq7j\" (UniqueName: \"kubernetes.io/projected/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-kube-api-access-wpq7j\") pod \"console-744f65bdfb-4w7p5\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.632218 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.632176 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:14:59.692862 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:14:59.692832 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:00.277074 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.277043 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:00.359754 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.359713 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:00.441179 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.441152 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:00.448229 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.448205 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8"] Jul 24 00:15:00.464970 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.464940 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8"] Jul 24 00:15:00.465164 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.465105 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8" Jul 24 00:15:00.468294 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.468168 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 00:15:00.468294 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.468206 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ptfxh\"" Jul 24 00:15:00.549845 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.549807 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:00.565167 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.565144 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-744f65bdfb-4w7p5"] Jul 24 00:15:00.567952 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:00.567929 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39bbbdfc_cbf2_4068_bacc_e9df2b2c24d1.slice/crio-0d2d4846c7be6dedc2cdc65469f2f244efbb92f1cd91c5517eee8f8f845fc0de WatchSource:0}: Error finding container 0d2d4846c7be6dedc2cdc65469f2f244efbb92f1cd91c5517eee8f8f845fc0de: Status 404 returned error can't find the container with id 0d2d4846c7be6dedc2cdc65469f2f244efbb92f1cd91c5517eee8f8f845fc0de Jul 24 00:15:00.586573 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.586552 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/178bd686-b849-4054-8c58-d67e3b77e3b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-2tbq8\" (UID: \"178bd686-b849-4054-8c58-d67e3b77e3b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8" Jul 24 00:15:00.687397 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.687360 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/178bd686-b849-4054-8c58-d67e3b77e3b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-2tbq8\" (UID: \"178bd686-b849-4054-8c58-d67e3b77e3b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8" Jul 24 00:15:00.689826 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.689804 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/178bd686-b849-4054-8c58-d67e3b77e3b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-2tbq8\" (UID: \"178bd686-b849-4054-8c58-d67e3b77e3b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8" Jul 24 00:15:00.776188 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.776120 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8" Jul 24 00:15:00.834822 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.834795 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744f65bdfb-4w7p5" event={"ID":"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1","Type":"ContainerStarted","Data":"0d2d4846c7be6dedc2cdc65469f2f244efbb92f1cd91c5517eee8f8f845fc0de"} Jul 24 00:15:00.836185 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.836161 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fn7qt" event={"ID":"63bc5548-6bb1-4ce7-8fc4-a032536cfaa3","Type":"ContainerStarted","Data":"0678a422b22ce109fe81889b9b7a0b2ebc15a436630b32ed81dc0a0fd61b5073"} Jul 24 00:15:00.838321 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.838298 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qt8k5" event={"ID":"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64","Type":"ContainerStarted","Data":"e24ae2fc7be5101c41116bcc4cf9e210d34601b4f33e23cd0d87094b7bb2a3c1"} Jul 24 00:15:00.948442 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.948386 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fn7qt" podStartSLOduration=1.375243657 podStartE2EDuration="6.9483663s" totalImagesPullingTime="5.573122643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:00.854777404 +0000 UTC m=+61.858336754" watchObservedRunningTime="2026-07-24 00:15:00.9483663 +0000 UTC m=+61.951925646" Jul 24 00:15:00.948612 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:00.948560 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8"] Jul 24 00:15:00.951344 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:00.951318 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178bd686_b849_4054_8c58_d67e3b77e3b3.slice/crio-13781ac3fb930fd77630417a7f542859a51af14cc6f78f7d03991b98a1f2bbb4 WatchSource:0}: Error finding container 13781ac3fb930fd77630417a7f542859a51af14cc6f78f7d03991b98a1f2bbb4: Status 404 returned error can't find the container with id 13781ac3fb930fd77630417a7f542859a51af14cc6f78f7d03991b98a1f2bbb4 Jul 24 00:15:01.852221 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:01.852177 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qt8k5" event={"ID":"ce0c13fa-1239-4b6c-92d0-bf1475b1ca64","Type":"ContainerStarted","Data":"b0c340e032f427bcb4f9460832307bf4dd731858120d1449328ae1e2bc168284"} Jul 24 00:15:01.852989 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:01.852966 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qt8k5" Jul 24 00:15:01.857225 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:01.857199 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cwl2" event={"ID":"c700810b-d686-448a-adf3-c8d334aa2f01","Type":"ContainerStarted","Data":"da8ada4437feaadc4d922c1dbce6ad2bb24bf4a5443b52c577be7bda836e05a3"} Jul 24 00:15:01.860235 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:01.860203 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8" event={"ID":"178bd686-b849-4054-8c58-d67e3b77e3b3","Type":"ContainerStarted","Data":"13781ac3fb930fd77630417a7f542859a51af14cc6f78f7d03991b98a1f2bbb4"} Jul 24 00:15:02.864572 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:02.864530 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8" event={"ID":"178bd686-b849-4054-8c58-d67e3b77e3b3","Type":"ContainerStarted","Data":"d1288438acf37e554c74a45be693404cccdf7626a42d22e96072711b0a864fdb"} Jul 24 00:15:02.880103 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:02.879852 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8" podStartSLOduration=1.176320057 podStartE2EDuration="2.879829666s" totalImagesPullingTime="1.703509609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:02.879480555 +0000 UTC m=+63.883039899" watchObservedRunningTime="2026-07-24 00:15:02.879829666 +0000 UTC m=+63.883389016" Jul 24 00:15:02.880940 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:02.880331 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qt8k5" podStartSLOduration=3.3245288459999998 podStartE2EDuration="8.880318925s" totalImagesPullingTime="5.555790079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:01.869584257 +0000 UTC m=+62.873143606" watchObservedRunningTime="2026-07-24 00:15:02.880318925 +0000 UTC m=+63.883878273" Jul 24 00:15:03.061176 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:03.061015 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:03.116846 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:03.116811 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:03.868194 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:03.868149 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8" Jul 24 00:15:03.873099 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:03.873064 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2tbq8" Jul 24 00:15:04.474348 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.474267 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:04.514553 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.514524 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-pxfgc"] Jul 24 00:15:04.517917 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.517894 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.520551 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.520529 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 00:15:04.521523 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.521488 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 00:15:04.521633 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.521545 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 24 00:15:04.521633 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.521591 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 00:15:04.521801 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.521785 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 24 00:15:04.521862 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.521812 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-44xqh\"" Jul 24 00:15:04.530188 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.530149 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-pxfgc"] Jul 24 00:15:04.544197 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.544169 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:04.600716 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.600672 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:04.625846 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.625800 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/40c29daa-314d-451c-a4fc-76bb976ca837-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pxfgc\" (UID: \"40c29daa-314d-451c-a4fc-76bb976ca837\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.626027 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.625857 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzwnc\" (UniqueName: \"kubernetes.io/projected/40c29daa-314d-451c-a4fc-76bb976ca837-kube-api-access-nzwnc\") pod \"prometheus-operator-84d69f794d-pxfgc\" (UID: \"40c29daa-314d-451c-a4fc-76bb976ca837\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.626027 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.625884 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40c29daa-314d-451c-a4fc-76bb976ca837-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-pxfgc\" (UID: \"40c29daa-314d-451c-a4fc-76bb976ca837\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.626027 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.625911 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40c29daa-314d-451c-a4fc-76bb976ca837-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-pxfgc\" (UID: \"40c29daa-314d-451c-a4fc-76bb976ca837\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.699734 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.699699 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:04.726529 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.726447 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/40c29daa-314d-451c-a4fc-76bb976ca837-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pxfgc\" (UID: \"40c29daa-314d-451c-a4fc-76bb976ca837\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.726529 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.726496 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzwnc\" (UniqueName: \"kubernetes.io/projected/40c29daa-314d-451c-a4fc-76bb976ca837-kube-api-access-nzwnc\") pod \"prometheus-operator-84d69f794d-pxfgc\" (UID: \"40c29daa-314d-451c-a4fc-76bb976ca837\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.726736 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.726542 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40c29daa-314d-451c-a4fc-76bb976ca837-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-pxfgc\" (UID: \"40c29daa-314d-451c-a4fc-76bb976ca837\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.726736 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.726571 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40c29daa-314d-451c-a4fc-76bb976ca837-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-pxfgc\" (UID: \"40c29daa-314d-451c-a4fc-76bb976ca837\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.727507 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.727365 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40c29daa-314d-451c-a4fc-76bb976ca837-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-pxfgc\" (UID: \"40c29daa-314d-451c-a4fc-76bb976ca837\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.729275 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.729215 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40c29daa-314d-451c-a4fc-76bb976ca837-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-pxfgc\" (UID: \"40c29daa-314d-451c-a4fc-76bb976ca837\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.729398 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.729315 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/40c29daa-314d-451c-a4fc-76bb976ca837-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pxfgc\" (UID: \"40c29daa-314d-451c-a4fc-76bb976ca837\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.735572 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.735543 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzwnc\" (UniqueName: \"kubernetes.io/projected/40c29daa-314d-451c-a4fc-76bb976ca837-kube-api-access-nzwnc\") pod \"prometheus-operator-84d69f794d-pxfgc\" (UID: \"40c29daa-314d-451c-a4fc-76bb976ca837\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:04.828191 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:04.828162 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" Jul 24 00:15:05.129769 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.129734 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:15:05.132249 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.132229 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 00:15:05.142016 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.141997 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4dda38d3-0c29-499b-93bd-b9accf7c4cb3-original-pull-secret\") pod \"global-pull-secret-syncer-jnljx\" (UID: \"4dda38d3-0c29-499b-93bd-b9accf7c4cb3\") " pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:15:05.230485 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.230441 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:15:05.232936 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.232900 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 00:15:05.243881 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.243857 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08af4545-5d43-4166-b9e7-c98b4af01da9-metrics-certs\") pod \"network-metrics-daemon-xbmxv\" (UID: \"08af4545-5d43-4166-b9e7-c98b4af01da9\") " pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:15:05.331838 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.331803 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqvb\" (UniqueName: \"kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb\") pod \"network-check-target-z6qkx\" (UID: \"f7fe8ab4-f1db-40ab-8c20-92c6210bfe59\") " pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:15:05.334561 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.334534 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 00:15:05.344636 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.344612 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 00:15:05.356172 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.356149 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqqvb\" (UniqueName: \"kubernetes.io/projected/f7fe8ab4-f1db-40ab-8c20-92c6210bfe59-kube-api-access-rqqvb\") pod \"network-check-target-z6qkx\" (UID: \"f7fe8ab4-f1db-40ab-8c20-92c6210bfe59\") " pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:15:05.401561 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.401473 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gpdt7\"" Jul 24 00:15:05.403402 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.403380 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jq7gh\"" Jul 24 00:15:05.409833 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.409812 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:15:05.409952 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.409933 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnljx" Jul 24 00:15:05.412138 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.412114 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbmxv" Jul 24 00:15:05.662279 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.662200 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c994bd64d-sqmf6"] Jul 24 00:15:05.669266 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.669237 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.676656 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.676624 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 00:15:05.681120 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.681070 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c994bd64d-sqmf6"] Jul 24 00:15:05.704918 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.704886 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:05.734681 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.734653 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm8c6\" (UniqueName: \"kubernetes.io/projected/826eb58b-4a58-4853-935d-b99500731cfa-kube-api-access-cm8c6\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.734915 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.734688 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-service-ca\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.734915 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.734715 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/826eb58b-4a58-4853-935d-b99500731cfa-console-oauth-config\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.734915 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.734748 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-trusted-ca-bundle\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.734915 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.734815 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/826eb58b-4a58-4853-935d-b99500731cfa-console-serving-cert\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.734915 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.734854 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-oauth-serving-cert\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.734915 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.734875 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-console-config\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.770055 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.770024 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:05.826980 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.826950 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:05.835680 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.835651 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/826eb58b-4a58-4853-935d-b99500731cfa-console-oauth-config\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.835823 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.835704 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-trusted-ca-bundle\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.835823 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.835741 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/826eb58b-4a58-4853-935d-b99500731cfa-console-serving-cert\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.835823 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.835774 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-oauth-serving-cert\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.835823 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.835803 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-console-config\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.836019 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.835849 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm8c6\" (UniqueName: \"kubernetes.io/projected/826eb58b-4a58-4853-935d-b99500731cfa-kube-api-access-cm8c6\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.836019 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.835878 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-service-ca\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.837215 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.836821 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-trusted-ca-bundle\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.837215 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.836857 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-service-ca\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.837215 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.837203 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-console-config\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.837434 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.837388 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-oauth-serving-cert\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.839659 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.839638 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/826eb58b-4a58-4853-935d-b99500731cfa-console-oauth-config\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.840270 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.840245 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/826eb58b-4a58-4853-935d-b99500731cfa-console-serving-cert\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.845306 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.845257 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm8c6\" (UniqueName: \"kubernetes.io/projected/826eb58b-4a58-4853-935d-b99500731cfa-kube-api-access-cm8c6\") pod \"console-6c994bd64d-sqmf6\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.980055 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.980029 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:05.994438 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:05.994402 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-pxfgc"] Jul 24 00:15:06.001005 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:06.000963 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c29daa_314d_451c_a4fc_76bb976ca837.slice/crio-e625a3f6f14123aa6743610f27f52d3a1bd358e081926923b478f639f79f53f2 WatchSource:0}: Error finding container e625a3f6f14123aa6743610f27f52d3a1bd358e081926923b478f639f79f53f2: Status 404 returned error can't find the container with id e625a3f6f14123aa6743610f27f52d3a1bd358e081926923b478f639f79f53f2 Jul 24 00:15:06.111382 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.111350 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c994bd64d-sqmf6"] Jul 24 00:15:06.114231 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:06.114208 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826eb58b_4a58_4853_935d_b99500731cfa.slice/crio-adb5cd15788d037cbf1fc026d93415e36581aeca54f023660c4f58c68b029932 WatchSource:0}: Error finding container adb5cd15788d037cbf1fc026d93415e36581aeca54f023660c4f58c68b029932: Status 404 returned error can't find the container with id adb5cd15788d037cbf1fc026d93415e36581aeca54f023660c4f58c68b029932 Jul 24 00:15:06.221598 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.221568 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z6qkx"] Jul 24 00:15:06.224671 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:06.224628 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7fe8ab4_f1db_40ab_8c20_92c6210bfe59.slice/crio-8cc7e518770b9d30eb9d9ea9ed4f62b9c61feff19b4c572290ca32612caf459a WatchSource:0}: Error finding container 8cc7e518770b9d30eb9d9ea9ed4f62b9c61feff19b4c572290ca32612caf459a: Status 404 returned error can't find the container with id 8cc7e518770b9d30eb9d9ea9ed4f62b9c61feff19b4c572290ca32612caf459a Jul 24 00:15:06.224796 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.224775 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xbmxv"] Jul 24 00:15:06.228285 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.228221 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jnljx"] Jul 24 00:15:06.228457 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:06.228246 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08af4545_5d43_4166_b9e7_c98b4af01da9.slice/crio-8235ad2cda6aa86943001e3da2f3ab9c5e4ab140924ca1173883c3302e1ed09c WatchSource:0}: Error finding container 8235ad2cda6aa86943001e3da2f3ab9c5e4ab140924ca1173883c3302e1ed09c: Status 404 returned error can't find the container with id 8235ad2cda6aa86943001e3da2f3ab9c5e4ab140924ca1173883c3302e1ed09c Jul 24 00:15:06.233347 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:06.233314 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dda38d3_0c29_499b_93bd_b9accf7c4cb3.slice/crio-9f5bff20bec9e2025d40bf14dd9e53604499792c25d3285ca76b86cfe2223fe4 WatchSource:0}: Error finding container 9f5bff20bec9e2025d40bf14dd9e53604499792c25d3285ca76b86cfe2223fe4: Status 404 returned error can't find the container with id 9f5bff20bec9e2025d40bf14dd9e53604499792c25d3285ca76b86cfe2223fe4 Jul 24 00:15:06.884896 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.884716 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cwl2" event={"ID":"c700810b-d686-448a-adf3-c8d334aa2f01","Type":"ContainerStarted","Data":"d793bc4919739fa6593a37c8a4c28d67cb4c4218a0c1f24c0f226a42e4f15795"} Jul 24 00:15:06.886370 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.886335 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z6qkx" event={"ID":"f7fe8ab4-f1db-40ab-8c20-92c6210bfe59","Type":"ContainerStarted","Data":"8cc7e518770b9d30eb9d9ea9ed4f62b9c61feff19b4c572290ca32612caf459a"} Jul 24 00:15:06.887827 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.887752 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" event={"ID":"40c29daa-314d-451c-a4fc-76bb976ca837","Type":"ContainerStarted","Data":"e625a3f6f14123aa6743610f27f52d3a1bd358e081926923b478f639f79f53f2"} Jul 24 00:15:06.891811 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.891248 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744f65bdfb-4w7p5" event={"ID":"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1","Type":"ContainerStarted","Data":"8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a"} Jul 24 00:15:06.894211 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.893683 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c994bd64d-sqmf6" event={"ID":"826eb58b-4a58-4853-935d-b99500731cfa","Type":"ContainerStarted","Data":"8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf"} Jul 24 00:15:06.894211 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.893726 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c994bd64d-sqmf6" event={"ID":"826eb58b-4a58-4853-935d-b99500731cfa","Type":"ContainerStarted","Data":"adb5cd15788d037cbf1fc026d93415e36581aeca54f023660c4f58c68b029932"} Jul 24 00:15:06.896159 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.896102 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jnljx" event={"ID":"4dda38d3-0c29-499b-93bd-b9accf7c4cb3","Type":"ContainerStarted","Data":"9f5bff20bec9e2025d40bf14dd9e53604499792c25d3285ca76b86cfe2223fe4"} Jul 24 00:15:06.898367 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.898306 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xbmxv" event={"ID":"08af4545-5d43-4166-b9e7-c98b4af01da9","Type":"ContainerStarted","Data":"8235ad2cda6aa86943001e3da2f3ab9c5e4ab140924ca1173883c3302e1ed09c"} Jul 24 00:15:06.910135 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:06.910071 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-744f65bdfb-4w7p5" podStartSLOduration=2.640277323 podStartE2EDuration="7.910051577s" totalImagesPullingTime="5.269774254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:06.90776221 +0000 UTC m=+67.911321552" watchObservedRunningTime="2026-07-24 00:15:06.910051577 +0000 UTC m=+67.913610923" Jul 24 00:15:07.392667 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:07.392587 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:07.450583 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:07.450516 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:08.264750 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:08.264639 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:08.912535 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:08.911989 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" event={"ID":"40c29daa-314d-451c-a4fc-76bb976ca837","Type":"ContainerStarted","Data":"863f18c8794f44d6202308fea069f93eb08bb74b645053e72c602b1fac72dad2"} Jul 24 00:15:08.912535 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:08.912047 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" event={"ID":"40c29daa-314d-451c-a4fc-76bb976ca837","Type":"ContainerStarted","Data":"a7bb37ec00397398652caf5b30e43be2e0aaf23b14c60e767b6b3917e3707377"} Jul 24 00:15:08.915893 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:08.915856 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xbmxv" event={"ID":"08af4545-5d43-4166-b9e7-c98b4af01da9","Type":"ContainerStarted","Data":"448ae65cb62ed8398f2e07ba1156f8b8fe8551abb26823d7dacb36721264aa7e"} Jul 24 00:15:08.915999 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:08.915919 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xbmxv" event={"ID":"08af4545-5d43-4166-b9e7-c98b4af01da9","Type":"ContainerStarted","Data":"d5607fb0e1d7567c97ecf3bdae59ad43a51fb22e2680924bbc3ea42dfe0535d7"} Jul 24 00:15:08.933827 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:08.932814 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-pxfgc" podStartSLOduration=3.031924321 podStartE2EDuration="4.932796666s" totalImagesPullingTime="1.900872345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:08.931967422 +0000 UTC m=+69.935526778" watchObservedRunningTime="2026-07-24 00:15:08.932796666 +0000 UTC m=+69.936356014" Jul 24 00:15:08.933827 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:08.932917 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c994bd64d-sqmf6" podStartSLOduration=3.932911208 podStartE2EDuration="3.932911208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:15:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:06.931006573 +0000 UTC m=+67.934565910" watchObservedRunningTime="2026-07-24 00:15:08.932911208 +0000 UTC m=+69.936470556" Jul 24 00:15:08.951092 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:08.950825 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xbmxv" podStartSLOduration=68.280830047 podStartE2EDuration="1m9.950801954s" totalImagesPullingTime="1.669971907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:08.950676519 +0000 UTC m=+69.954235867" watchObservedRunningTime="2026-07-24 00:15:08.950801954 +0000 UTC m=+69.954361301" Jul 24 00:15:09.055432 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:09.055382 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:09.121492 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:09.121457 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:09.266466 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:09.266387 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:09.632973 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:09.632934 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:15:09.633180 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:09.633040 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:15:09.639408 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:09.639377 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:15:09.875503 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:09.875447 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:09.924039 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:09.923950 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:15:10.147538 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.147501 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:10.486999 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.486935 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:10.596781 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.596745 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:10.694848 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.694813 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:10.839668 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.839635 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:10.869559 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.869524 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl"] Jul 24 00:15:10.874290 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.874269 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:10.876740 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.876719 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr"] Jul 24 00:15:10.878075 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.878045 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 24 00:15:10.878075 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.878056 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-v4vr5\"" Jul 24 00:15:10.878268 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.878051 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 24 00:15:10.880011 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.879993 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:10.883012 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.882987 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 00:15:10.883760 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.883726 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-42nbp\"" Jul 24 00:15:10.883920 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.883904 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 00:15:10.884097 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.884047 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 00:15:10.885333 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.885313 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl"] Jul 24 00:15:10.891714 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.891687 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr"] Jul 24 00:15:10.895015 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.894991 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d8fn9"] Jul 24 00:15:10.898663 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.898647 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:10.901528 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.901507 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rtkhg\"" Jul 24 00:15:10.901630 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.901604 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 00:15:10.901705 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.901626 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 00:15:10.901910 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.901889 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 00:15:10.934312 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.934281 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:10.978349 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978317 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/882f5d53-0541-446b-96ef-13a33895c1b8-sys\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:10.978516 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978361 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:10.978516 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978422 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-tls\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:10.978516 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978464 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a20a907e-7212-4580-a1c5-3156eb4e13d7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:10.978516 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978490 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a20a907e-7212-4580-a1c5-3156eb4e13d7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:10.978728 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978515 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be65a5f1-be44-4fdd-8632-6385dbee64b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:10.978728 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978579 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-wtmp\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:10.978728 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978630 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/882f5d53-0541-446b-96ef-13a33895c1b8-metrics-client-ca\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:10.978728 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978684 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be65a5f1-be44-4fdd-8632-6385dbee64b0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:10.978728 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978712 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4wcn\" (UniqueName: \"kubernetes.io/projected/be65a5f1-be44-4fdd-8632-6385dbee64b0-kube-api-access-w4wcn\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:10.978949 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978735 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghfqc\" (UniqueName: \"kubernetes.io/projected/882f5d53-0541-446b-96ef-13a33895c1b8-kube-api-access-ghfqc\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:10.978949 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978770 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a20a907e-7212-4580-a1c5-3156eb4e13d7-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:10.978949 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978816 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be65a5f1-be44-4fdd-8632-6385dbee64b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:10.978949 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978839 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a20a907e-7212-4580-a1c5-3156eb4e13d7-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:10.978949 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.978879 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr6rq\" (UniqueName: \"kubernetes.io/projected/a20a907e-7212-4580-a1c5-3156eb4e13d7-kube-api-access-cr6rq\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:10.979235 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.979025 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a20a907e-7212-4580-a1c5-3156eb4e13d7-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:10.979235 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.979061 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/882f5d53-0541-446b-96ef-13a33895c1b8-root\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:10.979235 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.979133 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-textfile\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:10.979235 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:10.979164 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.002437 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.002404 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:11.080043 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080006 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a20a907e-7212-4580-a1c5-3156eb4e13d7-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.080220 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080061 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/882f5d53-0541-446b-96ef-13a33895c1b8-root\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.080220 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080107 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-textfile\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.080220 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080130 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.080220 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080164 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/882f5d53-0541-446b-96ef-13a33895c1b8-sys\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.080220 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080193 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.080220 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080221 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-tls\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.080537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080247 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/882f5d53-0541-446b-96ef-13a33895c1b8-sys\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.080537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080272 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/882f5d53-0541-446b-96ef-13a33895c1b8-root\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.080537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080254 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a20a907e-7212-4580-a1c5-3156eb4e13d7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.080537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080341 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a20a907e-7212-4580-a1c5-3156eb4e13d7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.080537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080376 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be65a5f1-be44-4fdd-8632-6385dbee64b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:11.080537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080409 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-wtmp\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.080537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080441 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/882f5d53-0541-446b-96ef-13a33895c1b8-metrics-client-ca\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.080537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080480 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be65a5f1-be44-4fdd-8632-6385dbee64b0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:11.080537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080500 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a20a907e-7212-4580-a1c5-3156eb4e13d7-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.080537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080510 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-textfile\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.080537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080507 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4wcn\" (UniqueName: \"kubernetes.io/projected/be65a5f1-be44-4fdd-8632-6385dbee64b0-kube-api-access-w4wcn\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:11.081048 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.080660 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-wtmp\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.082614 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.081718 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghfqc\" (UniqueName: \"kubernetes.io/projected/882f5d53-0541-446b-96ef-13a33895c1b8-kube-api-access-ghfqc\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.082614 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.081804 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.082614 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:15:11.080745 2588 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 24 00:15:11.082614 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.082306 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be65a5f1-be44-4fdd-8632-6385dbee64b0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:11.082614 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.082417 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a20a907e-7212-4580-a1c5-3156eb4e13d7-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.083155 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.083063 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a20a907e-7212-4580-a1c5-3156eb4e13d7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.090190 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.083648 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a20a907e-7212-4580-a1c5-3156eb4e13d7-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.090190 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.083714 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be65a5f1-be44-4fdd-8632-6385dbee64b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:11.090190 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.083751 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a20a907e-7212-4580-a1c5-3156eb4e13d7-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.090190 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.083787 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr6rq\" (UniqueName: \"kubernetes.io/projected/a20a907e-7212-4580-a1c5-3156eb4e13d7-kube-api-access-cr6rq\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.090190 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:15:11.084314 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be65a5f1-be44-4fdd-8632-6385dbee64b0-openshift-state-metrics-tls podName:be65a5f1-be44-4fdd-8632-6385dbee64b0 nodeName:}" failed. No retries permitted until 2026-07-24 00:15:11.584292077 +0000 UTC m=+72.587851402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/be65a5f1-be44-4fdd-8632-6385dbee64b0-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-thczl" (UID: "be65a5f1-be44-4fdd-8632-6385dbee64b0") : secret "openshift-state-metrics-tls" not found Jul 24 00:15:11.090190 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.084854 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-tls\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.090190 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.085183 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/882f5d53-0541-446b-96ef-13a33895c1b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.090190 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.086921 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a20a907e-7212-4580-a1c5-3156eb4e13d7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.090190 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.087001 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be65a5f1-be44-4fdd-8632-6385dbee64b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:11.090190 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.088541 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a20a907e-7212-4580-a1c5-3156eb4e13d7-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.091054 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.091035 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/882f5d53-0541-446b-96ef-13a33895c1b8-metrics-client-ca\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.093149 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.093046 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4wcn\" (UniqueName: \"kubernetes.io/projected/be65a5f1-be44-4fdd-8632-6385dbee64b0-kube-api-access-w4wcn\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:11.093250 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.093175 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghfqc\" (UniqueName: \"kubernetes.io/projected/882f5d53-0541-446b-96ef-13a33895c1b8-kube-api-access-ghfqc\") pod \"node-exporter-d8fn9\" (UID: \"882f5d53-0541-446b-96ef-13a33895c1b8\") " pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.095918 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.095897 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr6rq\" (UniqueName: \"kubernetes.io/projected/a20a907e-7212-4580-a1c5-3156eb4e13d7-kube-api-access-cr6rq\") pod \"kube-state-metrics-56d9f944b4-xjkpr\" (UID: \"a20a907e-7212-4580-a1c5-3156eb4e13d7\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.103015 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.102941 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:11.195504 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.195461 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" Jul 24 00:15:11.203030 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.202997 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:11.209933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.209907 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d8fn9" Jul 24 00:15:11.349954 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.349870 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:11.537645 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.537614 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:11.588153 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.588116 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be65a5f1-be44-4fdd-8632-6385dbee64b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:11.590904 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.590877 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be65a5f1-be44-4fdd-8632-6385dbee64b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-thczl\" (UID: \"be65a5f1-be44-4fdd-8632-6385dbee64b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:11.787208 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.787122 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" Jul 24 00:15:11.848441 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.848377 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:11.927619 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.927586 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:11.936695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.936536 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 00:15:11.940689 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.940666 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:11.943207 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.943180 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 00:15:11.943719 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.943536 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 00:15:11.943719 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.943666 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 00:15:11.943929 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.943772 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 00:15:11.943929 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.943900 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 00:15:11.944031 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.943965 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 00:15:11.944031 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.943995 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 00:15:11.944220 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.944032 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 00:15:11.944220 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.944124 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wb6rs\"" Jul 24 00:15:11.945010 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.944991 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 00:15:11.953225 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:11.953203 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 00:15:12.052260 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.052169 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:12.092344 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092299 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-web-config\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.092344 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092342 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22245d2c-887b-43a5-8abb-6d728fc06241-config-out\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.092598 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092376 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.092598 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092413 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-config-volume\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.092598 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092436 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.092598 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092459 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22245d2c-887b-43a5-8abb-6d728fc06241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.092598 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092509 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhdwb\" (UniqueName: \"kubernetes.io/projected/22245d2c-887b-43a5-8abb-6d728fc06241-kube-api-access-qhdwb\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.092598 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092538 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22245d2c-887b-43a5-8abb-6d728fc06241-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.092845 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092627 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22245d2c-887b-43a5-8abb-6d728fc06241-tls-assets\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.092845 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092698 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.092845 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092744 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.092845 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092772 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.092845 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.092806 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/22245d2c-887b-43a5-8abb-6d728fc06241-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.193628 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193585 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22245d2c-887b-43a5-8abb-6d728fc06241-tls-assets\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.193628 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193641 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.193907 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193668 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.193907 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193695 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.193907 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193732 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/22245d2c-887b-43a5-8abb-6d728fc06241-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.193907 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193762 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-web-config\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.193907 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193783 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22245d2c-887b-43a5-8abb-6d728fc06241-config-out\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.193907 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193814 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.193907 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193858 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-config-volume\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.193907 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193884 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.193907 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193908 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22245d2c-887b-43a5-8abb-6d728fc06241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.194335 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193948 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhdwb\" (UniqueName: \"kubernetes.io/projected/22245d2c-887b-43a5-8abb-6d728fc06241-kube-api-access-qhdwb\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.194335 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.193979 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22245d2c-887b-43a5-8abb-6d728fc06241-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.195071 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.194748 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22245d2c-887b-43a5-8abb-6d728fc06241-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.195071 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.194782 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/22245d2c-887b-43a5-8abb-6d728fc06241-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.196891 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:15:12.196871 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22245d2c-887b-43a5-8abb-6d728fc06241-alertmanager-trusted-ca-bundle podName:22245d2c-887b-43a5-8abb-6d728fc06241 nodeName:}" failed. No retries permitted until 2026-07-24 00:15:12.69684663 +0000 UTC m=+73.700405969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/22245d2c-887b-43a5-8abb-6d728fc06241-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "22245d2c-887b-43a5-8abb-6d728fc06241") : configmap references non-existent config key: ca-bundle.crt Jul 24 00:15:12.197292 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.197188 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.197292 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:15:12.197199 2588 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 24 00:15:12.197292 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.197246 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.197292 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:15:12.197283 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-main-tls podName:22245d2c-887b-43a5-8abb-6d728fc06241 nodeName:}" failed. No retries permitted until 2026-07-24 00:15:12.697264844 +0000 UTC m=+73.700824173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "22245d2c-887b-43a5-8abb-6d728fc06241") : secret "alertmanager-main-tls" not found Jul 24 00:15:12.197644 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.197618 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22245d2c-887b-43a5-8abb-6d728fc06241-tls-assets\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.197839 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.197821 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22245d2c-887b-43a5-8abb-6d728fc06241-config-out\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.198148 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.198124 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.198442 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.198400 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-config-volume\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.198732 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.198709 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-web-config\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.198732 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.198709 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.205952 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.205931 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhdwb\" (UniqueName: \"kubernetes.io/projected/22245d2c-887b-43a5-8abb-6d728fc06241-kube-api-access-qhdwb\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.290486 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.290444 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:12.375292 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.375261 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:12.437133 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.437099 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:12.698445 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.698356 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.698445 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.698395 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22245d2c-887b-43a5-8abb-6d728fc06241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.699251 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.699230 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22245d2c-887b-43a5-8abb-6d728fc06241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.700996 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.700974 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/22245d2c-887b-43a5-8abb-6d728fc06241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"22245d2c-887b-43a5-8abb-6d728fc06241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.853270 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.853233 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 00:15:12.869868 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:12.869839 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qt8k5" Jul 24 00:15:13.176573 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:13.176534 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod882f5d53_0541_446b_96ef_13a33895c1b8.slice/crio-ba1bfe1c74a7a24017082f1a5dfadd48dd727561acf6c66dece3fc0881fbfdbf WatchSource:0}: Error finding container ba1bfe1c74a7a24017082f1a5dfadd48dd727561acf6c66dece3fc0881fbfdbf: Status 404 returned error can't find the container with id ba1bfe1c74a7a24017082f1a5dfadd48dd727561acf6c66dece3fc0881fbfdbf Jul 24 00:15:13.356355 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.356328 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl"] Jul 24 00:15:13.357426 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:13.357399 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe65a5f1_be44_4fdd_8632_6385dbee64b0.slice/crio-f3662fe325291869c841f6f44d685c0f32c12dc433178c21e26e61bcd5366a19 WatchSource:0}: Error finding container f3662fe325291869c841f6f44d685c0f32c12dc433178c21e26e61bcd5366a19: Status 404 returned error can't find the container with id f3662fe325291869c841f6f44d685c0f32c12dc433178c21e26e61bcd5366a19 Jul 24 00:15:13.382410 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.382381 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 00:15:13.393100 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:13.393060 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22245d2c_887b_43a5_8abb_6d728fc06241.slice/crio-b420dbd51e02f92e7603e0160adbd41073948cd59f29b75e6dcc2a602ed1cb89 WatchSource:0}: Error finding container b420dbd51e02f92e7603e0160adbd41073948cd59f29b75e6dcc2a602ed1cb89: Status 404 returned error can't find the container with id b420dbd51e02f92e7603e0160adbd41073948cd59f29b75e6dcc2a602ed1cb89 Jul 24 00:15:13.572974 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.572939 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr"] Jul 24 00:15:13.576764 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:13.576734 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20a907e_7212_4580_a1c5_3156eb4e13d7.slice/crio-7304ac4bdec04ea3bf9ea97b25ca30d8767f9e357b03766ee1928c0f37cb1fd3 WatchSource:0}: Error finding container 7304ac4bdec04ea3bf9ea97b25ca30d8767f9e357b03766ee1928c0f37cb1fd3: Status 404 returned error can't find the container with id 7304ac4bdec04ea3bf9ea97b25ca30d8767f9e357b03766ee1928c0f37cb1fd3 Jul 24 00:15:13.837462 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.837430 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6996659587-b68bm"] Jul 24 00:15:13.861589 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.861559 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6996659587-b68bm"] Jul 24 00:15:13.861729 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.861675 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:13.864152 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.864132 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 24 00:15:13.864300 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.864152 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 24 00:15:13.864300 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.864160 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7qx5g\"" Jul 24 00:15:13.864300 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.864132 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 24 00:15:13.864300 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.864263 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8fe95mceopsh2\"" Jul 24 00:15:13.864300 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.864132 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 24 00:15:13.864550 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.864458 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 24 00:15:13.933683 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.933635 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:13.937157 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.937123 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8fn9" event={"ID":"882f5d53-0541-446b-96ef-13a33895c1b8","Type":"ContainerStarted","Data":"ba1bfe1c74a7a24017082f1a5dfadd48dd727561acf6c66dece3fc0881fbfdbf"} Jul 24 00:15:13.939511 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.939477 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cwl2" event={"ID":"c700810b-d686-448a-adf3-c8d334aa2f01","Type":"ContainerStarted","Data":"c159a73cf5b3866366626b40d72c37b8a130a7af5d1dc00dd9e217966f782e37"} Jul 24 00:15:13.941207 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.941183 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z6qkx" event={"ID":"f7fe8ab4-f1db-40ab-8c20-92c6210bfe59","Type":"ContainerStarted","Data":"c8dc521de0553f4dd3c8d35eb5c96969ea14f0cd0dc02213ef913e87c7847cc2"} Jul 24 00:15:13.941348 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.941303 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:15:13.942591 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.942532 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22245d2c-887b-43a5-8abb-6d728fc06241","Type":"ContainerStarted","Data":"b420dbd51e02f92e7603e0160adbd41073948cd59f29b75e6dcc2a602ed1cb89"} Jul 24 00:15:13.943871 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.943848 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" event={"ID":"a20a907e-7212-4580-a1c5-3156eb4e13d7","Type":"ContainerStarted","Data":"7304ac4bdec04ea3bf9ea97b25ca30d8767f9e357b03766ee1928c0f37cb1fd3"} Jul 24 00:15:13.945762 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.945741 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" event={"ID":"be65a5f1-be44-4fdd-8632-6385dbee64b0","Type":"ContainerStarted","Data":"0f891458990d4500b0c2458ac7253ebf91457c931d8d21691c9a6f07946b85c1"} Jul 24 00:15:13.945851 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.945795 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" event={"ID":"be65a5f1-be44-4fdd-8632-6385dbee64b0","Type":"ContainerStarted","Data":"c07c5dea166fa5a007304a550166b760e267d664542e1f7f6540d22ab3eb433b"} Jul 24 00:15:13.945851 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.945819 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" event={"ID":"be65a5f1-be44-4fdd-8632-6385dbee64b0","Type":"ContainerStarted","Data":"f3662fe325291869c841f6f44d685c0f32c12dc433178c21e26e61bcd5366a19"} Jul 24 00:15:13.947199 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.947177 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jnljx" event={"ID":"4dda38d3-0c29-499b-93bd-b9accf7c4cb3","Type":"ContainerStarted","Data":"a0d62725be0e62e98f1b75647db799417dd5ee7e930e1e9a542f91aae6fb30b1"} Jul 24 00:15:13.956390 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.956345 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8cwl2" podStartSLOduration=1.9337436270000001 podStartE2EDuration="19.95632974s" totalImagesPullingTime="18.022586113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 00:14:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:13.955664237 +0000 UTC m=+74.959223600" watchObservedRunningTime="2026-07-24 00:15:13.95632974 +0000 UTC m=+74.959889088" Jul 24 00:15:13.970185 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.970133 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z6qkx" podStartSLOduration=68.030318403 podStartE2EDuration="1m14.970116467s" totalImagesPullingTime="6.939798064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:13.9691014 +0000 UTC m=+74.972660743" watchObservedRunningTime="2026-07-24 00:15:13.970116467 +0000 UTC m=+74.973675837" Jul 24 00:15:13.984150 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.984064 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jnljx" podStartSLOduration=68.04194292 podStartE2EDuration="1m14.984042101s" totalImagesPullingTime="6.942099181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 00:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:13.982638497 +0000 UTC m=+74.986197844" watchObservedRunningTime="2026-07-24 00:15:13.984042101 +0000 UTC m=+74.987601449" Jul 24 00:15:13.993414 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:13.993370 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:14.011794 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.011760 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.011940 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.011808 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.011940 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.011891 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4rnd\" (UniqueName: \"kubernetes.io/projected/31f5cd38-b590-4deb-a01a-59add4fee045-kube-api-access-b4rnd\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.012050 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.011979 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-tls\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.012050 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.012029 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.012172 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.012073 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-grpc-tls\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.012222 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.012206 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.012263 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.012223 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31f5cd38-b590-4deb-a01a-59add4fee045-metrics-client-ca\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.113152 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.113047 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.113152 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.113138 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4rnd\" (UniqueName: \"kubernetes.io/projected/31f5cd38-b590-4deb-a01a-59add4fee045-kube-api-access-b4rnd\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.113354 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.113170 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-tls\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.113354 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.113201 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.113354 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.113241 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-grpc-tls\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.113354 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.113322 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.113354 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.113351 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31f5cd38-b590-4deb-a01a-59add4fee045-metrics-client-ca\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.113648 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.113383 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.114350 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.114317 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31f5cd38-b590-4deb-a01a-59add4fee045-metrics-client-ca\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.116685 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.116440 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-tls\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.116809 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.116781 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.116938 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.116908 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.117024 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.116921 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-grpc-tls\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.117024 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.117003 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.117224 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.117203 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31f5cd38-b590-4deb-a01a-59add4fee045-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.120866 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.120846 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4rnd\" (UniqueName: \"kubernetes.io/projected/31f5cd38-b590-4deb-a01a-59add4fee045-kube-api-access-b4rnd\") pod \"thanos-querier-6996659587-b68bm\" (UID: \"31f5cd38-b590-4deb-a01a-59add4fee045\") " pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.171214 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.171183 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:14.252842 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.252804 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:14.309665 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.309565 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:14.342656 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.342550 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6996659587-b68bm"] Jul 24 00:15:14.364270 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:14.364186 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f5cd38_b590_4deb_a01a_59add4fee045.slice/crio-54178c79342075c039679abafc11f0c7796c2ef55a6e32c730d8ebe11bd2276e WatchSource:0}: Error finding container 54178c79342075c039679abafc11f0c7796c2ef55a6e32c730d8ebe11bd2276e: Status 404 returned error can't find the container with id 54178c79342075c039679abafc11f0c7796c2ef55a6e32c730d8ebe11bd2276e Jul 24 00:15:14.445772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.445739 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:14.543221 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.543187 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:14.952511 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.952479 2588 generic.go:356] "Generic (PLEG): container finished" podID="882f5d53-0541-446b-96ef-13a33895c1b8" containerID="9ee107a9bbd939aafcc58d2e8c78161375f76a2dfd54eebeb7aaf2aae864d698" exitCode=0 Jul 24 00:15:14.952710 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.952557 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8fn9" event={"ID":"882f5d53-0541-446b-96ef-13a33895c1b8","Type":"ContainerDied","Data":"9ee107a9bbd939aafcc58d2e8c78161375f76a2dfd54eebeb7aaf2aae864d698"} Jul 24 00:15:14.958159 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:14.957748 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6996659587-b68bm" event={"ID":"31f5cd38-b590-4deb-a01a-59add4fee045","Type":"ContainerStarted","Data":"54178c79342075c039679abafc11f0c7796c2ef55a6e32c730d8ebe11bd2276e"} Jul 24 00:15:15.172368 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.172336 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85f4f676b8-s5kvz"] Jul 24 00:15:15.175567 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.175540 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.179964 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.179754 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 24 00:15:15.179964 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.179825 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 24 00:15:15.179964 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.179853 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x68gv\"" Jul 24 00:15:15.180648 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.180598 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 24 00:15:15.180648 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.180616 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 00:15:15.180839 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.180618 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-98tldf8obheau\"" Jul 24 00:15:15.192898 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.192872 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85f4f676b8-s5kvz"] Jul 24 00:15:15.323849 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.323813 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/657f86fc-93b4-468a-a270-c4ef782b65c3-secret-metrics-server-client-certs\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.324346 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.323872 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/657f86fc-93b4-468a-a270-c4ef782b65c3-metrics-server-audit-profiles\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.324346 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.323916 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/657f86fc-93b4-468a-a270-c4ef782b65c3-audit-log\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.324346 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.323961 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/657f86fc-93b4-468a-a270-c4ef782b65c3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.324346 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.323989 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/657f86fc-93b4-468a-a270-c4ef782b65c3-secret-metrics-server-tls\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.324346 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.324098 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gclzx\" (UniqueName: \"kubernetes.io/projected/657f86fc-93b4-468a-a270-c4ef782b65c3-kube-api-access-gclzx\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.324346 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.324143 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/657f86fc-93b4-468a-a270-c4ef782b65c3-client-ca-bundle\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.425539 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.425491 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/657f86fc-93b4-468a-a270-c4ef782b65c3-secret-metrics-server-client-certs\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.425539 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.425540 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/657f86fc-93b4-468a-a270-c4ef782b65c3-metrics-server-audit-profiles\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.425727 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.425575 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/657f86fc-93b4-468a-a270-c4ef782b65c3-audit-log\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.425727 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.425612 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/657f86fc-93b4-468a-a270-c4ef782b65c3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.425727 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.425641 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/657f86fc-93b4-468a-a270-c4ef782b65c3-secret-metrics-server-tls\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.425727 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.425699 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gclzx\" (UniqueName: \"kubernetes.io/projected/657f86fc-93b4-468a-a270-c4ef782b65c3-kube-api-access-gclzx\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.425936 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.425735 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/657f86fc-93b4-468a-a270-c4ef782b65c3-client-ca-bundle\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.426375 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.426326 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/657f86fc-93b4-468a-a270-c4ef782b65c3-audit-log\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.426633 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.426609 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/657f86fc-93b4-468a-a270-c4ef782b65c3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.426888 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.426862 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/657f86fc-93b4-468a-a270-c4ef782b65c3-metrics-server-audit-profiles\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.428876 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.428836 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/657f86fc-93b4-468a-a270-c4ef782b65c3-secret-metrics-server-client-certs\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.429513 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.429470 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/657f86fc-93b4-468a-a270-c4ef782b65c3-secret-metrics-server-tls\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.430173 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.430136 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/657f86fc-93b4-468a-a270-c4ef782b65c3-client-ca-bundle\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.434793 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.434768 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gclzx\" (UniqueName: \"kubernetes.io/projected/657f86fc-93b4-468a-a270-c4ef782b65c3-kube-api-access-gclzx\") pod \"metrics-server-85f4f676b8-s5kvz\" (UID: \"657f86fc-93b4-468a-a270-c4ef782b65c3\") " pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.486904 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.486881 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:15.687223 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.687192 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:15.708750 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.708714 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-874pg"] Jul 24 00:15:15.712248 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.712221 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" Jul 24 00:15:15.715185 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.715099 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 24 00:15:15.715304 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.715217 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-k9xdp\"" Jul 24 00:15:15.726563 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.726538 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85f4f676b8-s5kvz"] Jul 24 00:15:15.728920 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:15.728893 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657f86fc_93b4_468a_a270_c4ef782b65c3.slice/crio-90a72c99f8e00cbf1ad3bad8854c66d384ddd53369ba3ca2aa96682e70793f38 WatchSource:0}: Error finding container 90a72c99f8e00cbf1ad3bad8854c66d384ddd53369ba3ca2aa96682e70793f38: Status 404 returned error can't find the container with id 90a72c99f8e00cbf1ad3bad8854c66d384ddd53369ba3ca2aa96682e70793f38 Jul 24 00:15:15.732648 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.732623 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c994bd64d-sqmf6"] Jul 24 00:15:15.737942 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.737919 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-874pg"] Jul 24 00:15:15.784473 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.784441 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b95b476ff-799xt"] Jul 24 00:15:15.788073 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.788047 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:15.799026 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.798996 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b95b476ff-799xt"] Jul 24 00:15:15.811125 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.811049 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:15.830433 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.830346 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16ed121a-0e76-44e0-9a17-cd3cada5bf52-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-874pg\" (UID: \"16ed121a-0e76-44e0-9a17-cd3cada5bf52\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" Jul 24 00:15:15.830433 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.830396 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgffg\" (UniqueName: \"kubernetes.io/projected/16ed121a-0e76-44e0-9a17-cd3cada5bf52-kube-api-access-tgffg\") pod \"monitoring-plugin-68b7fc9574-874pg\" (UID: \"16ed121a-0e76-44e0-9a17-cd3cada5bf52\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" Jul 24 00:15:15.931956 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.931920 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16ed121a-0e76-44e0-9a17-cd3cada5bf52-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-874pg\" (UID: \"16ed121a-0e76-44e0-9a17-cd3cada5bf52\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" Jul 24 00:15:15.932174 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.931967 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgffg\" (UniqueName: \"kubernetes.io/projected/16ed121a-0e76-44e0-9a17-cd3cada5bf52-kube-api-access-tgffg\") pod \"monitoring-plugin-68b7fc9574-874pg\" (UID: \"16ed121a-0e76-44e0-9a17-cd3cada5bf52\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" Jul 24 00:15:15.932174 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.932107 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-oauth-serving-cert\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:15.932292 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.932188 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x6sd\" (UniqueName: \"kubernetes.io/projected/94270855-6940-4ebe-b39a-74789d0d5d9a-kube-api-access-6x6sd\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:15.932292 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.932251 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-console-config\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:15.932395 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.932304 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94270855-6940-4ebe-b39a-74789d0d5d9a-console-oauth-config\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:15.932395 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.932339 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-service-ca\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:15.932395 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.932374 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94270855-6940-4ebe-b39a-74789d0d5d9a-console-serving-cert\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:15.932535 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.932424 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-trusted-ca-bundle\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:15.935484 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.935460 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16ed121a-0e76-44e0-9a17-cd3cada5bf52-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-874pg\" (UID: \"16ed121a-0e76-44e0-9a17-cd3cada5bf52\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" Jul 24 00:15:15.939788 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.939762 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgffg\" (UniqueName: \"kubernetes.io/projected/16ed121a-0e76-44e0-9a17-cd3cada5bf52-kube-api-access-tgffg\") pod \"monitoring-plugin-68b7fc9574-874pg\" (UID: \"16ed121a-0e76-44e0-9a17-cd3cada5bf52\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" Jul 24 00:15:15.969178 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.969131 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:15.978436 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.978396 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8fn9" event={"ID":"882f5d53-0541-446b-96ef-13a33895c1b8","Type":"ContainerStarted","Data":"26bee35a05c0d2065c1503442c3fb79e9a9663e7ed25c63903318314b2c4b1dc"} Jul 24 00:15:15.978604 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.978525 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8fn9" event={"ID":"882f5d53-0541-446b-96ef-13a33895c1b8","Type":"ContainerStarted","Data":"22ed15486184a77ffa3db57a449020257cb78d99488b38ec27855361067dad6e"} Jul 24 00:15:15.980361 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.980335 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:15.980881 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.980857 2588 generic.go:356] "Generic (PLEG): container finished" podID="22245d2c-887b-43a5-8abb-6d728fc06241" containerID="2ae04d4d010295a3a87661a3e69ca3a6d4d59220fd6b061e4a7358696db34b6e" exitCode=0 Jul 24 00:15:15.981102 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.981008 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22245d2c-887b-43a5-8abb-6d728fc06241","Type":"ContainerDied","Data":"2ae04d4d010295a3a87661a3e69ca3a6d4d59220fd6b061e4a7358696db34b6e"} Jul 24 00:15:15.984253 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.984230 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" event={"ID":"a20a907e-7212-4580-a1c5-3156eb4e13d7","Type":"ContainerStarted","Data":"f2902d14bf1f2cb27e5d8399f2b386e352c46f41a0cce3b2968f4226bbffe08c"} Jul 24 00:15:15.984525 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.984506 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" event={"ID":"a20a907e-7212-4580-a1c5-3156eb4e13d7","Type":"ContainerStarted","Data":"7947686e1f632755c8ed41714610667dc9934c60b7c4b93fb110baab6b3d0d0f"} Jul 24 00:15:15.984684 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.984670 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" event={"ID":"a20a907e-7212-4580-a1c5-3156eb4e13d7","Type":"ContainerStarted","Data":"2a9393b8d8de8b53739e636eebc5942cfe4c4a71175cac4bf622c4d92248ac83"} Jul 24 00:15:15.987285 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.987263 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" event={"ID":"be65a5f1-be44-4fdd-8632-6385dbee64b0","Type":"ContainerStarted","Data":"effd62783e222f539aff139036bdefe5b5f641bb62c3e6bd5e097642faad1416"} Jul 24 00:15:15.988970 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.988950 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" event={"ID":"657f86fc-93b4-468a-a270-c4ef782b65c3","Type":"ContainerStarted","Data":"90a72c99f8e00cbf1ad3bad8854c66d384ddd53369ba3ca2aa96682e70793f38"} Jul 24 00:15:15.998864 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:15.998814 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d8fn9" podStartSLOduration=4.956662028 podStartE2EDuration="5.998793121s" totalImagesPullingTime="949.458117ms" totalInitContainerRuntime="92.672976ms" isStatefulPod=true podCreationTimestamp="2026-07-24 00:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:15.997682013 +0000 UTC m=+77.001241360" watchObservedRunningTime="2026-07-24 00:15:15.998793121 +0000 UTC m=+77.002352470" Jul 24 00:15:16.016997 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.016847 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-thczl" podStartSLOduration=4.654410304 podStartE2EDuration="6.01682729s" totalImagesPullingTime="1.362416986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:16.01630419 +0000 UTC m=+77.019863538" watchObservedRunningTime="2026-07-24 00:15:16.01682729 +0000 UTC m=+77.020386638" Jul 24 00:15:16.022420 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.022381 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" Jul 24 00:15:16.033559 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.033504 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xjkpr" podStartSLOduration=4.203859869 podStartE2EDuration="6.033483363s" totalImagesPullingTime="1.829623494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:16.033409452 +0000 UTC m=+77.036968803" watchObservedRunningTime="2026-07-24 00:15:16.033483363 +0000 UTC m=+77.037042713" Jul 24 00:15:16.033691 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.033616 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x6sd\" (UniqueName: \"kubernetes.io/projected/94270855-6940-4ebe-b39a-74789d0d5d9a-kube-api-access-6x6sd\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.033777 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.033691 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-console-config\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.033777 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.033736 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94270855-6940-4ebe-b39a-74789d0d5d9a-console-oauth-config\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.033777 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.033766 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-service-ca\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.033923 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.033808 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94270855-6940-4ebe-b39a-74789d0d5d9a-console-serving-cert\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.033923 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.033868 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-trusted-ca-bundle\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.033923 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.033915 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-oauth-serving-cert\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.034931 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.034883 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-console-config\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.035044 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.035027 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-service-ca\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.035536 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.035508 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-oauth-serving-cert\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.035813 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.035769 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-trusted-ca-bundle\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.037988 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.037966 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94270855-6940-4ebe-b39a-74789d0d5d9a-console-serving-cert\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.038317 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.038271 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94270855-6940-4ebe-b39a-74789d0d5d9a-console-oauth-config\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.041565 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.041547 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x6sd\" (UniqueName: \"kubernetes.io/projected/94270855-6940-4ebe-b39a-74789d0d5d9a-kube-api-access-6x6sd\") pod \"console-5b95b476ff-799xt\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.100142 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.100107 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:16.172113 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.172062 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-874pg"] Jul 24 00:15:16.174856 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:16.174822 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ed121a_0e76_44e0_9a17_cd3cada5bf52.slice/crio-290f33c2ac29ecfa35bc47c3d49760feda8b0937536331b57777b29ecc5dcf59 WatchSource:0}: Error finding container 290f33c2ac29ecfa35bc47c3d49760feda8b0937536331b57777b29ecc5dcf59: Status 404 returned error can't find the container with id 290f33c2ac29ecfa35bc47c3d49760feda8b0937536331b57777b29ecc5dcf59 Jul 24 00:15:16.246515 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.246483 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b95b476ff-799xt"] Jul 24 00:15:16.733052 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:16.733014 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94270855_6940_4ebe_b39a_74789d0d5d9a.slice/crio-ce58678131c631fd729704cfd29edbf8d9deee5afab06dd84eced17d907c17e4 WatchSource:0}: Error finding container ce58678131c631fd729704cfd29edbf8d9deee5afab06dd84eced17d907c17e4: Status 404 returned error can't find the container with id ce58678131c631fd729704cfd29edbf8d9deee5afab06dd84eced17d907c17e4 Jul 24 00:15:16.997940 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.997864 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6996659587-b68bm" event={"ID":"31f5cd38-b590-4deb-a01a-59add4fee045","Type":"ContainerStarted","Data":"3876986999b16673751f90f466f6018bb4c7909aa56b821ed5a7aac64f741d56"} Jul 24 00:15:16.998070 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.997957 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6996659587-b68bm" event={"ID":"31f5cd38-b590-4deb-a01a-59add4fee045","Type":"ContainerStarted","Data":"2a9349c1366d5ae3b1f6815fda90154bc361d53b5422c3d461d73fb126cbd9c4"} Jul 24 00:15:16.999958 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.999932 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b95b476ff-799xt" event={"ID":"94270855-6940-4ebe-b39a-74789d0d5d9a","Type":"ContainerStarted","Data":"df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd"} Jul 24 00:15:17.000115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:16.999979 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b95b476ff-799xt" event={"ID":"94270855-6940-4ebe-b39a-74789d0d5d9a","Type":"ContainerStarted","Data":"ce58678131c631fd729704cfd29edbf8d9deee5afab06dd84eced17d907c17e4"} Jul 24 00:15:17.003108 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.002863 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" event={"ID":"16ed121a-0e76-44e0-9a17-cd3cada5bf52","Type":"ContainerStarted","Data":"290f33c2ac29ecfa35bc47c3d49760feda8b0937536331b57777b29ecc5dcf59"} Jul 24 00:15:17.019970 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.019100 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b95b476ff-799xt" podStartSLOduration=2.019059795 podStartE2EDuration="2.019059795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:17.018548342 +0000 UTC m=+78.022107689" watchObservedRunningTime="2026-07-24 00:15:17.019059795 +0000 UTC m=+78.022619143" Jul 24 00:15:17.099380 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.099191 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:17.105116 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.104490 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 00:15:17.117756 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.117727 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.120800 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.120724 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-29mcd\"" Jul 24 00:15:17.121168 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.121149 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 00:15:17.121584 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.121539 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7e1mqat2rr2q6\"" Jul 24 00:15:17.121792 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.121775 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 00:15:17.122109 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.122048 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 00:15:17.122267 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.122252 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 00:15:17.122433 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.122416 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 00:15:17.122611 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.122580 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 00:15:17.122720 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.122697 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 00:15:17.122781 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.122773 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 00:15:17.122902 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.122871 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 00:15:17.123001 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.122951 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 00:15:17.123168 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.123142 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 00:15:17.123834 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.123815 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 00:15:17.140063 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.138821 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 00:15:17.152981 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.152947 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 00:15:17.155606 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.155584 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247162 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247210 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247241 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gnsg\" (UniqueName: \"kubernetes.io/projected/475ca8cb-3bb0-4442-8445-5356e6488502-kube-api-access-8gnsg\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247272 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247310 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247333 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-web-config\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247361 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247386 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247408 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247439 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247478 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/475ca8cb-3bb0-4442-8445-5356e6488502-config-out\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247515 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247535 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247562 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/475ca8cb-3bb0-4442-8445-5356e6488502-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247585 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247614 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-config\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248952 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247643 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248952 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247683 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248952 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247750 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.248952 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.247780 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349504 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349555 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349587 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/475ca8cb-3bb0-4442-8445-5356e6488502-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349615 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349646 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-config\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349673 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349712 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349766 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349792 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349834 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349859 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349885 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gnsg\" (UniqueName: \"kubernetes.io/projected/475ca8cb-3bb0-4442-8445-5356e6488502-kube-api-access-8gnsg\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349913 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349952 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.349976 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-web-config\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.350003 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.350906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.350025 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.351981 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.350051 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.351981 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.350098 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.351981 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.350141 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/475ca8cb-3bb0-4442-8445-5356e6488502-config-out\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.351981 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.351277 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.351981 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.351605 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.356166 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.352823 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.356166 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.354545 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.356166 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.355779 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.358133 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.358106 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.358415 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.358393 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.364187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.364126 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/475ca8cb-3bb0-4442-8445-5356e6488502-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.364340 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.364244 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.364340 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.364308 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-web-config\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.367259 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.366258 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.367259 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.366324 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.367259 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.366756 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/475ca8cb-3bb0-4442-8445-5356e6488502-config-out\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.367259 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.366759 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.367259 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.366938 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.367259 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.367215 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.367643 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.367407 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/475ca8cb-3bb0-4442-8445-5356e6488502-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.368209 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.368138 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-config\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.369468 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.368929 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/475ca8cb-3bb0-4442-8445-5356e6488502-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.369468 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.369427 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gnsg\" (UniqueName: \"kubernetes.io/projected/475ca8cb-3bb0-4442-8445-5356e6488502-kube-api-access-8gnsg\") pod \"prometheus-k8s-0\" (UID: \"475ca8cb-3bb0-4442-8445-5356e6488502\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.455672 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.455341 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:17.661327 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:15:17.656977 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475ca8cb_3bb0_4442_8445_5356e6488502.slice/crio-d6e938bbca27880d30a1343086f7f3b87d67e6aa8a9d01bd2643f2c93af9cc48 WatchSource:0}: Error finding container d6e938bbca27880d30a1343086f7f3b87d67e6aa8a9d01bd2643f2c93af9cc48: Status 404 returned error can't find the container with id d6e938bbca27880d30a1343086f7f3b87d67e6aa8a9d01bd2643f2c93af9cc48 Jul 24 00:15:17.661327 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:17.657721 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 00:15:18.008775 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:18.008728 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"475ca8cb-3bb0-4442-8445-5356e6488502","Type":"ContainerStarted","Data":"d6e938bbca27880d30a1343086f7f3b87d67e6aa8a9d01bd2643f2c93af9cc48"} Jul 24 00:15:18.011173 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:18.011140 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6996659587-b68bm" event={"ID":"31f5cd38-b590-4deb-a01a-59add4fee045","Type":"ContainerStarted","Data":"6f0acf6c7ccf98bab5c2b321ee68c16b4314f2db65d680fde8e32b9a5042bb3e"} Jul 24 00:15:18.476284 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:18.476246 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:18.577030 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:18.576930 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:20.028540 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.028503 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" event={"ID":"16ed121a-0e76-44e0-9a17-cd3cada5bf52","Type":"ContainerStarted","Data":"973a9e608515e5d211f1f2d7774b5645717e9a053bf367f166cda23b28d34c08"} Jul 24 00:15:20.029016 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.028680 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" Jul 24 00:15:20.032286 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.032254 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22245d2c-887b-43a5-8abb-6d728fc06241","Type":"ContainerStarted","Data":"3ecf4c52f3559b2f17d409f5e36c2c69ae65fa55637e5ee98a3b27691ac56e92"} Jul 24 00:15:20.032446 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.032327 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22245d2c-887b-43a5-8abb-6d728fc06241","Type":"ContainerStarted","Data":"0a43f0026b610da6a24faaeb959199cca452f6fea3f9df5ee690885055ebbb0b"} Jul 24 00:15:20.032446 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.032369 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22245d2c-887b-43a5-8abb-6d728fc06241","Type":"ContainerStarted","Data":"e3903d5c672d9eed56ac2a5fc7ba68c133fb6df92ef2ad92387b7cf766b1714e"} Jul 24 00:15:20.032446 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.032412 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22245d2c-887b-43a5-8abb-6d728fc06241","Type":"ContainerStarted","Data":"4d87a12dbfddffd0503ef0be730b6bc3dea79fb3d61b0f6023c626563d7b60c4"} Jul 24 00:15:20.032446 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.032444 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22245d2c-887b-43a5-8abb-6d728fc06241","Type":"ContainerStarted","Data":"3a30f6785602a96a8683c1db0a6407822fb02f90c74f98c8eb57ea1f34d97ff9"} Jul 24 00:15:20.032654 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.032477 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22245d2c-887b-43a5-8abb-6d728fc06241","Type":"ContainerStarted","Data":"e65fbdb242e3f21c9bbe9c6f33202cbe83535604550051d8a087afdc0e82e23d"} Jul 24 00:15:20.034628 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.034606 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" Jul 24 00:15:20.035454 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.035429 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6996659587-b68bm" event={"ID":"31f5cd38-b590-4deb-a01a-59add4fee045","Type":"ContainerStarted","Data":"e1cb39ee0af519c6ba5510dbc732f08180d2ce2724e1fd5e791d014f784331d2"} Jul 24 00:15:20.035540 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.035495 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6996659587-b68bm" event={"ID":"31f5cd38-b590-4deb-a01a-59add4fee045","Type":"ContainerStarted","Data":"d7e8de682b5e081ff178ebecb1e7952d8de39568176ccae12fc84a354021a83c"} Jul 24 00:15:20.035540 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.035532 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6996659587-b68bm" event={"ID":"31f5cd38-b590-4deb-a01a-59add4fee045","Type":"ContainerStarted","Data":"bb229892415916e666fe8c483c4765f0956b7df1425b9aab6284ff9d7a1de35c"} Jul 24 00:15:20.035637 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.035569 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:20.036839 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.036818 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" event={"ID":"657f86fc-93b4-468a-a270-c4ef782b65c3","Type":"ContainerStarted","Data":"d3fd6863d06e59b60a1e3ce90425c810b81e3904323209cb5fd6b956bfdf34ec"} Jul 24 00:15:20.038224 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.038203 2588 generic.go:356] "Generic (PLEG): container finished" podID="475ca8cb-3bb0-4442-8445-5356e6488502" containerID="2f0d4f2740f0e05038334899e1e1f140e561fa3737f061e964cd8452797740c6" exitCode=0 Jul 24 00:15:20.038314 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.038233 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"475ca8cb-3bb0-4442-8445-5356e6488502","Type":"ContainerDied","Data":"2f0d4f2740f0e05038334899e1e1f140e561fa3737f061e964cd8452797740c6"} Jul 24 00:15:20.044367 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.044321 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-874pg" podStartSLOduration=2.21854943 podStartE2EDuration="5.044304968s" totalImagesPullingTime="2.825755538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:20.044274897 +0000 UTC m=+81.047834245" watchObservedRunningTime="2026-07-24 00:15:20.044304968 +0000 UTC m=+81.047864314" Jul 24 00:15:20.062212 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.062154 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" podStartSLOduration=1.790893177 podStartE2EDuration="5.062134358s" totalImagesPullingTime="3.271241181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:20.060933454 +0000 UTC m=+81.064492816" watchObservedRunningTime="2026-07-24 00:15:20.062134358 +0000 UTC m=+81.065693706" Jul 24 00:15:20.092103 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.092035 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.483562906 podStartE2EDuration="9.092017557s" totalImagesPullingTime="4.585680774s" totalInitContainerRuntime="22.773877ms" isStatefulPod=false podCreationTimestamp="2026-07-24 00:15:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:20.090011787 +0000 UTC m=+81.093571166" watchObservedRunningTime="2026-07-24 00:15:20.092017557 +0000 UTC m=+81.095576903" Jul 24 00:15:20.166660 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:20.166567 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6996659587-b68bm" podStartSLOduration=2.773069739 podStartE2EDuration="7.166546627s" totalImagesPullingTime="4.393476888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:15:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:20.166216313 +0000 UTC m=+81.169775661" watchObservedRunningTime="2026-07-24 00:15:20.166546627 +0000 UTC m=+81.170105976" Jul 24 00:15:21.056098 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:21.056048 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6996659587-b68bm" Jul 24 00:15:22.391914 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:22.391875 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:22.494438 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:22.494401 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:23.447803 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:23.447770 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:23.548410 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:23.548362 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:24.063057 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:24.063023 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"475ca8cb-3bb0-4442-8445-5356e6488502","Type":"ContainerStarted","Data":"d0cb3249b42777786e07c7a8f5c0825c1f351806eae90a5624e98c23f7e6fecb"} Jul 24 00:15:24.063245 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:24.063138 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"475ca8cb-3bb0-4442-8445-5356e6488502","Type":"ContainerStarted","Data":"e51e985e86a8518b1fbde859fa7e2a7cb9df8f1cf00821eea77db77ab5a21bb7"} Jul 24 00:15:24.063245 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:24.063167 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"475ca8cb-3bb0-4442-8445-5356e6488502","Type":"ContainerStarted","Data":"1e863aedc38950bf71a5fe53971270bded31df9c65f92c954c4613b3bc848a8e"} Jul 24 00:15:24.063245 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:24.063191 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"475ca8cb-3bb0-4442-8445-5356e6488502","Type":"ContainerStarted","Data":"d36ebefb2a7ca887b1bbe14a060d0899067ab85ea1998aa85f893b14f2ce68f3"} Jul 24 00:15:24.063245 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:24.063218 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"475ca8cb-3bb0-4442-8445-5356e6488502","Type":"ContainerStarted","Data":"87b659a5e8872d4444bbcfee58bcfeddec3ddac7d940b0b89eaf874038beedde"} Jul 24 00:15:24.063245 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:24.063247 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"475ca8cb-3bb0-4442-8445-5356e6488502","Type":"ContainerStarted","Data":"43aad394596ae02f2ea91ba6664c63a10929c65f33fa2dfbee21de04d2a824ad"} Jul 24 00:15:24.095038 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:24.094989 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.9246791610000002 podStartE2EDuration="7.094971662s" totalImagesPullingTime="3.137301947s" totalInitContainerRuntime="32.990554ms" isStatefulPod=false podCreationTimestamp="2026-07-24 00:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:15:24.093683387 +0000 UTC m=+85.097242735" watchObservedRunningTime="2026-07-24 00:15:24.094971662 +0000 UTC m=+85.098531010" Jul 24 00:15:26.100264 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:26.100226 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:26.100751 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:26.100319 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:26.105130 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:26.105103 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:27.062785 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:27.062742 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:27.078861 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:27.078834 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:15:27.122972 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:27.122940 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-744f65bdfb-4w7p5"] Jul 24 00:15:27.133349 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:27.133323 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:27.273031 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:27.273004 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:27.456522 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:27.456490 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:15:35.487157 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:35.487121 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:35.487563 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:35.487182 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:36.135272 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:36.135240 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:36.192820 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:36.192756 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:40.759108 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:40.759017 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c994bd64d-sqmf6" podUID="826eb58b-4a58-4853-935d-b99500731cfa" containerName="console" containerID="cri-o://8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf" gracePeriod=15 Jul 24 00:15:41.552762 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.552728 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:41.582288 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.582261 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm8c6\" (UniqueName: \"kubernetes.io/projected/826eb58b-4a58-4853-935d-b99500731cfa-kube-api-access-cm8c6\") pod \"826eb58b-4a58-4853-935d-b99500731cfa\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " Jul 24 00:15:41.582453 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.582301 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/826eb58b-4a58-4853-935d-b99500731cfa-console-serving-cert\") pod \"826eb58b-4a58-4853-935d-b99500731cfa\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " Jul 24 00:15:41.582453 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.582334 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/826eb58b-4a58-4853-935d-b99500731cfa-console-oauth-config\") pod \"826eb58b-4a58-4853-935d-b99500731cfa\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " Jul 24 00:15:41.582675 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.582607 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-console-config\") pod \"826eb58b-4a58-4853-935d-b99500731cfa\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " Jul 24 00:15:41.582675 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.582673 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-service-ca\") pod \"826eb58b-4a58-4853-935d-b99500731cfa\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " Jul 24 00:15:41.582856 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.582697 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-oauth-serving-cert\") pod \"826eb58b-4a58-4853-935d-b99500731cfa\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " Jul 24 00:15:41.582856 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.582758 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-trusted-ca-bundle\") pod \"826eb58b-4a58-4853-935d-b99500731cfa\" (UID: \"826eb58b-4a58-4853-935d-b99500731cfa\") " Jul 24 00:15:41.583492 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.583334 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-service-ca" (OuterVolumeSpecName: "service-ca") pod "826eb58b-4a58-4853-935d-b99500731cfa" (UID: "826eb58b-4a58-4853-935d-b99500731cfa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:15:41.583598 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.583496 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-console-config" (OuterVolumeSpecName: "console-config") pod "826eb58b-4a58-4853-935d-b99500731cfa" (UID: "826eb58b-4a58-4853-935d-b99500731cfa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:15:41.583598 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.583573 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "826eb58b-4a58-4853-935d-b99500731cfa" (UID: "826eb58b-4a58-4853-935d-b99500731cfa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:15:41.583809 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.583789 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "826eb58b-4a58-4853-935d-b99500731cfa" (UID: "826eb58b-4a58-4853-935d-b99500731cfa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:15:41.584880 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.584855 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/826eb58b-4a58-4853-935d-b99500731cfa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "826eb58b-4a58-4853-935d-b99500731cfa" (UID: "826eb58b-4a58-4853-935d-b99500731cfa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 00:15:41.584977 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.584933 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/826eb58b-4a58-4853-935d-b99500731cfa-kube-api-access-cm8c6" (OuterVolumeSpecName: "kube-api-access-cm8c6") pod "826eb58b-4a58-4853-935d-b99500731cfa" (UID: "826eb58b-4a58-4853-935d-b99500731cfa"). InnerVolumeSpecName "kube-api-access-cm8c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 00:15:41.584977 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.584953 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/826eb58b-4a58-4853-935d-b99500731cfa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "826eb58b-4a58-4853-935d-b99500731cfa" (UID: "826eb58b-4a58-4853-935d-b99500731cfa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 00:15:41.684428 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.684395 2588 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-console-config\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:41.684428 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.684423 2588 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-service-ca\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:41.684428 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.684432 2588 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-oauth-serving-cert\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:41.684428 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.684442 2588 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/826eb58b-4a58-4853-935d-b99500731cfa-trusted-ca-bundle\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:41.684695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.684451 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm8c6\" (UniqueName: \"kubernetes.io/projected/826eb58b-4a58-4853-935d-b99500731cfa-kube-api-access-cm8c6\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:41.684695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.684461 2588 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/826eb58b-4a58-4853-935d-b99500731cfa-console-serving-cert\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:41.684695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:41.684469 2588 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/826eb58b-4a58-4853-935d-b99500731cfa-console-oauth-config\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:42.140688 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:42.140648 2588 generic.go:356] "Generic (PLEG): container finished" podID="826eb58b-4a58-4853-935d-b99500731cfa" containerID="8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf" exitCode=0 Jul 24 00:15:42.140688 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:42.140692 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c994bd64d-sqmf6" Jul 24 00:15:42.141163 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:42.140741 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c994bd64d-sqmf6" event={"ID":"826eb58b-4a58-4853-935d-b99500731cfa","Type":"ContainerDied","Data":"8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf"} Jul 24 00:15:42.141163 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:42.140783 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c994bd64d-sqmf6" event={"ID":"826eb58b-4a58-4853-935d-b99500731cfa","Type":"ContainerDied","Data":"adb5cd15788d037cbf1fc026d93415e36581aeca54f023660c4f58c68b029932"} Jul 24 00:15:42.141163 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:42.140806 2588 scope.go:117] "RemoveContainer" containerID="8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf" Jul 24 00:15:42.149430 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:42.149413 2588 scope.go:117] "RemoveContainer" containerID="8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf" Jul 24 00:15:42.149680 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:15:42.149661 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf\": container with ID starting with 8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf not found: ID does not exist" containerID="8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf" Jul 24 00:15:42.149741 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:42.149689 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf"} err="failed to get container status \"8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf\": rpc error: code = NotFound desc = could not find container \"8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf\": container with ID starting with 8712b995e8ba226fa06da64d14ae05790efe26b77b9346bb22ff84e724feabcf not found: ID does not exist" Jul 24 00:15:42.162953 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:42.162932 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c994bd64d-sqmf6"] Jul 24 00:15:42.166997 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:42.166975 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c994bd64d-sqmf6"] Jul 24 00:15:43.476098 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:43.476059 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="826eb58b-4a58-4853-935d-b99500731cfa" path="/var/lib/kubelet/pods/826eb58b-4a58-4853-935d-b99500731cfa/volumes" Jul 24 00:15:44.960805 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:44.960778 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z6qkx" Jul 24 00:15:52.147869 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.147825 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-744f65bdfb-4w7p5" podUID="39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1" containerName="console" containerID="cri-o://8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a" gracePeriod=15 Jul 24 00:15:52.397327 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.397295 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:52.397442 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.397410 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:15:52.480548 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.480444 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-service-ca\") pod \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " Jul 24 00:15:52.480548 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.480497 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-oauth-serving-cert\") pod \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " Jul 24 00:15:52.480548 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.480551 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpq7j\" (UniqueName: \"kubernetes.io/projected/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-kube-api-access-wpq7j\") pod \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " Jul 24 00:15:52.480829 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.480596 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-config\") pod \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " Jul 24 00:15:52.480829 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.480710 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-serving-cert\") pod \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " Jul 24 00:15:52.480829 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.480753 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-oauth-config\") pod \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\" (UID: \"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1\") " Jul 24 00:15:52.480980 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.480955 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-config" (OuterVolumeSpecName: "console-config") pod "39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1" (UID: "39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:15:52.481032 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.480971 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-service-ca" (OuterVolumeSpecName: "service-ca") pod "39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1" (UID: "39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:15:52.481032 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.480979 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1" (UID: "39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:15:52.481187 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.481169 2588 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-config\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:52.481237 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.481192 2588 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-service-ca\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:52.481237 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.481206 2588 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-oauth-serving-cert\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:52.482867 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.482838 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-kube-api-access-wpq7j" (OuterVolumeSpecName: "kube-api-access-wpq7j") pod "39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1" (UID: "39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1"). InnerVolumeSpecName "kube-api-access-wpq7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 00:15:52.482867 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.482845 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1" (UID: "39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 00:15:52.483054 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.482918 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1" (UID: "39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 00:15:52.498656 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.498616 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:15:52.582345 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.582303 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpq7j\" (UniqueName: \"kubernetes.io/projected/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-kube-api-access-wpq7j\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:52.582345 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.582336 2588 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-serving-cert\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:52.582345 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:52.582345 2588 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1-console-oauth-config\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:15:53.190010 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:53.189978 2588 generic.go:356] "Generic (PLEG): container finished" podID="39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1" containerID="8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a" exitCode=0 Jul 24 00:15:53.190010 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:53.190013 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744f65bdfb-4w7p5" event={"ID":"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1","Type":"ContainerDied","Data":"8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a"} Jul 24 00:15:53.190573 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:53.190030 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744f65bdfb-4w7p5" Jul 24 00:15:53.190573 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:53.190048 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744f65bdfb-4w7p5" event={"ID":"39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1","Type":"ContainerDied","Data":"0d2d4846c7be6dedc2cdc65469f2f244efbb92f1cd91c5517eee8f8f845fc0de"} Jul 24 00:15:53.190573 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:53.190068 2588 scope.go:117] "RemoveContainer" containerID="8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a" Jul 24 00:15:53.198255 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:53.198240 2588 scope.go:117] "RemoveContainer" containerID="8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a" Jul 24 00:15:53.198508 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:15:53.198489 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a\": container with ID starting with 8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a not found: ID does not exist" containerID="8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a" Jul 24 00:15:53.198567 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:53.198519 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a"} err="failed to get container status \"8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a\": rpc error: code = NotFound desc = could not find container \"8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a\": container with ID starting with 8fd33929a2ad434ba8a09a9d3e975bf0023fa24c08c7d49cd0f2026db5c8522a not found: ID does not exist" Jul 24 00:15:53.210708 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:53.210685 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-744f65bdfb-4w7p5"] Jul 24 00:15:53.216621 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:53.216599 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-744f65bdfb-4w7p5"] Jul 24 00:15:53.488608 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:53.488512 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1" path="/var/lib/kubelet/pods/39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1/volumes" Jul 24 00:15:55.492224 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:55.492193 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:15:55.496204 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:15:55.496177 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85f4f676b8-s5kvz" Jul 24 00:16:07.422097 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:07.422057 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:16:07.482304 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:07.482258 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:16:17.456614 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:17.456572 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:16:17.476746 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:17.476717 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:16:18.311173 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:18.311144 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 00:16:30.067411 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:30.067375 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:16:30.573948 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:30.573914 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:16:40.531842 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.531797 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c896db9dc-69txs"] Jul 24 00:16:40.532366 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.532136 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1" containerName="console" Jul 24 00:16:40.532366 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.532148 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1" containerName="console" Jul 24 00:16:40.532366 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.532170 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="826eb58b-4a58-4853-935d-b99500731cfa" containerName="console" Jul 24 00:16:40.532366 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.532176 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="826eb58b-4a58-4853-935d-b99500731cfa" containerName="console" Jul 24 00:16:40.532366 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.532223 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="826eb58b-4a58-4853-935d-b99500731cfa" containerName="console" Jul 24 00:16:40.532366 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.532236 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="39bbbdfc-cbf2-4068-bacc-e9df2b2c24d1" containerName="console" Jul 24 00:16:40.535635 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.535609 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.546629 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.546598 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c896db9dc-69txs"] Jul 24 00:16:40.591519 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.591483 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:16:40.658296 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.658265 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:16:40.719533 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.719501 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-oauth-serving-cert\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.719533 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.719538 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f450877d-67bc-4b54-a79a-d95ea812dca9-console-oauth-config\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.719781 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.719563 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64p9w\" (UniqueName: \"kubernetes.io/projected/f450877d-67bc-4b54-a79a-d95ea812dca9-kube-api-access-64p9w\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.719781 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.719678 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f450877d-67bc-4b54-a79a-d95ea812dca9-console-serving-cert\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.719781 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.719708 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-trusted-ca-bundle\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.719927 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.719806 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-console-config\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.719927 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.719840 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-service-ca\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.820828 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.820796 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-console-config\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.820995 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.820834 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-service-ca\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.820995 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.820884 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-oauth-serving-cert\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.820995 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.820912 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f450877d-67bc-4b54-a79a-d95ea812dca9-console-oauth-config\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.820995 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.820938 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64p9w\" (UniqueName: \"kubernetes.io/projected/f450877d-67bc-4b54-a79a-d95ea812dca9-kube-api-access-64p9w\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.820995 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.820971 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f450877d-67bc-4b54-a79a-d95ea812dca9-console-serving-cert\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.820995 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.820992 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-trusted-ca-bundle\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.821689 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.821648 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-console-config\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.821794 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.821654 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-service-ca\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.821882 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.821865 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-oauth-serving-cert\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.821946 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.821925 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-trusted-ca-bundle\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.823491 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.823470 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f450877d-67bc-4b54-a79a-d95ea812dca9-console-serving-cert\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.823572 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.823506 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f450877d-67bc-4b54-a79a-d95ea812dca9-console-oauth-config\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.828989 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.828971 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64p9w\" (UniqueName: \"kubernetes.io/projected/f450877d-67bc-4b54-a79a-d95ea812dca9-kube-api-access-64p9w\") pod \"console-c896db9dc-69txs\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.846558 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.846528 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:40.975970 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:40.975941 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c896db9dc-69txs"] Jul 24 00:16:40.976980 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:16:40.976957 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf450877d_67bc_4b54_a79a_d95ea812dca9.slice/crio-6725d2bdaad4edbd008a7ad58612f56f801365dec1aa4199f0d49c99353502b9 WatchSource:0}: Error finding container 6725d2bdaad4edbd008a7ad58612f56f801365dec1aa4199f0d49c99353502b9: Status 404 returned error can't find the container with id 6725d2bdaad4edbd008a7ad58612f56f801365dec1aa4199f0d49c99353502b9 Jul 24 00:16:41.388318 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:41.388276 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c896db9dc-69txs" event={"ID":"f450877d-67bc-4b54-a79a-d95ea812dca9","Type":"ContainerStarted","Data":"5f7211b4a0ddb57931f086b4b7918fb8d81b5819e9fadad5cc1664498069c34c"} Jul 24 00:16:41.388526 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:41.388363 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c896db9dc-69txs" event={"ID":"f450877d-67bc-4b54-a79a-d95ea812dca9","Type":"ContainerStarted","Data":"6725d2bdaad4edbd008a7ad58612f56f801365dec1aa4199f0d49c99353502b9"} Jul 24 00:16:41.407636 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:41.407580 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c896db9dc-69txs" podStartSLOduration=1.407563637 podStartE2EDuration="1.407563637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:16:41.406907255 +0000 UTC m=+162.410466637" watchObservedRunningTime="2026-07-24 00:16:41.407563637 +0000 UTC m=+162.411122984" Jul 24 00:16:45.387105 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:45.387044 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:16:45.456696 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:45.456665 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:16:48.332546 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.332148 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c896db9dc-69txs"] Jul 24 00:16:48.362395 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.362365 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d784cbff4-j7hqr"] Jul 24 00:16:48.365761 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.365743 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.375331 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.375307 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d784cbff4-j7hqr"] Jul 24 00:16:48.379794 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.379772 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjzr2\" (UniqueName: \"kubernetes.io/projected/f0530d03-2c76-4b89-97d3-27847eae96d1-kube-api-access-vjzr2\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.379902 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.379805 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0530d03-2c76-4b89-97d3-27847eae96d1-console-config\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.379902 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.379831 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0530d03-2c76-4b89-97d3-27847eae96d1-console-serving-cert\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.380011 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.379916 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0530d03-2c76-4b89-97d3-27847eae96d1-console-oauth-config\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.380011 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.379950 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0530d03-2c76-4b89-97d3-27847eae96d1-oauth-serving-cert\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.380127 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.380018 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0530d03-2c76-4b89-97d3-27847eae96d1-service-ca\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.380127 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.380044 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0530d03-2c76-4b89-97d3-27847eae96d1-trusted-ca-bundle\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.481173 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.481131 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0530d03-2c76-4b89-97d3-27847eae96d1-console-serving-cert\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.481377 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.481187 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0530d03-2c76-4b89-97d3-27847eae96d1-console-oauth-config\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.481377 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.481206 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0530d03-2c76-4b89-97d3-27847eae96d1-oauth-serving-cert\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.481377 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.481242 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0530d03-2c76-4b89-97d3-27847eae96d1-service-ca\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.481536 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.481383 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0530d03-2c76-4b89-97d3-27847eae96d1-trusted-ca-bundle\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.481536 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.481458 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjzr2\" (UniqueName: \"kubernetes.io/projected/f0530d03-2c76-4b89-97d3-27847eae96d1-kube-api-access-vjzr2\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.481536 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.481516 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0530d03-2c76-4b89-97d3-27847eae96d1-console-config\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.482036 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.482011 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0530d03-2c76-4b89-97d3-27847eae96d1-service-ca\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.482166 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.482039 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0530d03-2c76-4b89-97d3-27847eae96d1-oauth-serving-cert\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.482237 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.482168 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0530d03-2c76-4b89-97d3-27847eae96d1-console-config\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.482237 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.482199 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0530d03-2c76-4b89-97d3-27847eae96d1-trusted-ca-bundle\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.483603 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.483582 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0530d03-2c76-4b89-97d3-27847eae96d1-console-oauth-config\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.483692 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.483678 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0530d03-2c76-4b89-97d3-27847eae96d1-console-serving-cert\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.489732 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.489704 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjzr2\" (UniqueName: \"kubernetes.io/projected/f0530d03-2c76-4b89-97d3-27847eae96d1-kube-api-access-vjzr2\") pod \"console-d784cbff4-j7hqr\" (UID: \"f0530d03-2c76-4b89-97d3-27847eae96d1\") " pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.676111 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.675987 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:48.807418 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:48.807387 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d784cbff4-j7hqr"] Jul 24 00:16:48.809977 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:16:48.809946 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0530d03_2c76_4b89_97d3_27847eae96d1.slice/crio-10427ec7d220428b5c2050833486240b738c8a4b8b2a5441c8fabcbfe6cccb5c WatchSource:0}: Error finding container 10427ec7d220428b5c2050833486240b738c8a4b8b2a5441c8fabcbfe6cccb5c: Status 404 returned error can't find the container with id 10427ec7d220428b5c2050833486240b738c8a4b8b2a5441c8fabcbfe6cccb5c Jul 24 00:16:49.424758 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:49.424723 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d784cbff4-j7hqr" event={"ID":"f0530d03-2c76-4b89-97d3-27847eae96d1","Type":"ContainerStarted","Data":"832865a2fb50d834a31a0b73e54beedfb3d515e7b21592e2a5b4c1d4e6773212"} Jul 24 00:16:49.425236 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:49.424780 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d784cbff4-j7hqr" event={"ID":"f0530d03-2c76-4b89-97d3-27847eae96d1","Type":"ContainerStarted","Data":"10427ec7d220428b5c2050833486240b738c8a4b8b2a5441c8fabcbfe6cccb5c"} Jul 24 00:16:49.439966 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:49.439907 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d784cbff4-j7hqr" podStartSLOduration=1.439886631 podStartE2EDuration="1.439886631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:16:49.439802482 +0000 UTC m=+170.443361831" watchObservedRunningTime="2026-07-24 00:16:49.439886631 +0000 UTC m=+170.443445979" Jul 24 00:16:50.847005 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:50.846971 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:16:57.418860 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:57.418823 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:16:57.477642 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:57.477579 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:16:58.676260 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:58.676223 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:58.676702 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:58.676286 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:58.681029 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:58.681000 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:59.480707 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:59.480680 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d784cbff4-j7hqr" Jul 24 00:16:59.525116 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:59.525052 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b95b476ff-799xt"] Jul 24 00:16:59.621021 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:59.620991 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:16:59.724222 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:16:59.724188 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:17:07.254041 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:07.254005 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:17:07.406678 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:07.406648 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:17:07.507183 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:07.507105 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:17:13.350581 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.350521 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c896db9dc-69txs" podUID="f450877d-67bc-4b54-a79a-d95ea812dca9" containerName="console" containerID="cri-o://5f7211b4a0ddb57931f086b4b7918fb8d81b5819e9fadad5cc1664498069c34c" gracePeriod=15 Jul 24 00:17:13.525822 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.525787 2588 generic.go:356] "Generic (PLEG): container finished" podID="f450877d-67bc-4b54-a79a-d95ea812dca9" containerID="5f7211b4a0ddb57931f086b4b7918fb8d81b5819e9fadad5cc1664498069c34c" exitCode=0 Jul 24 00:17:13.525946 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.525868 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c896db9dc-69txs" event={"ID":"f450877d-67bc-4b54-a79a-d95ea812dca9","Type":"ContainerDied","Data":"5f7211b4a0ddb57931f086b4b7918fb8d81b5819e9fadad5cc1664498069c34c"} Jul 24 00:17:13.597640 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.597615 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:17:13.717933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.717849 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-console-config\") pod \"f450877d-67bc-4b54-a79a-d95ea812dca9\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " Jul 24 00:17:13.717933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.717887 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-trusted-ca-bundle\") pod \"f450877d-67bc-4b54-a79a-d95ea812dca9\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " Jul 24 00:17:13.717933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.717904 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-service-ca\") pod \"f450877d-67bc-4b54-a79a-d95ea812dca9\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " Jul 24 00:17:13.718222 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.717968 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f450877d-67bc-4b54-a79a-d95ea812dca9-console-serving-cert\") pod \"f450877d-67bc-4b54-a79a-d95ea812dca9\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " Jul 24 00:17:13.718222 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.717987 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f450877d-67bc-4b54-a79a-d95ea812dca9-console-oauth-config\") pod \"f450877d-67bc-4b54-a79a-d95ea812dca9\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " Jul 24 00:17:13.718222 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.718006 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64p9w\" (UniqueName: \"kubernetes.io/projected/f450877d-67bc-4b54-a79a-d95ea812dca9-kube-api-access-64p9w\") pod \"f450877d-67bc-4b54-a79a-d95ea812dca9\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " Jul 24 00:17:13.718222 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.718025 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-oauth-serving-cert\") pod \"f450877d-67bc-4b54-a79a-d95ea812dca9\" (UID: \"f450877d-67bc-4b54-a79a-d95ea812dca9\") " Jul 24 00:17:13.718452 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.718425 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-console-config" (OuterVolumeSpecName: "console-config") pod "f450877d-67bc-4b54-a79a-d95ea812dca9" (UID: "f450877d-67bc-4b54-a79a-d95ea812dca9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:17:13.718452 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.718433 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-service-ca" (OuterVolumeSpecName: "service-ca") pod "f450877d-67bc-4b54-a79a-d95ea812dca9" (UID: "f450877d-67bc-4b54-a79a-d95ea812dca9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:17:13.718563 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.718500 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f450877d-67bc-4b54-a79a-d95ea812dca9" (UID: "f450877d-67bc-4b54-a79a-d95ea812dca9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:17:13.718563 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.718546 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f450877d-67bc-4b54-a79a-d95ea812dca9" (UID: "f450877d-67bc-4b54-a79a-d95ea812dca9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:17:13.720130 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.720100 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f450877d-67bc-4b54-a79a-d95ea812dca9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f450877d-67bc-4b54-a79a-d95ea812dca9" (UID: "f450877d-67bc-4b54-a79a-d95ea812dca9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 00:17:13.720248 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.720129 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f450877d-67bc-4b54-a79a-d95ea812dca9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f450877d-67bc-4b54-a79a-d95ea812dca9" (UID: "f450877d-67bc-4b54-a79a-d95ea812dca9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 00:17:13.720293 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.720266 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f450877d-67bc-4b54-a79a-d95ea812dca9-kube-api-access-64p9w" (OuterVolumeSpecName: "kube-api-access-64p9w") pod "f450877d-67bc-4b54-a79a-d95ea812dca9" (UID: "f450877d-67bc-4b54-a79a-d95ea812dca9"). InnerVolumeSpecName "kube-api-access-64p9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 00:17:13.819121 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.819060 2588 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f450877d-67bc-4b54-a79a-d95ea812dca9-console-serving-cert\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:13.819121 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.819115 2588 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f450877d-67bc-4b54-a79a-d95ea812dca9-console-oauth-config\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:13.819121 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.819128 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64p9w\" (UniqueName: \"kubernetes.io/projected/f450877d-67bc-4b54-a79a-d95ea812dca9-kube-api-access-64p9w\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:13.819350 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.819136 2588 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-oauth-serving-cert\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:13.819350 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.819145 2588 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-console-config\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:13.819350 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.819155 2588 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-trusted-ca-bundle\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:13.819350 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:13.819164 2588 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f450877d-67bc-4b54-a79a-d95ea812dca9-service-ca\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:14.530569 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:14.530541 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c896db9dc-69txs" Jul 24 00:17:14.530569 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:14.530560 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c896db9dc-69txs" event={"ID":"f450877d-67bc-4b54-a79a-d95ea812dca9","Type":"ContainerDied","Data":"6725d2bdaad4edbd008a7ad58612f56f801365dec1aa4199f0d49c99353502b9"} Jul 24 00:17:14.531100 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:14.530611 2588 scope.go:117] "RemoveContainer" containerID="5f7211b4a0ddb57931f086b4b7918fb8d81b5819e9fadad5cc1664498069c34c" Jul 24 00:17:14.551734 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:14.551708 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c896db9dc-69txs"] Jul 24 00:17:14.555246 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:14.555225 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c896db9dc-69txs"] Jul 24 00:17:15.477833 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:15.477780 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f450877d-67bc-4b54-a79a-d95ea812dca9" path="/var/lib/kubelet/pods/f450877d-67bc-4b54-a79a-d95ea812dca9/volumes" Jul 24 00:17:24.546163 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.546098 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b95b476ff-799xt" podUID="94270855-6940-4ebe-b39a-74789d0d5d9a" containerName="console" containerID="cri-o://df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd" gracePeriod=15 Jul 24 00:17:24.790675 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.790651 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:17:24.819203 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.819133 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6x6sd\" (UniqueName: \"kubernetes.io/projected/94270855-6940-4ebe-b39a-74789d0d5d9a-kube-api-access-6x6sd\") pod \"94270855-6940-4ebe-b39a-74789d0d5d9a\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " Jul 24 00:17:24.819321 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.819204 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-console-config\") pod \"94270855-6940-4ebe-b39a-74789d0d5d9a\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " Jul 24 00:17:24.819321 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.819240 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-trusted-ca-bundle\") pod \"94270855-6940-4ebe-b39a-74789d0d5d9a\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " Jul 24 00:17:24.819321 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.819290 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94270855-6940-4ebe-b39a-74789d0d5d9a-console-serving-cert\") pod \"94270855-6940-4ebe-b39a-74789d0d5d9a\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " Jul 24 00:17:24.819488 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.819328 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94270855-6940-4ebe-b39a-74789d0d5d9a-console-oauth-config\") pod \"94270855-6940-4ebe-b39a-74789d0d5d9a\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " Jul 24 00:17:24.819488 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.819371 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-service-ca\") pod \"94270855-6940-4ebe-b39a-74789d0d5d9a\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " Jul 24 00:17:24.819757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.819671 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-console-config" (OuterVolumeSpecName: "console-config") pod "94270855-6940-4ebe-b39a-74789d0d5d9a" (UID: "94270855-6940-4ebe-b39a-74789d0d5d9a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:17:24.819757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.819679 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "94270855-6940-4ebe-b39a-74789d0d5d9a" (UID: "94270855-6940-4ebe-b39a-74789d0d5d9a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:17:24.819967 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.819946 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-service-ca" (OuterVolumeSpecName: "service-ca") pod "94270855-6940-4ebe-b39a-74789d0d5d9a" (UID: "94270855-6940-4ebe-b39a-74789d0d5d9a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:17:24.821561 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.821520 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94270855-6940-4ebe-b39a-74789d0d5d9a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "94270855-6940-4ebe-b39a-74789d0d5d9a" (UID: "94270855-6940-4ebe-b39a-74789d0d5d9a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 00:17:24.821670 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.821645 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94270855-6940-4ebe-b39a-74789d0d5d9a-kube-api-access-6x6sd" (OuterVolumeSpecName: "kube-api-access-6x6sd") pod "94270855-6940-4ebe-b39a-74789d0d5d9a" (UID: "94270855-6940-4ebe-b39a-74789d0d5d9a"). InnerVolumeSpecName "kube-api-access-6x6sd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 00:17:24.821863 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.821831 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94270855-6940-4ebe-b39a-74789d0d5d9a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "94270855-6940-4ebe-b39a-74789d0d5d9a" (UID: "94270855-6940-4ebe-b39a-74789d0d5d9a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 00:17:24.920715 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.920684 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-oauth-serving-cert\") pod \"94270855-6940-4ebe-b39a-74789d0d5d9a\" (UID: \"94270855-6940-4ebe-b39a-74789d0d5d9a\") " Jul 24 00:17:24.920871 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.920857 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x6sd\" (UniqueName: \"kubernetes.io/projected/94270855-6940-4ebe-b39a-74789d0d5d9a-kube-api-access-6x6sd\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:24.920933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.920875 2588 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-console-config\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:24.920933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.920885 2588 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-trusted-ca-bundle\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:24.920933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.920894 2588 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94270855-6940-4ebe-b39a-74789d0d5d9a-console-serving-cert\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:24.920933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.920902 2588 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94270855-6940-4ebe-b39a-74789d0d5d9a-console-oauth-config\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:24.920933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.920911 2588 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-service-ca\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:24.921110 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:24.920979 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "94270855-6940-4ebe-b39a-74789d0d5d9a" (UID: "94270855-6940-4ebe-b39a-74789d0d5d9a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:17:25.021311 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:25.021275 2588 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94270855-6940-4ebe-b39a-74789d0d5d9a-oauth-serving-cert\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:17:25.576740 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:25.576703 2588 generic.go:356] "Generic (PLEG): container finished" podID="94270855-6940-4ebe-b39a-74789d0d5d9a" containerID="df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd" exitCode=0 Jul 24 00:17:25.577244 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:25.576753 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b95b476ff-799xt" Jul 24 00:17:25.577244 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:25.576775 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b95b476ff-799xt" event={"ID":"94270855-6940-4ebe-b39a-74789d0d5d9a","Type":"ContainerDied","Data":"df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd"} Jul 24 00:17:25.577244 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:25.576827 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b95b476ff-799xt" event={"ID":"94270855-6940-4ebe-b39a-74789d0d5d9a","Type":"ContainerDied","Data":"ce58678131c631fd729704cfd29edbf8d9deee5afab06dd84eced17d907c17e4"} Jul 24 00:17:25.577244 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:25.576848 2588 scope.go:117] "RemoveContainer" containerID="df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd" Jul 24 00:17:25.585190 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:25.585134 2588 scope.go:117] "RemoveContainer" containerID="df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd" Jul 24 00:17:25.585442 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:17:25.585424 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd\": container with ID starting with df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd not found: ID does not exist" containerID="df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd" Jul 24 00:17:25.585509 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:25.585457 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd"} err="failed to get container status \"df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd\": rpc error: code = NotFound desc = could not find container \"df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd\": container with ID starting with df328bf75d19f617daab6aee886736f15d0f38fbf49dfcf14870f32db3537afd not found: ID does not exist" Jul 24 00:17:25.593542 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:25.593513 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b95b476ff-799xt"] Jul 24 00:17:25.597341 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:25.597322 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b95b476ff-799xt"] Jul 24 00:17:27.480771 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:27.480737 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94270855-6940-4ebe-b39a-74789d0d5d9a" path="/var/lib/kubelet/pods/94270855-6940-4ebe-b39a-74789d0d5d9a/volumes" Jul 24 00:17:30.395513 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:30.395480 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:17:48.742886 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:48.742851 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:17:48.868526 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:17:48.868474 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:15.807324 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:15.807287 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:16.614071 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:16.614025 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:19.430819 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:19.430785 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:19.520951 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:19.520916 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:20.605671 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:20.605632 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:20.749656 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:20.749617 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:21.635836 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:21.635762 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:21.739788 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:21.739760 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:22.737443 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.737412 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5tshw"] Jul 24 00:18:22.737823 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.737752 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94270855-6940-4ebe-b39a-74789d0d5d9a" containerName="console" Jul 24 00:18:22.737823 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.737763 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="94270855-6940-4ebe-b39a-74789d0d5d9a" containerName="console" Jul 24 00:18:22.737823 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.737778 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f450877d-67bc-4b54-a79a-d95ea812dca9" containerName="console" Jul 24 00:18:22.737823 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.737784 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="f450877d-67bc-4b54-a79a-d95ea812dca9" containerName="console" Jul 24 00:18:22.737954 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.737842 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="94270855-6940-4ebe-b39a-74789d0d5d9a" containerName="console" Jul 24 00:18:22.737954 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.737852 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="f450877d-67bc-4b54-a79a-d95ea812dca9" containerName="console" Jul 24 00:18:22.740727 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.740709 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" Jul 24 00:18:22.743939 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.743915 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 00:18:22.744054 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.744011 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 00:18:22.746169 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.746155 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-c7l7g\"" Jul 24 00:18:22.749596 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.749572 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5tshw"] Jul 24 00:18:22.828929 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.828891 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3537f746-993c-4fcf-9f9f-4fdf3774a5d7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5tshw\" (UID: \"3537f746-993c-4fcf-9f9f-4fdf3774a5d7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" Jul 24 00:18:22.829119 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.828943 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfbwc\" (UniqueName: \"kubernetes.io/projected/3537f746-993c-4fcf-9f9f-4fdf3774a5d7-kube-api-access-dfbwc\") pod \"cert-manager-webhook-6486ffd997-5tshw\" (UID: \"3537f746-993c-4fcf-9f9f-4fdf3774a5d7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" Jul 24 00:18:22.929860 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.929815 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3537f746-993c-4fcf-9f9f-4fdf3774a5d7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5tshw\" (UID: \"3537f746-993c-4fcf-9f9f-4fdf3774a5d7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" Jul 24 00:18:22.930029 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.929885 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfbwc\" (UniqueName: \"kubernetes.io/projected/3537f746-993c-4fcf-9f9f-4fdf3774a5d7-kube-api-access-dfbwc\") pod \"cert-manager-webhook-6486ffd997-5tshw\" (UID: \"3537f746-993c-4fcf-9f9f-4fdf3774a5d7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" Jul 24 00:18:22.938981 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.938951 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3537f746-993c-4fcf-9f9f-4fdf3774a5d7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5tshw\" (UID: \"3537f746-993c-4fcf-9f9f-4fdf3774a5d7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" Jul 24 00:18:22.939135 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:22.938955 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfbwc\" (UniqueName: \"kubernetes.io/projected/3537f746-993c-4fcf-9f9f-4fdf3774a5d7-kube-api-access-dfbwc\") pod \"cert-manager-webhook-6486ffd997-5tshw\" (UID: \"3537f746-993c-4fcf-9f9f-4fdf3774a5d7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" Jul 24 00:18:23.066435 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:23.066350 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" Jul 24 00:18:23.197342 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:23.197312 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5tshw"] Jul 24 00:18:23.200198 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:18:23.200171 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3537f746_993c_4fcf_9f9f_4fdf3774a5d7.slice/crio-4a3a1b216e34801ece7de912e16259932f3bcc8ff462109be629dbc778117a7d WatchSource:0}: Error finding container 4a3a1b216e34801ece7de912e16259932f3bcc8ff462109be629dbc778117a7d: Status 404 returned error can't find the container with id 4a3a1b216e34801ece7de912e16259932f3bcc8ff462109be629dbc778117a7d Jul 24 00:18:23.631836 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:23.631787 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:23.809244 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:23.809210 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" event={"ID":"3537f746-993c-4fcf-9f9f-4fdf3774a5d7","Type":"ContainerStarted","Data":"4a3a1b216e34801ece7de912e16259932f3bcc8ff462109be629dbc778117a7d"} Jul 24 00:18:24.062992 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:24.062861 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:26.211004 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:26.210968 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:26.268650 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:26.268592 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:26.827371 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:26.827339 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" event={"ID":"3537f746-993c-4fcf-9f9f-4fdf3774a5d7","Type":"ContainerStarted","Data":"de18d5a6433c072aaed0cd41bd70e8b332bdb699ccdd0c1bcb84f9d55c6b41b1"} Jul 24 00:18:26.827534 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:26.827395 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" Jul 24 00:18:26.845605 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:26.845559 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" podStartSLOduration=1.7249884199999999 podStartE2EDuration="4.845542942s" totalImagesPullingTime="3.120554522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:18:26.844804649 +0000 UTC m=+267.848363997" watchObservedRunningTime="2026-07-24 00:18:26.845542942 +0000 UTC m=+267.849102289" Jul 24 00:18:28.052797 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:28.052756 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:28.104768 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:28.104738 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:29.824763 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:29.824722 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:29.926441 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:29.926408 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:32.233154 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.233075 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:32.521607 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.521531 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x22w5"] Jul 24 00:18:32.524779 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.524762 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x22w5" Jul 24 00:18:32.526983 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.526965 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7vthk\"" Jul 24 00:18:32.535446 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.535423 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x22w5"] Jul 24 00:18:32.617423 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.617395 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qncf\" (UniqueName: \"kubernetes.io/projected/4b61a87f-49e8-451e-b4a4-0cbb14245980-kube-api-access-4qncf\") pod \"cert-manager-55b4d954d5-x22w5\" (UID: \"4b61a87f-49e8-451e-b4a4-0cbb14245980\") " pod="cert-manager/cert-manager-55b4d954d5-x22w5" Jul 24 00:18:32.617423 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.617422 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b61a87f-49e8-451e-b4a4-0cbb14245980-bound-sa-token\") pod \"cert-manager-55b4d954d5-x22w5\" (UID: \"4b61a87f-49e8-451e-b4a4-0cbb14245980\") " pod="cert-manager/cert-manager-55b4d954d5-x22w5" Jul 24 00:18:32.718216 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.718183 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qncf\" (UniqueName: \"kubernetes.io/projected/4b61a87f-49e8-451e-b4a4-0cbb14245980-kube-api-access-4qncf\") pod \"cert-manager-55b4d954d5-x22w5\" (UID: \"4b61a87f-49e8-451e-b4a4-0cbb14245980\") " pod="cert-manager/cert-manager-55b4d954d5-x22w5" Jul 24 00:18:32.718216 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.718216 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b61a87f-49e8-451e-b4a4-0cbb14245980-bound-sa-token\") pod \"cert-manager-55b4d954d5-x22w5\" (UID: \"4b61a87f-49e8-451e-b4a4-0cbb14245980\") " pod="cert-manager/cert-manager-55b4d954d5-x22w5" Jul 24 00:18:32.726235 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.726198 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b61a87f-49e8-451e-b4a4-0cbb14245980-bound-sa-token\") pod \"cert-manager-55b4d954d5-x22w5\" (UID: \"4b61a87f-49e8-451e-b4a4-0cbb14245980\") " pod="cert-manager/cert-manager-55b4d954d5-x22w5" Jul 24 00:18:32.726397 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.726380 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qncf\" (UniqueName: \"kubernetes.io/projected/4b61a87f-49e8-451e-b4a4-0cbb14245980-kube-api-access-4qncf\") pod \"cert-manager-55b4d954d5-x22w5\" (UID: \"4b61a87f-49e8-451e-b4a4-0cbb14245980\") " pod="cert-manager/cert-manager-55b4d954d5-x22w5" Jul 24 00:18:32.833216 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.833186 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x22w5" Jul 24 00:18:32.833660 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.833640 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5tshw" Jul 24 00:18:32.965930 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:32.965909 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x22w5"] Jul 24 00:18:32.968501 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:18:32.968475 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b61a87f_49e8_451e_b4a4_0cbb14245980.slice/crio-bd0260a654f097bb3f35b78eda6e6256039957f34bab841108256ecb1418217f WatchSource:0}: Error finding container bd0260a654f097bb3f35b78eda6e6256039957f34bab841108256ecb1418217f: Status 404 returned error can't find the container with id bd0260a654f097bb3f35b78eda6e6256039957f34bab841108256ecb1418217f Jul 24 00:18:33.857258 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:33.857209 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x22w5" event={"ID":"4b61a87f-49e8-451e-b4a4-0cbb14245980","Type":"ContainerStarted","Data":"733b8e800864747dcc79f5bcfdf84e857d74cfdd05df317c54a361745f81afc9"} Jul 24 00:18:33.857258 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:33.857262 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x22w5" event={"ID":"4b61a87f-49e8-451e-b4a4-0cbb14245980","Type":"ContainerStarted","Data":"bd0260a654f097bb3f35b78eda6e6256039957f34bab841108256ecb1418217f"} Jul 24 00:18:33.872491 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:33.872449 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-x22w5" podStartSLOduration=1.872434667 podStartE2EDuration="1.872434667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:18:33.872178443 +0000 UTC m=+274.875737789" watchObservedRunningTime="2026-07-24 00:18:33.872434667 +0000 UTC m=+274.875994013" Jul 24 00:18:35.335995 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:35.335963 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:35.988182 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:35.988146 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:36.088834 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:36.088802 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:38.206901 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:38.206869 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:53.820964 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:53.820927 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:54.782195 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.782155 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc"] Jul 24 00:18:54.785701 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.785679 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.788046 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.788029 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 00:18:54.788323 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.788302 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b26lx\"" Jul 24 00:18:54.788435 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.788385 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 00:18:54.788435 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.788398 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 00:18:54.788435 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.788430 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 00:18:54.805943 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.805913 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc"] Jul 24 00:18:54.814398 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.814368 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32212fd4-a8fe-4762-886a-dfdf691b2e44-manifests\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.814529 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.814477 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldwpq\" (UniqueName: \"kubernetes.io/projected/32212fd4-a8fe-4762-886a-dfdf691b2e44-kube-api-access-ldwpq\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.814580 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.814545 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32212fd4-a8fe-4762-886a-dfdf691b2e44-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.814625 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.814576 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32212fd4-a8fe-4762-886a-dfdf691b2e44-tmp\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.814667 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.814649 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32212fd4-a8fe-4762-886a-dfdf691b2e44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.915613 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.915579 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldwpq\" (UniqueName: \"kubernetes.io/projected/32212fd4-a8fe-4762-886a-dfdf691b2e44-kube-api-access-ldwpq\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.916074 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.915622 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32212fd4-a8fe-4762-886a-dfdf691b2e44-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.916074 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.915749 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32212fd4-a8fe-4762-886a-dfdf691b2e44-tmp\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.916074 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.915792 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32212fd4-a8fe-4762-886a-dfdf691b2e44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.916074 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.915876 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32212fd4-a8fe-4762-886a-dfdf691b2e44-manifests\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.916327 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.916252 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32212fd4-a8fe-4762-886a-dfdf691b2e44-manifests\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.917939 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.917919 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32212fd4-a8fe-4762-886a-dfdf691b2e44-tmp\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.918045 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.917963 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32212fd4-a8fe-4762-886a-dfdf691b2e44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.918181 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.918162 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32212fd4-a8fe-4762-886a-dfdf691b2e44-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:54.927068 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:54.927045 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldwpq\" (UniqueName: \"kubernetes.io/projected/32212fd4-a8fe-4762-886a-dfdf691b2e44-kube-api-access-ldwpq\") pod \"opendatahub-operator-controller-manager-6cff767bd6-65nhc\" (UID: \"32212fd4-a8fe-4762-886a-dfdf691b2e44\") " pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:55.096200 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:55.096167 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:18:55.097141 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:55.097117 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:55.198404 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:55.198373 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:55.235714 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:55.235689 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc"] Jul 24 00:18:55.237674 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:18:55.237648 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32212fd4_a8fe_4762_886a_dfdf691b2e44.slice/crio-2a7295b4e3dfcfa187b68ae24a8bc0fe6c39ee1bb211a6c39317551fb438f04f WatchSource:0}: Error finding container 2a7295b4e3dfcfa187b68ae24a8bc0fe6c39ee1bb211a6c39317551fb438f04f: Status 404 returned error can't find the container with id 2a7295b4e3dfcfa187b68ae24a8bc0fe6c39ee1bb211a6c39317551fb438f04f Jul 24 00:18:55.297985 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:55.297950 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:55.400901 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:55.400821 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:55.499093 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:55.499048 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:18:55.947656 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:55.947624 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" event={"ID":"32212fd4-a8fe-4762-886a-dfdf691b2e44","Type":"ContainerStarted","Data":"2a7295b4e3dfcfa187b68ae24a8bc0fe6c39ee1bb211a6c39317551fb438f04f"} Jul 24 00:18:58.964607 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:58.964560 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" event={"ID":"32212fd4-a8fe-4762-886a-dfdf691b2e44","Type":"ContainerStarted","Data":"2d8eb00fac192dc7d534e4381f64b8b8fbe06f5a6ed0922bd80730bab9d5f63f"} Jul 24 00:18:59.333099 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:59.333052 2588 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 00:18:59.970163 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:59.970124 2588 generic.go:356] "Generic (PLEG): container finished" podID="32212fd4-a8fe-4762-886a-dfdf691b2e44" containerID="2d8eb00fac192dc7d534e4381f64b8b8fbe06f5a6ed0922bd80730bab9d5f63f" exitCode=0 Jul 24 00:18:59.972629 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:18:59.970198 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" event={"ID":"32212fd4-a8fe-4762-886a-dfdf691b2e44","Type":"ContainerDied","Data":"2d8eb00fac192dc7d534e4381f64b8b8fbe06f5a6ed0922bd80730bab9d5f63f"} Jul 24 00:19:00.976876 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:00.976842 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" event={"ID":"32212fd4-a8fe-4762-886a-dfdf691b2e44","Type":"ContainerStarted","Data":"16daa352d1ddbeb29dc7c5e7170b9d88bb95ff90de8b1cb28137f19201c9e7e5"} Jul 24 00:19:00.977284 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:00.976933 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:19:00.998493 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:00.998440 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" podStartSLOduration=2.578756791 podStartE2EDuration="6.998425739s" totalImagesPullingTime="3.308408121s" totalInitContainerRuntime="1.111260827s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:18:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:19:00.996789323 +0000 UTC m=+302.000348666" watchObservedRunningTime="2026-07-24 00:19:00.998425739 +0000 UTC m=+302.001985088" Jul 24 00:19:05.199875 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:05.199837 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:05.315123 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:05.315093 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:06.872121 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:06.872060 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:06.969997 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:06.969962 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:11.983742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:11.983712 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cff767bd6-65nhc" Jul 24 00:19:14.040646 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:14.040611 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:14.202604 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:14.202574 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:14.748890 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:14.748860 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:14.805676 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:14.805646 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:14.909241 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:14.909210 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:15.007548 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:15.007467 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:15.335230 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:15.335202 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:15.635940 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:15.635856 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:19.127563 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.127530 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh"] Jul 24 00:19:19.136219 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.136188 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.138792 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.138771 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 24 00:19:19.139261 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.139245 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 24 00:19:19.139718 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.139704 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 24 00:19:19.140048 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.140030 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 24 00:19:19.140195 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.140180 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nln5t\"" Jul 24 00:19:19.140270 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.140183 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 24 00:19:19.149119 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.149073 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh"] Jul 24 00:19:19.227853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.227820 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e0bacb1-56f8-4038-96c0-b3f7aac5e500-metrics-cert\") pod \"lws-controller-manager-5b84c6bc85-7x8nh\" (UID: \"0e0bacb1-56f8-4038-96c0-b3f7aac5e500\") " pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.228014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.227861 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0e0bacb1-56f8-4038-96c0-b3f7aac5e500-manager-config\") pod \"lws-controller-manager-5b84c6bc85-7x8nh\" (UID: \"0e0bacb1-56f8-4038-96c0-b3f7aac5e500\") " pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.228014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.227893 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e0bacb1-56f8-4038-96c0-b3f7aac5e500-cert\") pod \"lws-controller-manager-5b84c6bc85-7x8nh\" (UID: \"0e0bacb1-56f8-4038-96c0-b3f7aac5e500\") " pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.228114 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.228042 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nx7m\" (UniqueName: \"kubernetes.io/projected/0e0bacb1-56f8-4038-96c0-b3f7aac5e500-kube-api-access-8nx7m\") pod \"lws-controller-manager-5b84c6bc85-7x8nh\" (UID: \"0e0bacb1-56f8-4038-96c0-b3f7aac5e500\") " pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.329176 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.329145 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nx7m\" (UniqueName: \"kubernetes.io/projected/0e0bacb1-56f8-4038-96c0-b3f7aac5e500-kube-api-access-8nx7m\") pod \"lws-controller-manager-5b84c6bc85-7x8nh\" (UID: \"0e0bacb1-56f8-4038-96c0-b3f7aac5e500\") " pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.329176 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.329179 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e0bacb1-56f8-4038-96c0-b3f7aac5e500-metrics-cert\") pod \"lws-controller-manager-5b84c6bc85-7x8nh\" (UID: \"0e0bacb1-56f8-4038-96c0-b3f7aac5e500\") " pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.329366 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.329201 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0e0bacb1-56f8-4038-96c0-b3f7aac5e500-manager-config\") pod \"lws-controller-manager-5b84c6bc85-7x8nh\" (UID: \"0e0bacb1-56f8-4038-96c0-b3f7aac5e500\") " pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.329366 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.329221 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e0bacb1-56f8-4038-96c0-b3f7aac5e500-cert\") pod \"lws-controller-manager-5b84c6bc85-7x8nh\" (UID: \"0e0bacb1-56f8-4038-96c0-b3f7aac5e500\") " pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.329802 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.329781 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0e0bacb1-56f8-4038-96c0-b3f7aac5e500-manager-config\") pod \"lws-controller-manager-5b84c6bc85-7x8nh\" (UID: \"0e0bacb1-56f8-4038-96c0-b3f7aac5e500\") " pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.331655 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.331626 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e0bacb1-56f8-4038-96c0-b3f7aac5e500-metrics-cert\") pod \"lws-controller-manager-5b84c6bc85-7x8nh\" (UID: \"0e0bacb1-56f8-4038-96c0-b3f7aac5e500\") " pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.331759 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.331674 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e0bacb1-56f8-4038-96c0-b3f7aac5e500-cert\") pod \"lws-controller-manager-5b84c6bc85-7x8nh\" (UID: \"0e0bacb1-56f8-4038-96c0-b3f7aac5e500\") " pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.337178 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.337156 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nx7m\" (UniqueName: \"kubernetes.io/projected/0e0bacb1-56f8-4038-96c0-b3f7aac5e500-kube-api-access-8nx7m\") pod \"lws-controller-manager-5b84c6bc85-7x8nh\" (UID: \"0e0bacb1-56f8-4038-96c0-b3f7aac5e500\") " pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.445835 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.445754 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:19.586585 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.586553 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh"] Jul 24 00:19:19.591740 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:19:19.591715 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0bacb1_56f8_4038_96c0_b3f7aac5e500.slice/crio-1e42b837abbf1fec75255b635ea4847806588bb18f4d3925548cbf0b234f4570 WatchSource:0}: Error finding container 1e42b837abbf1fec75255b635ea4847806588bb18f4d3925548cbf0b234f4570: Status 404 returned error can't find the container with id 1e42b837abbf1fec75255b635ea4847806588bb18f4d3925548cbf0b234f4570 Jul 24 00:19:19.593753 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:19.593736 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 00:19:20.021860 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.021829 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:20.063645 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.063606 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" event={"ID":"0e0bacb1-56f8-4038-96c0-b3f7aac5e500","Type":"ContainerStarted","Data":"1e42b837abbf1fec75255b635ea4847806588bb18f4d3925548cbf0b234f4570"} Jul 24 00:19:20.172215 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.172182 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg"] Jul 24 00:19:20.176949 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.176931 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" Jul 24 00:19:20.185757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.185738 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 24 00:19:20.186892 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.186873 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 00:19:20.186994 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.186935 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fms4b\"" Jul 24 00:19:20.186994 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.186936 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 00:19:20.187637 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.187622 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 24 00:19:20.194273 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.194253 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg"] Jul 24 00:19:20.237262 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.237234 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/682e1a15-b52a-443b-bf2f-54a0e3ada196-tls-certs\") pod \"kube-auth-proxy-6c994f5cd9-fzvrg\" (UID: \"682e1a15-b52a-443b-bf2f-54a0e3ada196\") " pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" Jul 24 00:19:20.237262 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.237263 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/682e1a15-b52a-443b-bf2f-54a0e3ada196-tmp\") pod \"kube-auth-proxy-6c994f5cd9-fzvrg\" (UID: \"682e1a15-b52a-443b-bf2f-54a0e3ada196\") " pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" Jul 24 00:19:20.237477 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.237440 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwmgh\" (UniqueName: \"kubernetes.io/projected/682e1a15-b52a-443b-bf2f-54a0e3ada196-kube-api-access-vwmgh\") pod \"kube-auth-proxy-6c994f5cd9-fzvrg\" (UID: \"682e1a15-b52a-443b-bf2f-54a0e3ada196\") " pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" Jul 24 00:19:20.252652 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.252628 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:20.338522 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.338488 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwmgh\" (UniqueName: \"kubernetes.io/projected/682e1a15-b52a-443b-bf2f-54a0e3ada196-kube-api-access-vwmgh\") pod \"kube-auth-proxy-6c994f5cd9-fzvrg\" (UID: \"682e1a15-b52a-443b-bf2f-54a0e3ada196\") " pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" Jul 24 00:19:20.338705 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.338540 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/682e1a15-b52a-443b-bf2f-54a0e3ada196-tls-certs\") pod \"kube-auth-proxy-6c994f5cd9-fzvrg\" (UID: \"682e1a15-b52a-443b-bf2f-54a0e3ada196\") " pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" Jul 24 00:19:20.338705 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.338574 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/682e1a15-b52a-443b-bf2f-54a0e3ada196-tmp\") pod \"kube-auth-proxy-6c994f5cd9-fzvrg\" (UID: \"682e1a15-b52a-443b-bf2f-54a0e3ada196\") " pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" Jul 24 00:19:20.341246 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.341221 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/682e1a15-b52a-443b-bf2f-54a0e3ada196-tmp\") pod \"kube-auth-proxy-6c994f5cd9-fzvrg\" (UID: \"682e1a15-b52a-443b-bf2f-54a0e3ada196\") " pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" Jul 24 00:19:20.341665 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.341644 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/682e1a15-b52a-443b-bf2f-54a0e3ada196-tls-certs\") pod \"kube-auth-proxy-6c994f5cd9-fzvrg\" (UID: \"682e1a15-b52a-443b-bf2f-54a0e3ada196\") " pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" Jul 24 00:19:20.348272 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.348247 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwmgh\" (UniqueName: \"kubernetes.io/projected/682e1a15-b52a-443b-bf2f-54a0e3ada196-kube-api-access-vwmgh\") pod \"kube-auth-proxy-6c994f5cd9-fzvrg\" (UID: \"682e1a15-b52a-443b-bf2f-54a0e3ada196\") " pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" Jul 24 00:19:20.487432 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.487403 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" Jul 24 00:19:20.682512 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:20.682416 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg"] Jul 24 00:19:20.686506 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:19:20.686473 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682e1a15_b52a_443b_bf2f_54a0e3ada196.slice/crio-a2e2d54c08dc8b6c771eb23a2c711c5b94b9070698d8426f543709f6fe46c278 WatchSource:0}: Error finding container a2e2d54c08dc8b6c771eb23a2c711c5b94b9070698d8426f543709f6fe46c278: Status 404 returned error can't find the container with id a2e2d54c08dc8b6c771eb23a2c711c5b94b9070698d8426f543709f6fe46c278 Jul 24 00:19:21.070344 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:21.070305 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" event={"ID":"682e1a15-b52a-443b-bf2f-54a0e3ada196","Type":"ContainerStarted","Data":"a2e2d54c08dc8b6c771eb23a2c711c5b94b9070698d8426f543709f6fe46c278"} Jul 24 00:19:21.878241 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:21.878205 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:21.979726 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:21.979694 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:22.856992 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:22.856954 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:23.082826 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:23.082787 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" event={"ID":"0e0bacb1-56f8-4038-96c0-b3f7aac5e500","Type":"ContainerStarted","Data":"21f34790191c83f0603d43902b7a0bc9e43b00fed71df23655f6597d296faa88"} Jul 24 00:19:23.083296 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:23.082922 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:19:23.146189 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:23.146095 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" podStartSLOduration=1.667188868 podStartE2EDuration="4.14606231s" totalImagesPullingTime="2.478873442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:19:23.144443769 +0000 UTC m=+324.148003116" watchObservedRunningTime="2026-07-24 00:19:23.14606231 +0000 UTC m=+324.149621657" Jul 24 00:19:24.088613 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:24.088575 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" event={"ID":"682e1a15-b52a-443b-bf2f-54a0e3ada196","Type":"ContainerStarted","Data":"a9490c834d93f7e880ca4c903471c93f3dd4cd79f037a6651632b6daf3654d31"} Jul 24 00:19:24.110675 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:24.110624 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c994f5cd9-fzvrg" podStartSLOduration=1.163502608 podStartE2EDuration="4.11060497s" totalImagesPullingTime="2.947102362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:19:24.109205743 +0000 UTC m=+325.112765104" watchObservedRunningTime="2026-07-24 00:19:24.11060497 +0000 UTC m=+325.114164316" Jul 24 00:19:24.894912 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:24.894870 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:25.032365 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:25.032333 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:25.141378 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:25.141338 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:25.223057 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:25.222969 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:26.173469 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:26.173436 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:26.274865 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:26.274839 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:26.375023 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:26.374982 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:29.773344 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:29.773312 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:30.387636 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:30.387603 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:30.502631 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:30.502604 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:30.815926 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:30.815845 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:30.992556 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:30.992529 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:31.094150 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:31.094126 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:19:34.091030 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:19:34.091001 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b84c6bc85-7x8nh" Jul 24 00:20:15.617470 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:15.617389 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:15.714148 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:15.714112 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:15.815305 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:15.815273 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:16.536183 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:16.536154 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:16.746840 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:16.746807 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:41.763351 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:41.763314 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:45.213684 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:45.213652 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:46.747904 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:46.747867 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:47.157914 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:47.157884 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:48.231202 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:48.231169 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:49.759272 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:49.759238 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:49.854281 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:49.854248 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:51.824453 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:51.820257 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:51.919450 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:51.919418 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:52.017346 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:52.017312 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:53.740413 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:53.740375 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:53.836393 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:53.836360 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:55.552761 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:55.552731 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:55.739791 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:55.739758 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:56.638782 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.638752 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb"] Jul 24 00:20:56.642034 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.642019 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" Jul 24 00:20:56.644318 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.644301 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 00:20:56.644421 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.644334 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 24 00:20:56.644509 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.644493 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sbjbq\"" Jul 24 00:20:56.645222 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.645210 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 24 00:20:56.645299 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.645285 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 00:20:56.651051 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.651034 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb"] Jul 24 00:20:56.651435 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.651392 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:56.748679 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.748647 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:20:56.817900 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.817872 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/273a0188-f338-4eae-9d8d-7f6764169005-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-g86sb\" (UID: \"273a0188-f338-4eae-9d8d-7f6764169005\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" Jul 24 00:20:56.818051 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.817913 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/273a0188-f338-4eae-9d8d-7f6764169005-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-g86sb\" (UID: \"273a0188-f338-4eae-9d8d-7f6764169005\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" Jul 24 00:20:56.818051 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.817984 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pljtt\" (UniqueName: \"kubernetes.io/projected/273a0188-f338-4eae-9d8d-7f6764169005-kube-api-access-pljtt\") pod \"kuadrant-console-plugin-66b5774985-g86sb\" (UID: \"273a0188-f338-4eae-9d8d-7f6764169005\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" Jul 24 00:20:56.919315 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.919235 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/273a0188-f338-4eae-9d8d-7f6764169005-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-g86sb\" (UID: \"273a0188-f338-4eae-9d8d-7f6764169005\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" Jul 24 00:20:56.919315 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.919277 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/273a0188-f338-4eae-9d8d-7f6764169005-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-g86sb\" (UID: \"273a0188-f338-4eae-9d8d-7f6764169005\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" Jul 24 00:20:56.919315 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.919309 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pljtt\" (UniqueName: \"kubernetes.io/projected/273a0188-f338-4eae-9d8d-7f6764169005-kube-api-access-pljtt\") pod \"kuadrant-console-plugin-66b5774985-g86sb\" (UID: \"273a0188-f338-4eae-9d8d-7f6764169005\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" Jul 24 00:20:56.920043 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.920020 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/273a0188-f338-4eae-9d8d-7f6764169005-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-g86sb\" (UID: \"273a0188-f338-4eae-9d8d-7f6764169005\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" Jul 24 00:20:56.921678 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.921655 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/273a0188-f338-4eae-9d8d-7f6764169005-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-g86sb\" (UID: \"273a0188-f338-4eae-9d8d-7f6764169005\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" Jul 24 00:20:56.926974 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.926952 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pljtt\" (UniqueName: \"kubernetes.io/projected/273a0188-f338-4eae-9d8d-7f6764169005-kube-api-access-pljtt\") pod \"kuadrant-console-plugin-66b5774985-g86sb\" (UID: \"273a0188-f338-4eae-9d8d-7f6764169005\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" Jul 24 00:20:56.951465 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:56.951439 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" Jul 24 00:20:57.081538 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:57.081515 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb"] Jul 24 00:20:57.084101 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:20:57.084060 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod273a0188_f338_4eae_9d8d_7f6764169005.slice/crio-91df6c3efb0d532541b1360a60251a79c666d8c6683cafe4a6de484c5a90d1e5 WatchSource:0}: Error finding container 91df6c3efb0d532541b1360a60251a79c666d8c6683cafe4a6de484c5a90d1e5: Status 404 returned error can't find the container with id 91df6c3efb0d532541b1360a60251a79c666d8c6683cafe4a6de484c5a90d1e5 Jul 24 00:20:57.501517 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:20:57.501487 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" event={"ID":"273a0188-f338-4eae-9d8d-7f6764169005","Type":"ContainerStarted","Data":"91df6c3efb0d532541b1360a60251a79c666d8c6683cafe4a6de484c5a90d1e5"} Jul 24 00:21:04.782008 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:04.781966 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:04.881104 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:04.881044 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:07.028818 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.028779 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr"] Jul 24 00:21:07.055289 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.055255 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr"] Jul 24 00:21:07.055460 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.055300 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" Jul 24 00:21:07.058546 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.058522 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5xpbk\"" Jul 24 00:21:07.116240 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.116211 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4tvt\" (UniqueName: \"kubernetes.io/projected/5ed888ce-db78-442b-815d-404b5e684db9-kube-api-access-k4tvt\") pod \"kuadrant-operator-controller-manager-86878c769f-pplfr\" (UID: \"5ed888ce-db78-442b-815d-404b5e684db9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" Jul 24 00:21:07.116404 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.116336 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ed888ce-db78-442b-815d-404b5e684db9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pplfr\" (UID: \"5ed888ce-db78-442b-815d-404b5e684db9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" Jul 24 00:21:07.217198 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.217164 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ed888ce-db78-442b-815d-404b5e684db9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pplfr\" (UID: \"5ed888ce-db78-442b-815d-404b5e684db9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" Jul 24 00:21:07.217198 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.217212 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4tvt\" (UniqueName: \"kubernetes.io/projected/5ed888ce-db78-442b-815d-404b5e684db9-kube-api-access-k4tvt\") pod \"kuadrant-operator-controller-manager-86878c769f-pplfr\" (UID: \"5ed888ce-db78-442b-815d-404b5e684db9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" Jul 24 00:21:07.217639 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.217621 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ed888ce-db78-442b-815d-404b5e684db9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pplfr\" (UID: \"5ed888ce-db78-442b-815d-404b5e684db9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" Jul 24 00:21:07.222542 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.222515 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:07.226265 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.226228 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4tvt\" (UniqueName: \"kubernetes.io/projected/5ed888ce-db78-442b-815d-404b5e684db9-kube-api-access-k4tvt\") pod \"kuadrant-operator-controller-manager-86878c769f-pplfr\" (UID: \"5ed888ce-db78-442b-815d-404b5e684db9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" Jul 24 00:21:07.322461 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.322429 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:07.368306 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:07.368279 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" Jul 24 00:21:11.977975 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:11.977939 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:12.078229 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:12.078194 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:15.769426 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:15.769393 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:15.849536 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:15.849507 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:18.591545 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:18.591517 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr"] Jul 24 00:21:18.593018 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:21:18.592994 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed888ce_db78_442b_815d_404b5e684db9.slice/crio-47655fa06ce0b80cf4565f0e2950725d3d8cc24bdf61b1ed913744bb4d84b924 WatchSource:0}: Error finding container 47655fa06ce0b80cf4565f0e2950725d3d8cc24bdf61b1ed913744bb4d84b924: Status 404 returned error can't find the container with id 47655fa06ce0b80cf4565f0e2950725d3d8cc24bdf61b1ed913744bb4d84b924 Jul 24 00:21:18.606954 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:18.606924 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" event={"ID":"5ed888ce-db78-442b-815d-404b5e684db9","Type":"ContainerStarted","Data":"47655fa06ce0b80cf4565f0e2950725d3d8cc24bdf61b1ed913744bb4d84b924"} Jul 24 00:21:19.613150 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:19.613114 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" event={"ID":"273a0188-f338-4eae-9d8d-7f6764169005","Type":"ContainerStarted","Data":"d63f785e31b87b2c2af3c643f513479dd26e23bd1c2cfb380bb1fda6c1e5480f"} Jul 24 00:21:19.633586 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:19.633535 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-g86sb" podStartSLOduration=2.182529565 podStartE2EDuration="23.633521284s" totalImagesPullingTime="21.450991719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:21:19.632578238 +0000 UTC m=+440.636137589" watchObservedRunningTime="2026-07-24 00:21:19.633521284 +0000 UTC m=+440.637080631" Jul 24 00:21:24.384237 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:24.384156 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:24.484245 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:24.484207 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:26.648750 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:26.648719 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" event={"ID":"5ed888ce-db78-442b-815d-404b5e684db9","Type":"ContainerStarted","Data":"36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6"} Jul 24 00:21:26.649193 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:26.648828 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" Jul 24 00:21:26.669808 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:26.669758 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" podStartSLOduration=12.413006753 podStartE2EDuration="19.669742671s" totalImagesPullingTime="7.256735918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:21:26.667904036 +0000 UTC m=+447.671463408" watchObservedRunningTime="2026-07-24 00:21:26.669742671 +0000 UTC m=+447.673302019" Jul 24 00:21:26.835618 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:26.835582 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:26.936286 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:26.936212 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:31.603490 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:31.603455 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:31.702182 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:31.702153 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:35.785257 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:35.785215 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:35.849299 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:35.849266 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:37.655610 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:37.655580 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" Jul 24 00:21:44.802742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:44.802699 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:44.903071 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:44.903040 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:47.241942 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:47.241906 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:47.341783 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:47.341749 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:51.359027 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:51.358992 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:51.458687 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:51.458659 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:51.996306 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:51.996277 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:52.103722 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:52.103686 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:54.128404 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:54.128370 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:54.616911 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:54.616878 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:56.379706 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:56.379661 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:56.477167 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:56.477135 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:56.577763 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:56.577733 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:57.188806 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:57.188767 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zpdpg"] Jul 24 00:21:57.204597 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:57.204567 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zpdpg"] Jul 24 00:21:57.204761 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:57.204612 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zpdpg" Jul 24 00:21:57.207021 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:57.207002 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8vf4k\"" Jul 24 00:21:57.225953 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:57.225926 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:57.263495 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:57.263465 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2tzh\" (UniqueName: \"kubernetes.io/projected/dbb780a4-a539-481d-b08c-4bb45c38bd75-kube-api-access-f2tzh\") pod \"authorino-58cd955675-zpdpg\" (UID: \"dbb780a4-a539-481d-b08c-4bb45c38bd75\") " pod="kuadrant-system/authorino-58cd955675-zpdpg" Jul 24 00:21:57.283668 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:57.283637 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:21:57.364377 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:57.364346 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2tzh\" (UniqueName: \"kubernetes.io/projected/dbb780a4-a539-481d-b08c-4bb45c38bd75-kube-api-access-f2tzh\") pod \"authorino-58cd955675-zpdpg\" (UID: \"dbb780a4-a539-481d-b08c-4bb45c38bd75\") " pod="kuadrant-system/authorino-58cd955675-zpdpg" Jul 24 00:21:57.372178 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:57.372146 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2tzh\" (UniqueName: \"kubernetes.io/projected/dbb780a4-a539-481d-b08c-4bb45c38bd75-kube-api-access-f2tzh\") pod \"authorino-58cd955675-zpdpg\" (UID: \"dbb780a4-a539-481d-b08c-4bb45c38bd75\") " pod="kuadrant-system/authorino-58cd955675-zpdpg" Jul 24 00:21:57.514113 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:57.514011 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zpdpg" Jul 24 00:21:57.662909 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:57.662883 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zpdpg"] Jul 24 00:21:57.665778 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:21:57.665755 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbb780a4_a539_481d_b08c_4bb45c38bd75.slice/crio-9e1a9409ff9bef074c564c0ffae89326bf7e5c583c5b31635aa269c668047668 WatchSource:0}: Error finding container 9e1a9409ff9bef074c564c0ffae89326bf7e5c583c5b31635aa269c668047668: Status 404 returned error can't find the container with id 9e1a9409ff9bef074c564c0ffae89326bf7e5c583c5b31635aa269c668047668 Jul 24 00:21:57.790112 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:21:57.789995 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zpdpg" event={"ID":"dbb780a4-a539-481d-b08c-4bb45c38bd75","Type":"ContainerStarted","Data":"9e1a9409ff9bef074c564c0ffae89326bf7e5c583c5b31635aa269c668047668"} Jul 24 00:22:01.251518 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:01.251437 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:01.815231 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:01.815191 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zpdpg" event={"ID":"dbb780a4-a539-481d-b08c-4bb45c38bd75","Type":"ContainerStarted","Data":"2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc"} Jul 24 00:22:01.831163 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:01.831100 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zpdpg" podStartSLOduration=1.536005151 podStartE2EDuration="4.831065593s" totalImagesPullingTime="3.295060442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:22:01.830579956 +0000 UTC m=+482.834139304" watchObservedRunningTime="2026-07-24 00:22:01.831065593 +0000 UTC m=+482.834624943" Jul 24 00:22:02.021141 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:02.021109 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zpdpg"] Jul 24 00:22:03.823784 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:03.823740 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zpdpg" podUID="dbb780a4-a539-481d-b08c-4bb45c38bd75" containerName="authorino" containerID="cri-o://2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc" gracePeriod=30 Jul 24 00:22:04.068935 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.068908 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zpdpg" Jul 24 00:22:04.122345 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.122262 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2tzh\" (UniqueName: \"kubernetes.io/projected/dbb780a4-a539-481d-b08c-4bb45c38bd75-kube-api-access-f2tzh\") pod \"dbb780a4-a539-481d-b08c-4bb45c38bd75\" (UID: \"dbb780a4-a539-481d-b08c-4bb45c38bd75\") " Jul 24 00:22:04.124442 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.124413 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb780a4-a539-481d-b08c-4bb45c38bd75-kube-api-access-f2tzh" (OuterVolumeSpecName: "kube-api-access-f2tzh") pod "dbb780a4-a539-481d-b08c-4bb45c38bd75" (UID: "dbb780a4-a539-481d-b08c-4bb45c38bd75"). InnerVolumeSpecName "kube-api-access-f2tzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 00:22:04.223367 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.223330 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2tzh\" (UniqueName: \"kubernetes.io/projected/dbb780a4-a539-481d-b08c-4bb45c38bd75-kube-api-access-f2tzh\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:22:04.829120 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.829060 2588 generic.go:356] "Generic (PLEG): container finished" podID="dbb780a4-a539-481d-b08c-4bb45c38bd75" containerID="2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc" exitCode=0 Jul 24 00:22:04.829120 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.829109 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zpdpg" Jul 24 00:22:04.829120 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.829117 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zpdpg" event={"ID":"dbb780a4-a539-481d-b08c-4bb45c38bd75","Type":"ContainerDied","Data":"2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc"} Jul 24 00:22:04.829697 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.829163 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zpdpg" event={"ID":"dbb780a4-a539-481d-b08c-4bb45c38bd75","Type":"ContainerDied","Data":"9e1a9409ff9bef074c564c0ffae89326bf7e5c583c5b31635aa269c668047668"} Jul 24 00:22:04.829697 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.829181 2588 scope.go:117] "RemoveContainer" containerID="2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc" Jul 24 00:22:04.839022 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.839006 2588 scope.go:117] "RemoveContainer" containerID="2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc" Jul 24 00:22:04.839290 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:22:04.839273 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc\": container with ID starting with 2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc not found: ID does not exist" containerID="2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc" Jul 24 00:22:04.839368 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.839303 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc"} err="failed to get container status \"2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc\": rpc error: code = NotFound desc = could not find container \"2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc\": container with ID starting with 2eee33995a04da5cc3d086ec0bf560b5014f87e88f58b45e6468435ac6e21cfc not found: ID does not exist" Jul 24 00:22:04.852281 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.852259 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zpdpg"] Jul 24 00:22:04.855800 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:04.855781 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zpdpg"] Jul 24 00:22:05.477393 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:05.477363 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbb780a4-a539-481d-b08c-4bb45c38bd75" path="/var/lib/kubelet/pods/dbb780a4-a539-481d-b08c-4bb45c38bd75/volumes" Jul 24 00:22:12.605541 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:12.605509 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:12.717035 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:12.716998 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:13.068468 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:13.068388 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:25.448905 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:25.448857 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:25.626261 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:25.626232 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:33.077483 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.077452 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:33.081715 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.081691 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5865bd5784-5m64j"] Jul 24 00:22:33.082040 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.082028 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb780a4-a539-481d-b08c-4bb45c38bd75" containerName="authorino" Jul 24 00:22:33.082110 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.082041 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb780a4-a539-481d-b08c-4bb45c38bd75" containerName="authorino" Jul 24 00:22:33.082153 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.082147 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb780a4-a539-481d-b08c-4bb45c38bd75" containerName="authorino" Jul 24 00:22:33.085295 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.085276 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5865bd5784-5m64j" Jul 24 00:22:33.088129 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.088108 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 24 00:22:33.088339 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.088323 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n6cg2\"" Jul 24 00:22:33.088716 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.088702 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 24 00:22:33.095413 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.095395 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5865bd5784-5m64j"] Jul 24 00:22:33.171305 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.171279 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:33.183793 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.183763 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwscg\" (UniqueName: \"kubernetes.io/projected/d9ae0379-5a81-47cd-84c2-52bc94437f22-kube-api-access-xwscg\") pod \"maas-controller-5865bd5784-5m64j\" (UID: \"d9ae0379-5a81-47cd-84c2-52bc94437f22\") " pod="opendatahub/maas-controller-5865bd5784-5m64j" Jul 24 00:22:33.183923 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.183832 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9ae0379-5a81-47cd-84c2-52bc94437f22-webhook-cert\") pod \"maas-controller-5865bd5784-5m64j\" (UID: \"d9ae0379-5a81-47cd-84c2-52bc94437f22\") " pod="opendatahub/maas-controller-5865bd5784-5m64j" Jul 24 00:22:33.254213 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.254183 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:33.284354 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.284324 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwscg\" (UniqueName: \"kubernetes.io/projected/d9ae0379-5a81-47cd-84c2-52bc94437f22-kube-api-access-xwscg\") pod \"maas-controller-5865bd5784-5m64j\" (UID: \"d9ae0379-5a81-47cd-84c2-52bc94437f22\") " pod="opendatahub/maas-controller-5865bd5784-5m64j" Jul 24 00:22:33.284499 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.284387 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9ae0379-5a81-47cd-84c2-52bc94437f22-webhook-cert\") pod \"maas-controller-5865bd5784-5m64j\" (UID: \"d9ae0379-5a81-47cd-84c2-52bc94437f22\") " pod="opendatahub/maas-controller-5865bd5784-5m64j" Jul 24 00:22:33.286745 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.286726 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9ae0379-5a81-47cd-84c2-52bc94437f22-webhook-cert\") pod \"maas-controller-5865bd5784-5m64j\" (UID: \"d9ae0379-5a81-47cd-84c2-52bc94437f22\") " pod="opendatahub/maas-controller-5865bd5784-5m64j" Jul 24 00:22:33.292172 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.292151 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwscg\" (UniqueName: \"kubernetes.io/projected/d9ae0379-5a81-47cd-84c2-52bc94437f22-kube-api-access-xwscg\") pod \"maas-controller-5865bd5784-5m64j\" (UID: \"d9ae0379-5a81-47cd-84c2-52bc94437f22\") " pod="opendatahub/maas-controller-5865bd5784-5m64j" Jul 24 00:22:33.321655 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.321622 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:33.395728 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.395652 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5865bd5784-5m64j" Jul 24 00:22:33.526157 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.526130 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5865bd5784-5m64j"] Jul 24 00:22:33.528778 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:22:33.528742 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ae0379_5a81_47cd_84c2_52bc94437f22.slice/crio-921b9b12b33bdeefc361dbd25566f1f6d68d74b6a8111f573e253ecdfcbd0f5e WatchSource:0}: Error finding container 921b9b12b33bdeefc361dbd25566f1f6d68d74b6a8111f573e253ecdfcbd0f5e: Status 404 returned error can't find the container with id 921b9b12b33bdeefc361dbd25566f1f6d68d74b6a8111f573e253ecdfcbd0f5e Jul 24 00:22:33.968352 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:33.968322 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5865bd5784-5m64j" event={"ID":"d9ae0379-5a81-47cd-84c2-52bc94437f22","Type":"ContainerStarted","Data":"921b9b12b33bdeefc361dbd25566f1f6d68d74b6a8111f573e253ecdfcbd0f5e"} Jul 24 00:22:36.193020 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:36.192988 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:36.293227 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:36.293198 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:36.983996 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:36.983957 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5865bd5784-5m64j" event={"ID":"d9ae0379-5a81-47cd-84c2-52bc94437f22","Type":"ContainerStarted","Data":"24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e"} Jul 24 00:22:36.984215 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:36.984100 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5865bd5784-5m64j" Jul 24 00:22:37.004320 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:37.004256 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5865bd5784-5m64j" podStartSLOduration=1.456600206 podStartE2EDuration="4.004238283s" totalImagesPullingTime="2.547638077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:22:37.003608108 +0000 UTC m=+518.007167456" watchObservedRunningTime="2026-07-24 00:22:37.004238283 +0000 UTC m=+518.007797634" Jul 24 00:22:44.497239 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:44.497204 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:44.598041 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:44.598009 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:22:47.199533 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:47.199497 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5865bd5784-5m64j"] Jul 24 00:22:47.200107 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:47.199702 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5865bd5784-5m64j" podUID="d9ae0379-5a81-47cd-84c2-52bc94437f22" containerName="manager" containerID="cri-o://24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e" gracePeriod=30 Jul 24 00:22:47.201678 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:47.201647 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5865bd5784-5m64j" Jul 24 00:22:47.447562 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:47.447532 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5865bd5784-5m64j" Jul 24 00:22:47.509398 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:47.509322 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9ae0379-5a81-47cd-84c2-52bc94437f22-webhook-cert\") pod \"d9ae0379-5a81-47cd-84c2-52bc94437f22\" (UID: \"d9ae0379-5a81-47cd-84c2-52bc94437f22\") " Jul 24 00:22:47.509537 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:47.509419 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwscg\" (UniqueName: \"kubernetes.io/projected/d9ae0379-5a81-47cd-84c2-52bc94437f22-kube-api-access-xwscg\") pod \"d9ae0379-5a81-47cd-84c2-52bc94437f22\" (UID: \"d9ae0379-5a81-47cd-84c2-52bc94437f22\") " Jul 24 00:22:47.511489 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:47.511461 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9ae0379-5a81-47cd-84c2-52bc94437f22-kube-api-access-xwscg" (OuterVolumeSpecName: "kube-api-access-xwscg") pod "d9ae0379-5a81-47cd-84c2-52bc94437f22" (UID: "d9ae0379-5a81-47cd-84c2-52bc94437f22"). InnerVolumeSpecName "kube-api-access-xwscg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 00:22:47.511489 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:47.511479 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ae0379-5a81-47cd-84c2-52bc94437f22-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d9ae0379-5a81-47cd-84c2-52bc94437f22" (UID: "d9ae0379-5a81-47cd-84c2-52bc94437f22"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 00:22:47.610430 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:47.610396 2588 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9ae0379-5a81-47cd-84c2-52bc94437f22-webhook-cert\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:22:47.610430 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:47.610424 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwscg\" (UniqueName: \"kubernetes.io/projected/d9ae0379-5a81-47cd-84c2-52bc94437f22-kube-api-access-xwscg\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:22:48.037426 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:48.037391 2588 generic.go:356] "Generic (PLEG): container finished" podID="d9ae0379-5a81-47cd-84c2-52bc94437f22" containerID="24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e" exitCode=0 Jul 24 00:22:48.037608 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:48.037433 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5865bd5784-5m64j" Jul 24 00:22:48.037608 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:48.037473 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5865bd5784-5m64j" event={"ID":"d9ae0379-5a81-47cd-84c2-52bc94437f22","Type":"ContainerDied","Data":"24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e"} Jul 24 00:22:48.037608 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:48.037522 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5865bd5784-5m64j" event={"ID":"d9ae0379-5a81-47cd-84c2-52bc94437f22","Type":"ContainerDied","Data":"921b9b12b33bdeefc361dbd25566f1f6d68d74b6a8111f573e253ecdfcbd0f5e"} Jul 24 00:22:48.037608 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:48.037545 2588 scope.go:117] "RemoveContainer" containerID="24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e" Jul 24 00:22:48.046723 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:48.046708 2588 scope.go:117] "RemoveContainer" containerID="24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e" Jul 24 00:22:48.046988 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:22:48.046967 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e\": container with ID starting with 24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e not found: ID does not exist" containerID="24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e" Jul 24 00:22:48.047054 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:48.046997 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e"} err="failed to get container status \"24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e\": rpc error: code = NotFound desc = could not find container \"24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e\": container with ID starting with 24d770395c64b650e8cae712c748fce4f0e4e4d593b98f6c0d429dfa7937bf9e not found: ID does not exist" Jul 24 00:22:48.058873 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:48.058848 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5865bd5784-5m64j"] Jul 24 00:22:48.060913 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:48.060888 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5865bd5784-5m64j"] Jul 24 00:22:49.477031 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:22:49.476997 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9ae0379-5a81-47cd-84c2-52bc94437f22" path="/var/lib/kubelet/pods/d9ae0379-5a81-47cd-84c2-52bc94437f22/volumes" Jul 24 00:23:06.858540 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:06.858508 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:06.956284 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:06.956243 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:07.572177 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:07.572147 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:08.054237 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.054160 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:08.157018 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.156988 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn"] Jul 24 00:23:08.157392 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.157378 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ae0379-5a81-47cd-84c2-52bc94437f22" containerName="manager" Jul 24 00:23:08.157437 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.157394 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ae0379-5a81-47cd-84c2-52bc94437f22" containerName="manager" Jul 24 00:23:08.157471 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.157467 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ae0379-5a81-47cd-84c2-52bc94437f22" containerName="manager" Jul 24 00:23:08.165707 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.165684 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" Jul 24 00:23:08.169971 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.169948 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 24 00:23:08.171947 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.171924 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn"] Jul 24 00:23:08.172322 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.172306 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-llzxl\"" Jul 24 00:23:08.287257 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.287224 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:08.290501 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.290469 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66d99f9c-2622-44c8-91e2-9f764c43ed1c-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-78hzn\" (UID: \"66d99f9c-2622-44c8-91e2-9f764c43ed1c\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" Jul 24 00:23:08.290644 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.290524 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8xd5\" (UniqueName: \"kubernetes.io/projected/66d99f9c-2622-44c8-91e2-9f764c43ed1c-kube-api-access-f8xd5\") pod \"payload-pre-processing-687dbb6cf6-78hzn\" (UID: \"66d99f9c-2622-44c8-91e2-9f764c43ed1c\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" Jul 24 00:23:08.387161 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.387131 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:08.391518 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.391498 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66d99f9c-2622-44c8-91e2-9f764c43ed1c-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-78hzn\" (UID: \"66d99f9c-2622-44c8-91e2-9f764c43ed1c\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" Jul 24 00:23:08.391603 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.391538 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8xd5\" (UniqueName: \"kubernetes.io/projected/66d99f9c-2622-44c8-91e2-9f764c43ed1c-kube-api-access-f8xd5\") pod \"payload-pre-processing-687dbb6cf6-78hzn\" (UID: \"66d99f9c-2622-44c8-91e2-9f764c43ed1c\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" Jul 24 00:23:08.392218 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.392201 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66d99f9c-2622-44c8-91e2-9f764c43ed1c-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-78hzn\" (UID: \"66d99f9c-2622-44c8-91e2-9f764c43ed1c\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" Jul 24 00:23:08.399544 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.399521 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8xd5\" (UniqueName: \"kubernetes.io/projected/66d99f9c-2622-44c8-91e2-9f764c43ed1c-kube-api-access-f8xd5\") pod \"payload-pre-processing-687dbb6cf6-78hzn\" (UID: \"66d99f9c-2622-44c8-91e2-9f764c43ed1c\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" Jul 24 00:23:08.478940 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.478905 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" Jul 24 00:23:08.605893 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:08.605866 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn"] Jul 24 00:23:08.608598 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:23:08.608570 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d99f9c_2622_44c8_91e2_9f764c43ed1c.slice/crio-8a2c8a798951a28dc531ce15bbc37f7bc5f368771f83bd8572c40f3abdb552f0 WatchSource:0}: Error finding container 8a2c8a798951a28dc531ce15bbc37f7bc5f368771f83bd8572c40f3abdb552f0: Status 404 returned error can't find the container with id 8a2c8a798951a28dc531ce15bbc37f7bc5f368771f83bd8572c40f3abdb552f0 Jul 24 00:23:09.138944 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:09.138909 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" event={"ID":"66d99f9c-2622-44c8-91e2-9f764c43ed1c","Type":"ContainerStarted","Data":"8a2c8a798951a28dc531ce15bbc37f7bc5f368771f83bd8572c40f3abdb552f0"} Jul 24 00:23:11.151855 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:11.151818 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" event={"ID":"66d99f9c-2622-44c8-91e2-9f764c43ed1c","Type":"ContainerStarted","Data":"45024040894ee29bb935680ac23c7b5a0bea23729c04d87ac285cae2afa24cd6"} Jul 24 00:23:11.152290 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:11.151891 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" Jul 24 00:23:11.171025 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:11.170972 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" podStartSLOduration=1.576407342 podStartE2EDuration="3.170955815s" totalImagesPullingTime="1.594548473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:23:11.169131096 +0000 UTC m=+552.172690444" watchObservedRunningTime="2026-07-24 00:23:11.170955815 +0000 UTC m=+552.174515161" Jul 24 00:23:19.351591 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:19.351558 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:19.448156 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:19.448126 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:22.159549 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:22.159520 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-78hzn" Jul 24 00:23:31.886697 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:31.886662 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8"] Jul 24 00:23:31.889926 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:31.889909 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:31.893115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:31.893091 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bk7h5\"" Jul 24 00:23:31.893996 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:31.893976 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 00:23:31.894102 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:31.893975 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 24 00:23:31.894102 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:31.894021 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 00:23:31.908629 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:31.908603 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8"] Jul 24 00:23:31.940092 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:31.940059 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:32.008937 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.008907 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2987c00-28b1-401f-ab90-d58c58f8c60f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.009114 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.009013 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2987c00-28b1-401f-ab90-d58c58f8c60f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.009114 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.009043 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2987c00-28b1-401f-ab90-d58c58f8c60f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.009114 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.009062 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2987c00-28b1-401f-ab90-d58c58f8c60f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.009114 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.009091 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtv79\" (UniqueName: \"kubernetes.io/projected/b2987c00-28b1-401f-ab90-d58c58f8c60f-kube-api-access-rtv79\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.009262 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.009160 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2987c00-28b1-401f-ab90-d58c58f8c60f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.110491 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.110449 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2987c00-28b1-401f-ab90-d58c58f8c60f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.110662 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.110572 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2987c00-28b1-401f-ab90-d58c58f8c60f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.110662 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.110604 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2987c00-28b1-401f-ab90-d58c58f8c60f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.110662 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.110625 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2987c00-28b1-401f-ab90-d58c58f8c60f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.110662 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.110646 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtv79\" (UniqueName: \"kubernetes.io/projected/b2987c00-28b1-401f-ab90-d58c58f8c60f-kube-api-access-rtv79\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.110836 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.110697 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2987c00-28b1-401f-ab90-d58c58f8c60f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.110959 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.110937 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2987c00-28b1-401f-ab90-d58c58f8c60f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.111052 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.110967 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2987c00-28b1-401f-ab90-d58c58f8c60f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.111052 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.111040 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2987c00-28b1-401f-ab90-d58c58f8c60f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.112975 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.112949 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2987c00-28b1-401f-ab90-d58c58f8c60f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.113192 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.113172 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2987c00-28b1-401f-ab90-d58c58f8c60f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.120033 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.120009 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtv79\" (UniqueName: \"kubernetes.io/projected/b2987c00-28b1-401f-ab90-d58c58f8c60f-kube-api-access-rtv79\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8\" (UID: \"b2987c00-28b1-401f-ab90-d58c58f8c60f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.200481 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.200389 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:32.332752 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:32.332690 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8"] Jul 24 00:23:32.335564 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:23:32.335533 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2987c00_28b1_401f_ab90_d58c58f8c60f.slice/crio-91baef689143f9dab0a7a935fc667c05d728f1646d79ebd6e618aef73738e3f3 WatchSource:0}: Error finding container 91baef689143f9dab0a7a935fc667c05d728f1646d79ebd6e618aef73738e3f3: Status 404 returned error can't find the container with id 91baef689143f9dab0a7a935fc667c05d728f1646d79ebd6e618aef73738e3f3 Jul 24 00:23:33.254304 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:33.254268 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" event={"ID":"b2987c00-28b1-401f-ab90-d58c58f8c60f","Type":"ContainerStarted","Data":"91baef689143f9dab0a7a935fc667c05d728f1646d79ebd6e618aef73738e3f3"} Jul 24 00:23:34.260534 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:34.260497 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" event={"ID":"b2987c00-28b1-401f-ab90-d58c58f8c60f","Type":"ContainerStarted","Data":"b563fad9b858341b38be28dfb41d6c6721576fdc252f66e9389306edc6bd0aec"} Jul 24 00:23:34.280281 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:34.280231 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" podStartSLOduration=2.271398266 podStartE2EDuration="3.280213671s" totalImagesPullingTime="1.008815405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:23:34.277868352 +0000 UTC m=+575.281427698" watchObservedRunningTime="2026-07-24 00:23:34.280213671 +0000 UTC m=+575.283773017" Jul 24 00:23:38.524733 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:38.524684 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:38.910909 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:38.910873 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:42.200636 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:42.200603 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:42.201029 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:42.200655 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:42.213340 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:42.213315 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:42.309766 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:42.309726 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8" Jul 24 00:23:51.692490 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:51.692443 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:58.985859 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:58.985829 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz"] Jul 24 00:23:58.989419 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:58.989399 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:58.992016 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:58.991992 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 24 00:23:58.997987 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:58.997957 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz"] Jul 24 00:23:59.025033 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.025009 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:23:59.059984 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.059954 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c01f868-ec0a-4d55-8966-fa39b98e2de4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.060151 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.060031 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c01f868-ec0a-4d55-8966-fa39b98e2de4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.060151 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.060060 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6wgv\" (UniqueName: \"kubernetes.io/projected/5c01f868-ec0a-4d55-8966-fa39b98e2de4-kube-api-access-g6wgv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.060257 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.060179 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c01f868-ec0a-4d55-8966-fa39b98e2de4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.060257 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.060224 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c01f868-ec0a-4d55-8966-fa39b98e2de4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.060257 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.060249 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c01f868-ec0a-4d55-8966-fa39b98e2de4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.161394 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.161354 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c01f868-ec0a-4d55-8966-fa39b98e2de4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.161394 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.161402 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c01f868-ec0a-4d55-8966-fa39b98e2de4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.161640 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.161422 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c01f868-ec0a-4d55-8966-fa39b98e2de4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.161640 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.161452 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c01f868-ec0a-4d55-8966-fa39b98e2de4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.161640 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.161474 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c01f868-ec0a-4d55-8966-fa39b98e2de4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.161640 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.161490 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6wgv\" (UniqueName: \"kubernetes.io/projected/5c01f868-ec0a-4d55-8966-fa39b98e2de4-kube-api-access-g6wgv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.161850 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.161822 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c01f868-ec0a-4d55-8966-fa39b98e2de4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.161904 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.161870 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c01f868-ec0a-4d55-8966-fa39b98e2de4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.161960 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.161904 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c01f868-ec0a-4d55-8966-fa39b98e2de4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.163768 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.163748 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c01f868-ec0a-4d55-8966-fa39b98e2de4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.164061 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.164042 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c01f868-ec0a-4d55-8966-fa39b98e2de4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.169274 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.169252 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6wgv\" (UniqueName: \"kubernetes.io/projected/5c01f868-ec0a-4d55-8966-fa39b98e2de4-kube-api-access-g6wgv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz\" (UID: \"5c01f868-ec0a-4d55-8966-fa39b98e2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.301196 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.301113 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:23:59.438854 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:23:59.438830 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz"] Jul 24 00:23:59.440595 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:23:59.440571 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c01f868_ec0a_4d55_8966_fa39b98e2de4.slice/crio-f74b4e1768f2384ca610303ddb6254c581542c539ee8b0e0085903d249c9df13 WatchSource:0}: Error finding container f74b4e1768f2384ca610303ddb6254c581542c539ee8b0e0085903d249c9df13: Status 404 returned error can't find the container with id f74b4e1768f2384ca610303ddb6254c581542c539ee8b0e0085903d249c9df13 Jul 24 00:24:00.389255 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:00.389217 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" event={"ID":"5c01f868-ec0a-4d55-8966-fa39b98e2de4","Type":"ContainerStarted","Data":"26cd163acd5195b32d354adefc64625f4f89c276457baf0b69eac22371216832"} Jul 24 00:24:00.391636 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:00.389308 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" event={"ID":"5c01f868-ec0a-4d55-8966-fa39b98e2de4","Type":"ContainerStarted","Data":"f74b4e1768f2384ca610303ddb6254c581542c539ee8b0e0085903d249c9df13"} Jul 24 00:24:00.408174 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:00.408124 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" podStartSLOduration=2.243618434 podStartE2EDuration="2.408108139s" totalImagesPullingTime="164.489705ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:24:00.407063578 +0000 UTC m=+601.410622937" watchObservedRunningTime="2026-07-24 00:24:00.408108139 +0000 UTC m=+601.411667481" Jul 24 00:24:01.527416 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:01.527374 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:24:01.627956 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:01.627926 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:24:09.302173 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:09.302137 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:24:09.302752 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:09.302199 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:24:09.314732 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:09.314698 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:24:09.441675 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:09.441645 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz" Jul 24 00:24:12.097857 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.097824 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq"] Jul 24 00:24:12.103861 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.103836 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.106587 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.106563 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 24 00:24:12.117004 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.116959 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq"] Jul 24 00:24:12.140828 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.140799 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:24:12.186178 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.186143 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d35ab260-405d-4993-9962-c58c82785b16-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.186364 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.186196 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d35ab260-405d-4993-9962-c58c82785b16-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.186364 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.186263 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjq6q\" (UniqueName: \"kubernetes.io/projected/d35ab260-405d-4993-9962-c58c82785b16-kube-api-access-hjq6q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.186364 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.186308 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d35ab260-405d-4993-9962-c58c82785b16-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.186364 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.186350 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d35ab260-405d-4993-9962-c58c82785b16-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.186513 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.186369 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d35ab260-405d-4993-9962-c58c82785b16-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.287752 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.287714 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d35ab260-405d-4993-9962-c58c82785b16-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.287951 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.287759 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d35ab260-405d-4993-9962-c58c82785b16-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.287951 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.287795 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjq6q\" (UniqueName: \"kubernetes.io/projected/d35ab260-405d-4993-9962-c58c82785b16-kube-api-access-hjq6q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.287951 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.287828 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d35ab260-405d-4993-9962-c58c82785b16-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.287951 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.287849 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d35ab260-405d-4993-9962-c58c82785b16-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.287951 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.287937 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d35ab260-405d-4993-9962-c58c82785b16-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.288298 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.288277 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d35ab260-405d-4993-9962-c58c82785b16-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.288368 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.288345 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d35ab260-405d-4993-9962-c58c82785b16-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.288448 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.288432 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d35ab260-405d-4993-9962-c58c82785b16-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.290110 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.290071 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d35ab260-405d-4993-9962-c58c82785b16-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.290528 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.290506 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d35ab260-405d-4993-9962-c58c82785b16-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.296027 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.296010 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjq6q\" (UniqueName: \"kubernetes.io/projected/d35ab260-405d-4993-9962-c58c82785b16-kube-api-access-hjq6q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zxbjq\" (UID: \"d35ab260-405d-4993-9962-c58c82785b16\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.425273 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.425188 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:12.559859 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:12.559721 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq"] Jul 24 00:24:12.562813 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:24:12.562778 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35ab260_405d_4993_9962_c58c82785b16.slice/crio-b8216317b882d648db55bd5eb18d4e4268a2cf94283698f32288048dd56d9215 WatchSource:0}: Error finding container b8216317b882d648db55bd5eb18d4e4268a2cf94283698f32288048dd56d9215: Status 404 returned error can't find the container with id b8216317b882d648db55bd5eb18d4e4268a2cf94283698f32288048dd56d9215 Jul 24 00:24:13.451995 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:13.451960 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" event={"ID":"d35ab260-405d-4993-9962-c58c82785b16","Type":"ContainerStarted","Data":"ebee3cd40d866b57e5b1e40175fe131963f6050fee1a33148c087e2c5a57226f"} Jul 24 00:24:13.452503 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:13.452008 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" event={"ID":"d35ab260-405d-4993-9962-c58c82785b16","Type":"ContainerStarted","Data":"b8216317b882d648db55bd5eb18d4e4268a2cf94283698f32288048dd56d9215"} Jul 24 00:24:13.474872 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:13.474821 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" podStartSLOduration=1.29673599 podStartE2EDuration="1.474804974s" totalImagesPullingTime="178.068984ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:24:13.472921886 +0000 UTC m=+614.476481246" watchObservedRunningTime="2026-07-24 00:24:13.474804974 +0000 UTC m=+614.478364320" Jul 24 00:24:17.382696 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.382658 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8"] Jul 24 00:24:17.386308 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.386292 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.388695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.388669 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 24 00:24:17.395284 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.395259 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8"] Jul 24 00:24:17.538946 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.538898 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5031836-522b-49be-9d90-48482a590df4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.539168 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.538971 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5031836-522b-49be-9d90-48482a590df4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.539168 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.539025 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5031836-522b-49be-9d90-48482a590df4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.539168 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.539147 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqhzs\" (UniqueName: \"kubernetes.io/projected/c5031836-522b-49be-9d90-48482a590df4-kube-api-access-jqhzs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.539294 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.539190 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5031836-522b-49be-9d90-48482a590df4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.539294 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.539227 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5031836-522b-49be-9d90-48482a590df4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.597439 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.597406 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:24:17.639968 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.639890 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5031836-522b-49be-9d90-48482a590df4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.639968 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.639937 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5031836-522b-49be-9d90-48482a590df4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.639968 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.639970 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5031836-522b-49be-9d90-48482a590df4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.640222 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.640023 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5031836-522b-49be-9d90-48482a590df4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.640222 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.640054 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhzs\" (UniqueName: \"kubernetes.io/projected/c5031836-522b-49be-9d90-48482a590df4-kube-api-access-jqhzs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.640222 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.640108 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5031836-522b-49be-9d90-48482a590df4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.640444 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.640285 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5031836-522b-49be-9d90-48482a590df4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.640497 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.640442 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5031836-522b-49be-9d90-48482a590df4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.640497 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.640479 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5031836-522b-49be-9d90-48482a590df4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.642323 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.642302 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5031836-522b-49be-9d90-48482a590df4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.642575 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.642558 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5031836-522b-49be-9d90-48482a590df4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.650897 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.650875 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqhzs\" (UniqueName: \"kubernetes.io/projected/c5031836-522b-49be-9d90-48482a590df4-kube-api-access-jqhzs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8\" (UID: \"c5031836-522b-49be-9d90-48482a590df4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.697194 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.697157 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:17.831193 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:17.831156 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8"] Jul 24 00:24:17.834737 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:24:17.834710 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5031836_522b_49be_9d90_48482a590df4.slice/crio-e36babfc41ee0149e61a98071df86ebdb1ec2dad08aebcea6fd8b5308f7512ed WatchSource:0}: Error finding container e36babfc41ee0149e61a98071df86ebdb1ec2dad08aebcea6fd8b5308f7512ed: Status 404 returned error can't find the container with id e36babfc41ee0149e61a98071df86ebdb1ec2dad08aebcea6fd8b5308f7512ed Jul 24 00:24:18.478983 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:18.478952 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" event={"ID":"c5031836-522b-49be-9d90-48482a590df4","Type":"ContainerStarted","Data":"033ffd1d0633ca180b8ee2c11577e1878435c0a7746201e556c37e48a02dd4ce"} Jul 24 00:24:18.478983 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:18.478987 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" event={"ID":"c5031836-522b-49be-9d90-48482a590df4","Type":"ContainerStarted","Data":"e36babfc41ee0149e61a98071df86ebdb1ec2dad08aebcea6fd8b5308f7512ed"} Jul 24 00:24:18.495795 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:18.495739 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" podStartSLOduration=1.309971026 podStartE2EDuration="1.495717976s" totalImagesPullingTime="185.74695ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:24:18.494268713 +0000 UTC m=+619.497828062" watchObservedRunningTime="2026-07-24 00:24:18.495717976 +0000 UTC m=+619.499277325" Jul 24 00:24:22.426307 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:22.426209 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:22.426307 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:22.426293 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:22.438771 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:22.438738 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:22.511479 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:22.511451 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zxbjq" Jul 24 00:24:27.697882 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:27.697846 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:27.698342 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:27.697896 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:27.710609 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:27.710585 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:28.539196 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:28.539162 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8" Jul 24 00:24:54.908056 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:54.908014 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:24:55.005454 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:24:55.005426 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:25:20.246824 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:25:20.246791 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:25:20.345695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:25:20.345662 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:25:21.512590 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:25:21.512559 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:25:21.606857 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:25:21.606814 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:26:47.764171 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:26:47.764113 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:26:47.865072 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:26:47.865039 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:27:27.950389 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:27:27.950318 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:27:29.201340 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:27:29.201287 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:27:31.527486 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:27:31.527457 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:27:31.582689 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:27:31.582650 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:28:02.975683 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:28:02.975650 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:28:03.066372 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:28:03.066338 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:28:03.173829 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:28:03.173798 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:28:08.941407 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:28:08.941375 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:28:09.006405 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:28:09.006372 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:28:09.118300 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:28:09.118269 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:28:09.227745 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:28:09.227665 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:28:09.337048 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:28:09.337013 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:28:14.913294 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:28:14.913259 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:28:14.989893 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:28:14.989859 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:28:38.692320 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:28:38.692285 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:29:06.961184 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:29:06.961152 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:29:08.202696 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:29:08.202661 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:32:11.841600 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:11.841502 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr"] Jul 24 00:32:11.842180 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:11.841715 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" podUID="5ed888ce-db78-442b-815d-404b5e684db9" containerName="manager" containerID="cri-o://36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6" gracePeriod=10 Jul 24 00:32:15.092658 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.092628 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" Jul 24 00:32:15.187444 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.187358 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ed888ce-db78-442b-815d-404b5e684db9-extensions-socket-volume\") pod \"5ed888ce-db78-442b-815d-404b5e684db9\" (UID: \"5ed888ce-db78-442b-815d-404b5e684db9\") " Jul 24 00:32:15.187604 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.187447 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4tvt\" (UniqueName: \"kubernetes.io/projected/5ed888ce-db78-442b-815d-404b5e684db9-kube-api-access-k4tvt\") pod \"5ed888ce-db78-442b-815d-404b5e684db9\" (UID: \"5ed888ce-db78-442b-815d-404b5e684db9\") " Jul 24 00:32:15.187799 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.187719 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed888ce-db78-442b-815d-404b5e684db9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5ed888ce-db78-442b-815d-404b5e684db9" (UID: "5ed888ce-db78-442b-815d-404b5e684db9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 00:32:15.189626 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.189605 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed888ce-db78-442b-815d-404b5e684db9-kube-api-access-k4tvt" (OuterVolumeSpecName: "kube-api-access-k4tvt") pod "5ed888ce-db78-442b-815d-404b5e684db9" (UID: "5ed888ce-db78-442b-815d-404b5e684db9"). InnerVolumeSpecName "kube-api-access-k4tvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 00:32:15.288547 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.288518 2588 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ed888ce-db78-442b-815d-404b5e684db9-extensions-socket-volume\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:32:15.288547 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.288543 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4tvt\" (UniqueName: \"kubernetes.io/projected/5ed888ce-db78-442b-815d-404b5e684db9-kube-api-access-k4tvt\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:32:15.806288 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.806196 2588 generic.go:356] "Generic (PLEG): container finished" podID="5ed888ce-db78-442b-815d-404b5e684db9" containerID="36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6" exitCode=0 Jul 24 00:32:15.806288 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.806238 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" Jul 24 00:32:15.806500 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.806281 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" event={"ID":"5ed888ce-db78-442b-815d-404b5e684db9","Type":"ContainerDied","Data":"36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6"} Jul 24 00:32:15.806500 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.806333 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr" event={"ID":"5ed888ce-db78-442b-815d-404b5e684db9","Type":"ContainerDied","Data":"47655fa06ce0b80cf4565f0e2950725d3d8cc24bdf61b1ed913744bb4d84b924"} Jul 24 00:32:15.806500 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.806355 2588 scope.go:117] "RemoveContainer" containerID="36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6" Jul 24 00:32:15.816844 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.816819 2588 scope.go:117] "RemoveContainer" containerID="36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6" Jul 24 00:32:15.817130 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:32:15.817106 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6\": container with ID starting with 36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6 not found: ID does not exist" containerID="36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6" Jul 24 00:32:15.817215 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.817136 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6"} err="failed to get container status \"36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6\": rpc error: code = NotFound desc = could not find container \"36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6\": container with ID starting with 36a9c44986e00521c953d2a3570a7ccf8533fde417a6b7f1f3b963c3d20db3d6 not found: ID does not exist" Jul 24 00:32:15.824218 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.824196 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr"] Jul 24 00:32:15.827626 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:15.827607 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pplfr"] Jul 24 00:32:17.478979 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:32:17.478942 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ed888ce-db78-442b-815d-404b5e684db9" path="/var/lib/kubelet/pods/5ed888ce-db78-442b-815d-404b5e684db9/volumes" Jul 24 00:33:13.042691 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.042659 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5"] Jul 24 00:33:13.043151 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.043074 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed888ce-db78-442b-815d-404b5e684db9" containerName="manager" Jul 24 00:33:13.043151 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.043099 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed888ce-db78-442b-815d-404b5e684db9" containerName="manager" Jul 24 00:33:13.043239 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.043163 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed888ce-db78-442b-815d-404b5e684db9" containerName="manager" Jul 24 00:33:13.047377 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.047361 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" Jul 24 00:33:13.049887 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.049866 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5xpbk\"" Jul 24 00:33:13.057410 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.057389 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5"] Jul 24 00:33:13.139453 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.139419 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f743ce96-d16c-4bc8-b67e-d017e31ae10d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p4hw5\" (UID: \"f743ce96-d16c-4bc8-b67e-d017e31ae10d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" Jul 24 00:33:13.139602 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.139464 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lssz8\" (UniqueName: \"kubernetes.io/projected/f743ce96-d16c-4bc8-b67e-d017e31ae10d-kube-api-access-lssz8\") pod \"kuadrant-operator-controller-manager-86878c769f-p4hw5\" (UID: \"f743ce96-d16c-4bc8-b67e-d017e31ae10d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" Jul 24 00:33:13.240792 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.240751 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f743ce96-d16c-4bc8-b67e-d017e31ae10d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p4hw5\" (UID: \"f743ce96-d16c-4bc8-b67e-d017e31ae10d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" Jul 24 00:33:13.240792 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.240800 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lssz8\" (UniqueName: \"kubernetes.io/projected/f743ce96-d16c-4bc8-b67e-d017e31ae10d-kube-api-access-lssz8\") pod \"kuadrant-operator-controller-manager-86878c769f-p4hw5\" (UID: \"f743ce96-d16c-4bc8-b67e-d017e31ae10d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" Jul 24 00:33:13.241247 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.241227 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f743ce96-d16c-4bc8-b67e-d017e31ae10d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p4hw5\" (UID: \"f743ce96-d16c-4bc8-b67e-d017e31ae10d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" Jul 24 00:33:13.252169 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.252146 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lssz8\" (UniqueName: \"kubernetes.io/projected/f743ce96-d16c-4bc8-b67e-d017e31ae10d-kube-api-access-lssz8\") pod \"kuadrant-operator-controller-manager-86878c769f-p4hw5\" (UID: \"f743ce96-d16c-4bc8-b67e-d017e31ae10d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" Jul 24 00:33:13.358719 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.358689 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" Jul 24 00:33:13.499356 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:13.499328 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5"] Jul 24 00:33:13.502333 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:33:13.502306 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf743ce96_d16c_4bc8_b67e_d017e31ae10d.slice/crio-6d531868bbfda254356caa5980fa1e54d2ea15b4d4bb60bc16ee08e7b957517a WatchSource:0}: Error finding container 6d531868bbfda254356caa5980fa1e54d2ea15b4d4bb60bc16ee08e7b957517a: Status 404 returned error can't find the container with id 6d531868bbfda254356caa5980fa1e54d2ea15b4d4bb60bc16ee08e7b957517a Jul 24 00:33:14.105660 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:14.105624 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" event={"ID":"f743ce96-d16c-4bc8-b67e-d017e31ae10d","Type":"ContainerStarted","Data":"19aca444596d23bd93e20a10c4e5b1f10bc0f9646bf5beabad13e307b4e3002e"} Jul 24 00:33:14.106175 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:14.105685 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" event={"ID":"f743ce96-d16c-4bc8-b67e-d017e31ae10d","Type":"ContainerStarted","Data":"6d531868bbfda254356caa5980fa1e54d2ea15b4d4bb60bc16ee08e7b957517a"} Jul 24 00:33:14.106175 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:14.105739 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" Jul 24 00:33:14.126068 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:14.126019 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" podStartSLOduration=1.126005843 podStartE2EDuration="1.126005843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:33:14.123818781 +0000 UTC m=+1155.127378128" watchObservedRunningTime="2026-07-24 00:33:14.126005843 +0000 UTC m=+1155.129565190" Jul 24 00:33:25.115087 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:25.115058 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4hw5" Jul 24 00:33:33.647347 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:33.647312 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:33:33.731494 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:33:33.731463 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:34:20.244584 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:34:20.244547 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:36:05.060831 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:36:05.060790 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:36:14.923130 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:36:14.923072 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:36:31.381562 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:36:31.381463 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:36:32.807001 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:36:32.806966 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:36:39.873667 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:36:39.873632 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:36:58.777404 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:36:58.777372 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:36:58.878102 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:36:58.878051 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:38:41.947573 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:38:41.947535 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:38:42.014723 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:38:42.014686 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:39:37.284292 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:39:37.284253 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:39:44.629098 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:39:44.629021 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:06.185518 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:06.185478 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:09.520742 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:09.520693 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:09.610685 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:09.610627 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:09.995545 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:09.995509 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:15.609282 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:15.609246 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:15.709338 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:15.709280 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:15.848960 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:15.848915 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:16.199344 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:16.199311 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:16.408542 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:16.408496 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:18.489214 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:18.489180 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:18.601619 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:18.601588 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:18.689402 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:18.689358 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:18.870338 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:18.870301 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:19.200712 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:19.200625 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:19.297961 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:19.297925 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:54.537634 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:54.537531 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:54.634018 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:54.633978 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:54.734350 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:54.734313 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:59.186640 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:59.186585 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:59.346232 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:59.346199 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:59.609772 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:59.609742 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:59.875376 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:59.875278 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:40:59.966882 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:40:59.966849 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:00.091821 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:00.091791 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:00.441235 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:00.441196 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:00.781924 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:00.781845 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:02.813809 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:02.813778 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:03.034586 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:03.034538 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:03.461483 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:03.461452 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:03.561494 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:03.561459 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:03.652937 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:03.652902 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:31.699587 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:31.699548 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:38.308345 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:38.308303 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:38.408822 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:38.408779 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:42.529219 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:42.529185 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:42.997800 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:42.997763 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:43.158326 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:43.158293 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:43.452606 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:43.452575 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:43.694016 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:43.693980 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:43.995102 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:43.995056 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:44.095990 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:44.095963 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:45.947478 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:45.947439 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:46.046637 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:46.046603 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:46.125636 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:46.125586 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:46.391208 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:46.391176 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:46.624157 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:46.624120 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:41:46.719179 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:41:46.719066 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:22.390043 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:22.389947 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:22.489598 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:22.489548 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:22.590303 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:22.590259 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:26.952012 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:26.951972 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:28.226115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:28.226061 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:28.494705 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:28.494624 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:28.746041 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:28.745951 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:29.065503 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:29.065416 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:29.369556 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:29.369523 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:31.213989 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:31.213955 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:31.316221 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:31.316181 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:31.442444 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:31.442409 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:31.952712 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:31.952681 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:32.128663 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:32.128629 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:42:32.221768 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:42:32.221685 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:06.742472 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:06.742426 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:06.843071 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:06.843033 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:06.943169 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:06.943134 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:11.237596 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:11.237540 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:11.391001 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:11.390970 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:11.631810 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:11.631773 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:12.113971 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:12.113930 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:12.213678 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:12.213649 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:12.314303 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:12.314268 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:13.775175 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:13.775114 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:19.419479 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:19.419442 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:19.524351 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:19.524318 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:19.621737 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:19.621700 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:19.721950 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:19.721870 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:20.147052 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:20.146999 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:46.146063 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:46.146022 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:52.211152 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:52.211039 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:52.322695 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:52.322651 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:43:52.416585 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:43:52.416553 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:08.365286 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:08.365251 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:14.204953 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:14.204920 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:14.270044 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:14.270013 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:14.354309 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:14.354271 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:14.454048 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:14.454015 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:24.942037 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:24.942004 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:25.796926 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:25.796879 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:32.150909 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:32.150867 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:32.261861 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:32.261824 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:32.349553 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:32.349521 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:32.450781 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:32.450698 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:33.276467 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:33.276433 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:33.376915 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:33.376880 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:33.477509 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:33.477476 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:35.148177 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:35.148119 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:40.849923 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:40.849878 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:42.094674 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:42.094634 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:47.887477 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:47.887439 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:47.982692 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:47.982656 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:48.142040 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:48.141955 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:48.473581 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:48.473480 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:48.688541 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:48.688491 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:51.661257 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:51.661202 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:51.756899 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:51.756867 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:51.924215 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:51.924116 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:52.256207 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:52.256072 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:52.452708 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:52.452679 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:52.538055 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:52.537944 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:56.202013 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:56.201974 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:56.907700 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:56.907666 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:57.005918 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:57.005886 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:44:57.380770 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:44:57.380738 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:03.084451 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:03.084419 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:03.185300 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:03.185262 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:11.140538 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:11.140508 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:11.228245 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:11.228207 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:13.908664 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:13.908626 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:13.977905 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:13.977859 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:14.035346 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:14.035316 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:18.523801 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:18.523765 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:18.954504 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:18.954467 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:24.581500 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:24.581414 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:24.646370 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:24.646333 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:24.949115 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:24.948991 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:25.107513 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:25.107477 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:25.254250 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:25.254160 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:25.344304 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:25.344267 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:25.463829 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:25.463786 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:31.113917 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:31.113873 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:31.233779 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:31.233750 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:31.315003 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:31.314972 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:31.476656 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:31.476557 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:37.093325 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:37.093281 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:37.157264 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:37.157227 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:44.105482 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:44.105449 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:44.433598 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:44.433497 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:44.547721 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:44.547669 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:47.078677 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:47.078630 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:47.180562 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:47.180520 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:47.342569 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:47.342485 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:47.439745 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:47.439709 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:47.806172 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:47.806089 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:47.903898 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:47.903866 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:51.591780 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:51.591743 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:45:58.870431 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:45:58.870396 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:46:20.346905 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:46:20.346863 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:46:41.773135 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:46:41.773101 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:46:41.839111 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:46:41.839063 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:46:41.907885 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:46:41.907855 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:46:46.282071 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:46:46.282034 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:46:49.683380 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:46:49.683345 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:46:54.766315 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:46:54.766231 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:02.436778 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:02.436738 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:30.924905 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:30.924870 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:31.831918 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:31.831882 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:37.244753 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:37.244717 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:37.346303 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:37.346268 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:37.527337 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:37.527249 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:37.773236 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:37.773201 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:38.870364 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:38.870330 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:38.966409 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:38.966371 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:39.064477 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:39.064441 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:39.851196 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:39.851161 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:39.949723 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:39.949682 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:40.053390 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:40.053356 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:41.514455 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:41.514416 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:47.161699 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:47.161651 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:47.230446 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:47.230406 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:47.860182 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:47.860150 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:54.090815 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:54.090777 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:54.196062 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:54.196018 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:47:54.290776 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:47:54.290735 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:04.867047 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:04.867011 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:05.238706 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:05.238607 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:26.238318 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:26.238235 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:32.472362 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:32.472323 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:32.574675 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:32.574640 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:32.840408 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:32.840374 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:33.169713 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:33.169624 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:33.379629 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:33.379589 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:35.074825 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:35.074782 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:35.134583 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:35.134537 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:36.003678 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:36.003641 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:36.103600 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:36.103562 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:36.222633 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:36.222599 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:36.468888 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:36.468854 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:36.800534 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:36.800408 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:36.904027 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:36.903990 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:40.540491 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:40.540443 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:40.933012 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:40.932976 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:41.130328 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:41.130289 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:41.251481 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:41.251391 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:41.535262 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:41.535159 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:44.059017 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:44.058983 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:44.161920 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:44.161887 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:44.263565 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:44.263529 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:44.398911 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:44.398874 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:44.702918 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:44.702835 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:44.801516 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:44.801479 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:48.567913 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:48.567880 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:48:55.125336 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:48:55.125295 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:49:21.208802 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:49:21.208769 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:03.541050 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:03.541001 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:04.563049 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:04.563012 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7"] Jul 24 00:50:04.566448 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:04.566432 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7" Jul 24 00:50:04.568616 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:04.568595 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 00:50:04.568728 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:04.568633 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rz5kk\"" Jul 24 00:50:04.572482 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:04.572459 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7"] Jul 24 00:50:04.595627 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:04.595590 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34a05173-c0a4-4b6b-b097-af9edb068269-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7\" (UID: \"34a05173-c0a4-4b6b-b097-af9edb068269\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7" Jul 24 00:50:04.696808 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:04.696777 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34a05173-c0a4-4b6b-b097-af9edb068269-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7\" (UID: \"34a05173-c0a4-4b6b-b097-af9edb068269\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7" Jul 24 00:50:04.697444 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:04.697421 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34a05173-c0a4-4b6b-b097-af9edb068269-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7\" (UID: \"34a05173-c0a4-4b6b-b097-af9edb068269\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7" Jul 24 00:50:04.877804 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:04.877766 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7" Jul 24 00:50:04.891400 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:04.891371 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:05.007740 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:05.007683 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7"] Jul 24 00:50:05.010062 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:50:05.010028 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a05173_c0a4_4b6b_b097_af9edb068269.slice/crio-0e1083d6fbfa00bff1ac51d7d76b5e206d15f8abaf69abdd0a5a7f3b9c62ee84 WatchSource:0}: Error finding container 0e1083d6fbfa00bff1ac51d7d76b5e206d15f8abaf69abdd0a5a7f3b9c62ee84: Status 404 returned error can't find the container with id 0e1083d6fbfa00bff1ac51d7d76b5e206d15f8abaf69abdd0a5a7f3b9c62ee84 Jul 24 00:50:05.012197 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:05.012181 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 00:50:06.021721 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:06.021690 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7" event={"ID":"34a05173-c0a4-4b6b-b097-af9edb068269","Type":"ContainerStarted","Data":"0e1083d6fbfa00bff1ac51d7d76b5e206d15f8abaf69abdd0a5a7f3b9c62ee84"} Jul 24 00:50:09.040434 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:09.040399 2588 generic.go:356] "Generic (PLEG): container finished" podID="34a05173-c0a4-4b6b-b097-af9edb068269" containerID="43ea13866deba8a691df075748617793b50693bbb54dd882c23bf0ca83a92955" exitCode=0 Jul 24 00:50:09.040906 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:09.040485 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7" event={"ID":"34a05173-c0a4-4b6b-b097-af9edb068269","Type":"ContainerDied","Data":"43ea13866deba8a691df075748617793b50693bbb54dd882c23bf0ca83a92955"} Jul 24 00:50:10.175243 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:10.175216 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7" Jul 24 00:50:10.251870 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:10.251837 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34a05173-c0a4-4b6b-b097-af9edb068269-maas-api-service-ca\") pod \"34a05173-c0a4-4b6b-b097-af9edb068269\" (UID: \"34a05173-c0a4-4b6b-b097-af9edb068269\") " Jul 24 00:50:10.252235 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:10.252213 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34a05173-c0a4-4b6b-b097-af9edb068269-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "34a05173-c0a4-4b6b-b097-af9edb068269" (UID: "34a05173-c0a4-4b6b-b097-af9edb068269"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:50:10.353393 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:10.353361 2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34a05173-c0a4-4b6b-b097-af9edb068269-maas-api-service-ca\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:50:11.051000 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:11.050963 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7" event={"ID":"34a05173-c0a4-4b6b-b097-af9edb068269","Type":"ContainerDied","Data":"0e1083d6fbfa00bff1ac51d7d76b5e206d15f8abaf69abdd0a5a7f3b9c62ee84"} Jul 24 00:50:11.051000 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:11.050997 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7" Jul 24 00:50:11.051232 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:11.051024 2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e1083d6fbfa00bff1ac51d7d76b5e206d15f8abaf69abdd0a5a7f3b9c62ee84" Jul 24 00:50:14.996465 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:14.996422 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:15.061318 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:15.061285 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:15.124890 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:15.124848 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:19.638810 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:19.638771 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:19.648244 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:19.648216 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7"] Jul 24 00:50:19.653189 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:19.653164 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ac89bc-wz4c7"] Jul 24 00:50:20.039705 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:20.039603 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:21.477723 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:21.477688 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34a05173-c0a4-4b6b-b097-af9edb068269" path="/var/lib/kubelet/pods/34a05173-c0a4-4b6b-b097-af9edb068269/volumes" Jul 24 00:50:25.722823 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:25.722785 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:25.792284 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:25.792243 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:25.998457 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:25.998365 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:26.230706 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:26.230658 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:36.821934 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:36.821856 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:36.921471 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:36.921442 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:41.421201 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:41.421161 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:41.840845 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:41.840787 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:47.599110 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:47.599056 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:47.700246 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:47.700208 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:47.884979 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:47.884895 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:48.119181 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:48.119146 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:48.495030 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:48.494978 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:48.829202 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:48.829171 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:48.949912 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:48.949870 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:51.782065 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:51.782022 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:51.891981 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:51.891945 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:52.042499 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:52.042391 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:52.171736 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:52.171702 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:52.566037 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:52.565995 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:52.660095 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:52.660056 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:56.324810 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:56.324773 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:56.824696 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:56.824656 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:57.148357 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:57.148272 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:57.228097 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:57.228024 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:50:59.872060 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:50:59.872021 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:00.036800 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:00.036769 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:00.106444 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:00.106414 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:00.407417 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:00.407380 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:00.731435 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:00.731333 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:00.829361 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:00.829312 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:04.360749 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:04.360717 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:12.563550 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:12.563516 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6"] Jul 24 00:51:12.564014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:12.563905 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34a05173-c0a4-4b6b-b097-af9edb068269" containerName="revoke-keys" Jul 24 00:51:12.564014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:12.563915 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="34a05173-c0a4-4b6b-b097-af9edb068269" containerName="revoke-keys" Jul 24 00:51:12.564014 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:12.563979 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="34a05173-c0a4-4b6b-b097-af9edb068269" containerName="revoke-keys" Jul 24 00:51:12.566977 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:12.566961 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6" Jul 24 00:51:12.569335 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:12.569312 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 00:51:12.569473 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:12.569368 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rz5kk\"" Jul 24 00:51:12.575301 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:12.574927 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6"] Jul 24 00:51:12.645168 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:12.645137 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ae97d60-d0ed-41ee-8726-d09cb2054b02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6\" (UID: \"5ae97d60-d0ed-41ee-8726-d09cb2054b02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6" Jul 24 00:51:12.746438 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:12.746401 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ae97d60-d0ed-41ee-8726-d09cb2054b02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6\" (UID: \"5ae97d60-d0ed-41ee-8726-d09cb2054b02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6" Jul 24 00:51:12.747040 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:12.747019 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ae97d60-d0ed-41ee-8726-d09cb2054b02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6\" (UID: \"5ae97d60-d0ed-41ee-8726-d09cb2054b02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6" Jul 24 00:51:12.880067 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:12.880039 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6" Jul 24 00:51:13.008913 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:13.008852 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6"] Jul 24 00:51:13.012057 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:51:13.012030 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae97d60_d0ed_41ee_8726_d09cb2054b02.slice/crio-d71000c3884bd7cf4ead0ddbf4a3f7c17c94c741096991772fc573cf9e5ab492 WatchSource:0}: Error finding container d71000c3884bd7cf4ead0ddbf4a3f7c17c94c741096991772fc573cf9e5ab492: Status 404 returned error can't find the container with id d71000c3884bd7cf4ead0ddbf4a3f7c17c94c741096991772fc573cf9e5ab492 Jul 24 00:51:13.352330 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:13.352296 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6" event={"ID":"5ae97d60-d0ed-41ee-8726-d09cb2054b02","Type":"ContainerStarted","Data":"61b34cde1aa2ed6826bc107e513fa2608f453d9e6747a567a3abd6a06b4d1e2f"} Jul 24 00:51:13.352461 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:13.352347 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6" event={"ID":"5ae97d60-d0ed-41ee-8726-d09cb2054b02","Type":"ContainerStarted","Data":"d71000c3884bd7cf4ead0ddbf4a3f7c17c94c741096991772fc573cf9e5ab492"} Jul 24 00:51:13.367765 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:13.367719 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6" podStartSLOduration=1.367703826 podStartE2EDuration="1.367703826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:51:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:51:13.365498916 +0000 UTC m=+2234.369058264" watchObservedRunningTime="2026-07-24 00:51:13.367703826 +0000 UTC m=+2234.371263173" Jul 24 00:51:14.358452 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:14.358418 2588 generic.go:356] "Generic (PLEG): container finished" podID="5ae97d60-d0ed-41ee-8726-d09cb2054b02" containerID="61b34cde1aa2ed6826bc107e513fa2608f453d9e6747a567a3abd6a06b4d1e2f" exitCode=0 Jul 24 00:51:14.358870 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:14.358480 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6" event={"ID":"5ae97d60-d0ed-41ee-8726-d09cb2054b02","Type":"ContainerDied","Data":"61b34cde1aa2ed6826bc107e513fa2608f453d9e6747a567a3abd6a06b4d1e2f"} Jul 24 00:51:15.497866 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:15.497843 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6" Jul 24 00:51:15.572389 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:15.572357 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ae97d60-d0ed-41ee-8726-d09cb2054b02-maas-api-service-ca\") pod \"5ae97d60-d0ed-41ee-8726-d09cb2054b02\" (UID: \"5ae97d60-d0ed-41ee-8726-d09cb2054b02\") " Jul 24 00:51:15.572705 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:15.572682 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ae97d60-d0ed-41ee-8726-d09cb2054b02-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5ae97d60-d0ed-41ee-8726-d09cb2054b02" (UID: "5ae97d60-d0ed-41ee-8726-d09cb2054b02"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 00:51:15.673528 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:15.673445 2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ae97d60-d0ed-41ee-8726-d09cb2054b02-maas-api-service-ca\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:51:16.370167 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:16.370138 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6" Jul 24 00:51:16.370167 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:16.370149 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6" event={"ID":"5ae97d60-d0ed-41ee-8726-d09cb2054b02","Type":"ContainerDied","Data":"d71000c3884bd7cf4ead0ddbf4a3f7c17c94c741096991772fc573cf9e5ab492"} Jul 24 00:51:16.370371 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:16.370199 2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d71000c3884bd7cf4ead0ddbf4a3f7c17c94c741096991772fc573cf9e5ab492" Jul 24 00:51:28.378120 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:28.378023 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:28.477965 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:28.477922 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:28.532667 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:28.532616 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:32.652942 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:32.652909 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6"] Jul 24 00:51:32.655581 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:32.655560 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8188-7x9t6"] Jul 24 00:51:32.657988 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:32.657961 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:33.064193 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:33.064094 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:33.476831 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:33.476800 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ae97d60-d0ed-41ee-8726-d09cb2054b02" path="/var/lib/kubelet/pods/5ae97d60-d0ed-41ee-8726-d09cb2054b02/volumes" Jul 24 00:51:39.124205 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:39.124155 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:39.225224 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:39.225190 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:39.410545 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:39.410457 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:39.643796 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:39.643756 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:55.212156 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:55.212119 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:55.284052 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:55.284018 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:55.345815 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:55.345785 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:51:59.858424 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:51:59.858384 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:00.255969 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:00.255863 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:00.939356 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:00.939316 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:01.001682 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:01.001638 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:06.151662 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:06.151628 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:06.252289 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:06.252253 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:06.394567 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:06.394525 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:06.632070 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:06.632028 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:07.030147 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:07.030036 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:07.342668 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:07.342629 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:07.504390 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:07.504338 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:10.288681 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:10.288641 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:10.382815 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:10.382782 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:10.502837 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:10.502800 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:10.602316 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:10.602280 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:10.981221 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:10.981131 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:11.082406 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:11.082357 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:14.807290 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:14.807246 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:15.167666 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:15.167631 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:15.482915 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:15.482837 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:15.781636 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:15.781546 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:18.314593 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:18.314563 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:18.393517 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:18.393481 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:18.464053 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:18.464010 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:18.915990 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:18.915954 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:19.010343 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:19.010310 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:22.868422 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:22.868383 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:52:39.306021 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:52:39.305986 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:53:10.034192 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:53:10.034155 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:53:46.776348 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:53:46.776310 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:54:57.401745 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:54:57.401709 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:55:09.192866 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:09.192834 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:55:10.349504 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:10.349461 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:55:14.293279 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.293246 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp"] Jul 24 00:55:14.293651 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.293631 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae97d60-d0ed-41ee-8726-d09cb2054b02" containerName="revoke-keys" Jul 24 00:55:14.293651 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.293641 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae97d60-d0ed-41ee-8726-d09cb2054b02" containerName="revoke-keys" Jul 24 00:55:14.293737 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.293730 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ae97d60-d0ed-41ee-8726-d09cb2054b02" containerName="revoke-keys" Jul 24 00:55:14.296751 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.296731 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.300145 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.300113 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-38da25\"/\"default-dockercfg-qsk9j\"" Jul 24 00:55:14.300145 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.300130 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-38da25\"/\"sub-test-model-38da25-kserve-self-signed-certs\"" Jul 24 00:55:14.300295 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.300133 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-38da25\"/\"openshift-service-ca.crt\"" Jul 24 00:55:14.300295 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.300133 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-38da25\"/\"kube-root-ca.crt\"" Jul 24 00:55:14.305109 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.305072 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp"] Jul 24 00:55:14.322453 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.322425 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:55:14.344492 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.344462 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-tls-certs\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.344664 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.344505 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdkqg\" (UniqueName: \"kubernetes.io/projected/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-kube-api-access-pdkqg\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.344664 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.344547 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-model-cache\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.344664 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.344575 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-tmp-dir\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.344664 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.344602 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-dshm\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.344813 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.344667 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-home\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.446163 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.446119 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdkqg\" (UniqueName: \"kubernetes.io/projected/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-kube-api-access-pdkqg\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.446360 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.446192 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-model-cache\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.446360 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.446235 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-tmp-dir\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.446360 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.446267 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-dshm\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.446360 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.446319 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-home\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.446581 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.446406 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-tls-certs\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.446692 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.446664 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-model-cache\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.446692 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.446684 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-tmp-dir\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.446822 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.446794 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-home\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.448501 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.448474 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-dshm\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.448739 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.448721 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-tls-certs\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.454404 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.454382 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdkqg\" (UniqueName: \"kubernetes.io/projected/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-kube-api-access-pdkqg\") pod \"sub-test-model-38da25-kserve-576947c869-464vp\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.607867 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.607834 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:14.746643 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:14.746619 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp"] Jul 24 00:55:14.749771 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:55:14.749746 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d78f7db_1223_4ccb_9255_cf72d92b3d8e.slice/crio-945f8a3bf9a9d0e1383537e154e7e537fbba13d03abda98c805f1b0a033de23a WatchSource:0}: Error finding container 945f8a3bf9a9d0e1383537e154e7e537fbba13d03abda98c805f1b0a033de23a: Status 404 returned error can't find the container with id 945f8a3bf9a9d0e1383537e154e7e537fbba13d03abda98c805f1b0a033de23a Jul 24 00:55:15.577933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:15.577897 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" event={"ID":"1d78f7db-1223-4ccb-9255-cf72d92b3d8e","Type":"ContainerStarted","Data":"66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360"} Jul 24 00:55:15.577933 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:15.577940 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" event={"ID":"1d78f7db-1223-4ccb-9255-cf72d92b3d8e","Type":"ContainerStarted","Data":"945f8a3bf9a9d0e1383537e154e7e537fbba13d03abda98c805f1b0a033de23a"} Jul 24 00:55:15.594527 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:15.594071 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" podStartSLOduration=1.594048836 podStartE2EDuration="1.594048836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:55:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:55:15.593750018 +0000 UTC m=+2476.597309364" watchObservedRunningTime="2026-07-24 00:55:15.594048836 +0000 UTC m=+2476.597608184" Jul 24 00:55:24.608818 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:24.608785 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:24.608818 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:24.608827 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:24.621197 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:24.621172 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:24.634041 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:24.634018 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:55:36.627286 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:36.627239 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:55:53.452780 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:55:53.452682 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:56:22.240730 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:22.240686 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp"] Jul 24 00:56:22.258270 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:22.258239 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:56:23.122993 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:23.122964 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:56:28.933194 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:28.933150 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:56:32.540439 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:32.540397 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:56:37.260618 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.260549 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" podUID="1d78f7db-1223-4ccb-9255-cf72d92b3d8e" containerName="main" containerID="cri-o://66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360" gracePeriod=45 Jul 24 00:56:37.514572 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.514506 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:56:37.625921 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.625893 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-tmp-dir\") pod \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " Jul 24 00:56:37.626120 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.625932 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-model-cache\") pod \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " Jul 24 00:56:37.626120 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.625967 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-dshm\") pod \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " Jul 24 00:56:37.626120 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.626009 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-home\") pod \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " Jul 24 00:56:37.626120 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.626059 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-tls-certs\") pod \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " Jul 24 00:56:37.626120 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.626106 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdkqg\" (UniqueName: \"kubernetes.io/projected/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-kube-api-access-pdkqg\") pod \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\" (UID: \"1d78f7db-1223-4ccb-9255-cf72d92b3d8e\") " Jul 24 00:56:37.626408 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.626235 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1d78f7db-1223-4ccb-9255-cf72d92b3d8e" (UID: "1d78f7db-1223-4ccb-9255-cf72d92b3d8e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 00:56:37.626408 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.626252 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-model-cache" (OuterVolumeSpecName: "model-cache") pod "1d78f7db-1223-4ccb-9255-cf72d92b3d8e" (UID: "1d78f7db-1223-4ccb-9255-cf72d92b3d8e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 00:56:37.626408 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.626355 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-home" (OuterVolumeSpecName: "home") pod "1d78f7db-1223-4ccb-9255-cf72d92b3d8e" (UID: "1d78f7db-1223-4ccb-9255-cf72d92b3d8e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 00:56:37.626557 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.626526 2588 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-home\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:56:37.626614 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.626572 2588 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-tmp-dir\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:56:37.626614 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.626589 2588 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-model-cache\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:56:37.628295 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.628268 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-dshm" (OuterVolumeSpecName: "dshm") pod "1d78f7db-1223-4ccb-9255-cf72d92b3d8e" (UID: "1d78f7db-1223-4ccb-9255-cf72d92b3d8e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 00:56:37.628411 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.628315 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-kube-api-access-pdkqg" (OuterVolumeSpecName: "kube-api-access-pdkqg") pod "1d78f7db-1223-4ccb-9255-cf72d92b3d8e" (UID: "1d78f7db-1223-4ccb-9255-cf72d92b3d8e"). InnerVolumeSpecName "kube-api-access-pdkqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 00:56:37.628411 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.628321 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1d78f7db-1223-4ccb-9255-cf72d92b3d8e" (UID: "1d78f7db-1223-4ccb-9255-cf72d92b3d8e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 00:56:37.727970 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.727933 2588 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-dshm\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:56:37.727970 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.727963 2588 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-tls-certs\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:56:37.727970 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.727974 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdkqg\" (UniqueName: \"kubernetes.io/projected/1d78f7db-1223-4ccb-9255-cf72d92b3d8e-kube-api-access-pdkqg\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:56:37.991804 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.991767 2588 generic.go:356] "Generic (PLEG): container finished" podID="1d78f7db-1223-4ccb-9255-cf72d92b3d8e" containerID="66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360" exitCode=0 Jul 24 00:56:37.991994 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.991819 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" Jul 24 00:56:37.991994 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.991850 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" event={"ID":"1d78f7db-1223-4ccb-9255-cf72d92b3d8e","Type":"ContainerDied","Data":"66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360"} Jul 24 00:56:37.991994 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.991893 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp" event={"ID":"1d78f7db-1223-4ccb-9255-cf72d92b3d8e","Type":"ContainerDied","Data":"945f8a3bf9a9d0e1383537e154e7e537fbba13d03abda98c805f1b0a033de23a"} Jul 24 00:56:37.991994 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:37.991909 2588 scope.go:117] "RemoveContainer" containerID="66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360" Jul 24 00:56:38.001600 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:38.001585 2588 scope.go:117] "RemoveContainer" containerID="66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360" Jul 24 00:56:38.001845 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:56:38.001828 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360\": container with ID starting with 66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360 not found: ID does not exist" containerID="66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360" Jul 24 00:56:38.001885 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:38.001852 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360"} err="failed to get container status \"66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360\": rpc error: code = NotFound desc = could not find container \"66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360\": container with ID starting with 66c867b32fb1562e3f172ab55086d4429a1457b10f862731715984105dfef360 not found: ID does not exist" Jul 24 00:56:38.012329 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:38.012304 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp"] Jul 24 00:56:38.015529 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:38.015506 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-38da25/sub-test-model-38da25-kserve-576947c869-464vp"] Jul 24 00:56:39.478549 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:39.478520 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d78f7db-1223-4ccb-9255-cf72d92b3d8e" path="/var/lib/kubelet/pods/1d78f7db-1223-4ccb-9255-cf72d92b3d8e/volumes" Jul 24 00:56:59.638006 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:56:59.637977 2588 scope.go:117] "RemoveContainer" containerID="43ea13866deba8a691df075748617793b50693bbb54dd882c23bf0ca83a92955" Jul 24 00:57:05.722138 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:57:05.722067 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:57:54.993662 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:57:54.993625 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:57:55.823436 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:57:55.823400 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:57:59.660400 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:57:59.660371 2588 scope.go:117] "RemoveContainer" containerID="61b34cde1aa2ed6826bc107e513fa2608f453d9e6747a567a3abd6a06b4d1e2f" Jul 24 00:58:08.702184 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:08.702147 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7358-140013700301136"] Jul 24 00:58:08.702657 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:08.702524 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d78f7db-1223-4ccb-9255-cf72d92b3d8e" containerName="main" Jul 24 00:58:08.702657 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:08.702535 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d78f7db-1223-4ccb-9255-cf72d92b3d8e" containerName="main" Jul 24 00:58:08.702657 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:08.702617 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d78f7db-1223-4ccb-9255-cf72d92b3d8e" containerName="main" Jul 24 00:58:08.705752 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:08.705736 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140013700301136" Jul 24 00:58:08.707884 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:08.707865 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wmrlv\"" Jul 24 00:58:08.710734 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:08.710710 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140013700301136"] Jul 24 00:58:08.799729 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:08.799695 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ldnl\" (UniqueName: \"kubernetes.io/projected/8beba73d-0403-49a6-8b94-0e1c17a2e204-kube-api-access-5ldnl\") pod \"test-curl-7358-140013700301136\" (UID: \"8beba73d-0403-49a6-8b94-0e1c17a2e204\") " pod="opendatahub/test-curl-7358-140013700301136" Jul 24 00:58:08.900692 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:08.900650 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ldnl\" (UniqueName: \"kubernetes.io/projected/8beba73d-0403-49a6-8b94-0e1c17a2e204-kube-api-access-5ldnl\") pod \"test-curl-7358-140013700301136\" (UID: \"8beba73d-0403-49a6-8b94-0e1c17a2e204\") " pod="opendatahub/test-curl-7358-140013700301136" Jul 24 00:58:08.909466 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:08.909439 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ldnl\" (UniqueName: \"kubernetes.io/projected/8beba73d-0403-49a6-8b94-0e1c17a2e204-kube-api-access-5ldnl\") pod \"test-curl-7358-140013700301136\" (UID: \"8beba73d-0403-49a6-8b94-0e1c17a2e204\") " pod="opendatahub/test-curl-7358-140013700301136" Jul 24 00:58:09.015884 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:09.015797 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140013700301136" Jul 24 00:58:09.146650 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:09.146621 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140013700301136"] Jul 24 00:58:09.148972 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:58:09.148942 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8beba73d_0403_49a6_8b94_0e1c17a2e204.slice/crio-799dca886bf9456e2e20a0cbc9013b0b8aaf34fb81ae0faf4df8d943d3a7bb54 WatchSource:0}: Error finding container 799dca886bf9456e2e20a0cbc9013b0b8aaf34fb81ae0faf4df8d943d3a7bb54: Status 404 returned error can't find the container with id 799dca886bf9456e2e20a0cbc9013b0b8aaf34fb81ae0faf4df8d943d3a7bb54 Jul 24 00:58:09.150401 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:09.150382 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 00:58:09.448535 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:09.448493 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140013700301136" event={"ID":"8beba73d-0403-49a6-8b94-0e1c17a2e204","Type":"ContainerStarted","Data":"799dca886bf9456e2e20a0cbc9013b0b8aaf34fb81ae0faf4df8d943d3a7bb54"} Jul 24 00:58:10.456100 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:10.456054 2588 generic.go:356] "Generic (PLEG): container finished" podID="8beba73d-0403-49a6-8b94-0e1c17a2e204" containerID="4f7b878a881012b609d9def7ca144b3b8f652f94acfe42ce151dd0c2024a6533" exitCode=0 Jul 24 00:58:10.456538 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:10.456144 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140013700301136" event={"ID":"8beba73d-0403-49a6-8b94-0e1c17a2e204","Type":"ContainerDied","Data":"4f7b878a881012b609d9def7ca144b3b8f652f94acfe42ce151dd0c2024a6533"} Jul 24 00:58:11.597950 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:11.597927 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140013700301136" Jul 24 00:58:11.617101 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:11.617059 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7358-140013700301136_8beba73d-0403-49a6-8b94-0e1c17a2e204/test-curl-7358-140013700301136/0.log" Jul 24 00:58:11.637496 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:11.637462 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7358-140013700301136"] Jul 24 00:58:11.641110 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:11.641064 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7358-140013700301136"] Jul 24 00:58:11.726225 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:11.726136 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ldnl\" (UniqueName: \"kubernetes.io/projected/8beba73d-0403-49a6-8b94-0e1c17a2e204-kube-api-access-5ldnl\") pod \"8beba73d-0403-49a6-8b94-0e1c17a2e204\" (UID: \"8beba73d-0403-49a6-8b94-0e1c17a2e204\") " Jul 24 00:58:11.728293 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:11.728265 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8beba73d-0403-49a6-8b94-0e1c17a2e204-kube-api-access-5ldnl" (OuterVolumeSpecName: "kube-api-access-5ldnl") pod "8beba73d-0403-49a6-8b94-0e1c17a2e204" (UID: "8beba73d-0403-49a6-8b94-0e1c17a2e204"). InnerVolumeSpecName "kube-api-access-5ldnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 00:58:11.827853 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:11.827815 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ldnl\" (UniqueName: \"kubernetes.io/projected/8beba73d-0403-49a6-8b94-0e1c17a2e204-kube-api-access-5ldnl\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 00:58:12.466205 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:12.466179 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140013700301136" Jul 24 00:58:12.466409 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:12.466177 2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="799dca886bf9456e2e20a0cbc9013b0b8aaf34fb81ae0faf4df8d943d3a7bb54" Jul 24 00:58:12.476089 ip-10-0-130-20 kubenswrapper[2588]: E0724 00:58:12.476050 2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7358-140013700301136\" is forbidden: User \"system:node:ip-10-0-130-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-20.ec2.internal' and this object" podUID="8beba73d-0403-49a6-8b94-0e1c17a2e204" pod="opendatahub/test-curl-7358-140013700301136" Jul 24 00:58:13.476459 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:13.476424 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8beba73d-0403-49a6-8b94-0e1c17a2e204" path="/var/lib/kubelet/pods/8beba73d-0403-49a6-8b94-0e1c17a2e204/volumes" Jul 24 00:58:15.074279 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:15.074244 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:15.411675 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:15.411581 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:15.766226 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:15.766150 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:18.529685 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:18.529646 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:18.629883 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:18.629843 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:18.782236 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:18.782140 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:18.968438 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:18.968409 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:19.211526 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.211483 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:19.308705 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.308670 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:19.320094 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.320045 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj"] Jul 24 00:58:19.320512 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.320493 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8beba73d-0403-49a6-8b94-0e1c17a2e204" containerName="test-curl-7358-140013700301136" Jul 24 00:58:19.320608 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.320515 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="8beba73d-0403-49a6-8b94-0e1c17a2e204" containerName="test-curl-7358-140013700301136" Jul 24 00:58:19.320663 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.320629 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="8beba73d-0403-49a6-8b94-0e1c17a2e204" containerName="test-curl-7358-140013700301136" Jul 24 00:58:19.323881 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.323862 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" Jul 24 00:58:19.327149 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.327126 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-a3cf0e\"" Jul 24 00:58:19.336313 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.336288 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj"] Jul 24 00:58:19.353485 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.353453 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4"] Jul 24 00:58:19.356941 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.356924 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" Jul 24 00:58:19.359259 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.359242 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-a3cf0e-dockercfg-nlgs8\"" Jul 24 00:58:19.365459 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.365436 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4"] Jul 24 00:58:19.408511 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.408424 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkrq5\" (UniqueName: \"kubernetes.io/projected/a6b0c688-032c-4d75-ae20-581011661e02-kube-api-access-pkrq5\") pod \"payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj\" (UID: \"a6b0c688-032c-4d75-ae20-581011661e02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" Jul 24 00:58:19.408511 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.408506 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b0c688-032c-4d75-ae20-581011661e02-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj\" (UID: \"a6b0c688-032c-4d75-ae20-581011661e02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" Jul 24 00:58:19.509006 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.508971 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkrq5\" (UniqueName: \"kubernetes.io/projected/a6b0c688-032c-4d75-ae20-581011661e02-kube-api-access-pkrq5\") pod \"payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj\" (UID: \"a6b0c688-032c-4d75-ae20-581011661e02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" Jul 24 00:58:19.509203 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.509013 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn5qs\" (UniqueName: \"kubernetes.io/projected/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0-kube-api-access-cn5qs\") pod \"payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4\" (UID: \"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" Jul 24 00:58:19.509203 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.509046 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4\" (UID: \"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" Jul 24 00:58:19.509203 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.509140 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b0c688-032c-4d75-ae20-581011661e02-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj\" (UID: \"a6b0c688-032c-4d75-ae20-581011661e02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" Jul 24 00:58:19.509794 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.509776 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b0c688-032c-4d75-ae20-581011661e02-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj\" (UID: \"a6b0c688-032c-4d75-ae20-581011661e02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" Jul 24 00:58:19.517945 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.517913 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkrq5\" (UniqueName: \"kubernetes.io/projected/a6b0c688-032c-4d75-ae20-581011661e02-kube-api-access-pkrq5\") pod \"payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj\" (UID: \"a6b0c688-032c-4d75-ae20-581011661e02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" Jul 24 00:58:19.610762 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.610725 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn5qs\" (UniqueName: \"kubernetes.io/projected/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0-kube-api-access-cn5qs\") pod \"payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4\" (UID: \"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" Jul 24 00:58:19.610762 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.610768 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4\" (UID: \"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" Jul 24 00:58:19.611543 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.611523 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4\" (UID: \"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" Jul 24 00:58:19.618948 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.618923 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn5qs\" (UniqueName: \"kubernetes.io/projected/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0-kube-api-access-cn5qs\") pod \"payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4\" (UID: \"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" Jul 24 00:58:19.634774 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.634746 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" Jul 24 00:58:19.668868 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.668781 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" Jul 24 00:58:19.785380 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:58:19.785351 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b0c688_032c_4d75_ae20_581011661e02.slice/crio-0e264f0b488c23288cec3c0903b6c1f2b72c89f35678bdc8c2657ad186aea0da WatchSource:0}: Error finding container 0e264f0b488c23288cec3c0903b6c1f2b72c89f35678bdc8c2657ad186aea0da: Status 404 returned error can't find the container with id 0e264f0b488c23288cec3c0903b6c1f2b72c89f35678bdc8c2657ad186aea0da Jul 24 00:58:19.785519 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.785488 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj"] Jul 24 00:58:19.825630 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:19.825454 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4"] Jul 24 00:58:19.828378 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:58:19.828350 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460ac5c8_c4cf_4fc5_b1fc_05c1d6de85a0.slice/crio-804653a0773632839b10296e8f356e0e868233ffe05c9f8a90677b2dccd5066a WatchSource:0}: Error finding container 804653a0773632839b10296e8f356e0e868233ffe05c9f8a90677b2dccd5066a: Status 404 returned error can't find the container with id 804653a0773632839b10296e8f356e0e868233ffe05c9f8a90677b2dccd5066a Jul 24 00:58:20.510145 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:20.510111 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" event={"ID":"a6b0c688-032c-4d75-ae20-581011661e02","Type":"ContainerStarted","Data":"391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6"} Jul 24 00:58:20.510351 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:20.510164 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" event={"ID":"a6b0c688-032c-4d75-ae20-581011661e02","Type":"ContainerStarted","Data":"0e264f0b488c23288cec3c0903b6c1f2b72c89f35678bdc8c2657ad186aea0da"} Jul 24 00:58:20.510351 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:20.510204 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" Jul 24 00:58:20.511689 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:20.511661 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" event={"ID":"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0","Type":"ContainerStarted","Data":"a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2"} Jul 24 00:58:20.511794 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:20.511694 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" event={"ID":"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0","Type":"ContainerStarted","Data":"804653a0773632839b10296e8f356e0e868233ffe05c9f8a90677b2dccd5066a"} Jul 24 00:58:20.511794 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:20.511778 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" Jul 24 00:58:20.527205 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:20.527147 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" podStartSLOduration=1.527129867 podStartE2EDuration="1.527129867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:58:20.525461007 +0000 UTC m=+2661.529020355" watchObservedRunningTime="2026-07-24 00:58:20.527129867 +0000 UTC m=+2661.530689214" Jul 24 00:58:20.543399 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:20.543342 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" podStartSLOduration=1.543321314 podStartE2EDuration="1.543321314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:58:20.540770143 +0000 UTC m=+2661.544329501" watchObservedRunningTime="2026-07-24 00:58:20.543321314 +0000 UTC m=+2661.546880664" Jul 24 00:58:22.939570 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:22.939528 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:31.518561 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:31.518508 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" podUID="a6b0c688-032c-4d75-ae20-581011661e02" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.42:9004: connect: connection refused" Jul 24 00:58:31.519045 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:31.519027 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" Jul 24 00:58:41.517757 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:41.517727 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" Jul 24 00:58:44.164206 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:44.164166 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:44.484880 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:44.484784 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:44.584666 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:44.584630 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:47.585544 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:47.585506 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:47.679540 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:47.679511 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:47.756503 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:47.756468 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:48.271478 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.271440 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:48.372703 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.372672 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:48.407329 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.407290 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52"] Jul 24 00:58:48.412427 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.412411 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" Jul 24 00:58:48.415223 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.415201 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-86b8da\"" Jul 24 00:58:48.415359 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.415251 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-86b8da-dockercfg-q779t\"" Jul 24 00:58:48.420297 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.420269 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52"] Jul 24 00:58:48.451803 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.451775 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:58:48.488985 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.488956 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/033aaab4-768a-472a-acbd-8b0122689490-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52\" (UID: \"033aaab4-768a-472a-acbd-8b0122689490\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" Jul 24 00:58:48.489191 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.489008 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nzjm\" (UniqueName: \"kubernetes.io/projected/033aaab4-768a-472a-acbd-8b0122689490-kube-api-access-6nzjm\") pod \"payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52\" (UID: \"033aaab4-768a-472a-acbd-8b0122689490\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" Jul 24 00:58:48.589734 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.589683 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/033aaab4-768a-472a-acbd-8b0122689490-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52\" (UID: \"033aaab4-768a-472a-acbd-8b0122689490\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" Jul 24 00:58:48.590208 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.589771 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nzjm\" (UniqueName: \"kubernetes.io/projected/033aaab4-768a-472a-acbd-8b0122689490-kube-api-access-6nzjm\") pod \"payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52\" (UID: \"033aaab4-768a-472a-acbd-8b0122689490\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" Jul 24 00:58:48.590767 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.590745 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/033aaab4-768a-472a-acbd-8b0122689490-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52\" (UID: \"033aaab4-768a-472a-acbd-8b0122689490\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" Jul 24 00:58:48.598048 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.598018 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nzjm\" (UniqueName: \"kubernetes.io/projected/033aaab4-768a-472a-acbd-8b0122689490-kube-api-access-6nzjm\") pod \"payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52\" (UID: \"033aaab4-768a-472a-acbd-8b0122689490\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" Jul 24 00:58:48.724861 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.724827 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" Jul 24 00:58:48.856802 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:48.856776 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52"] Jul 24 00:58:48.858745 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:58:48.858716 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod033aaab4_768a_472a_acbd_8b0122689490.slice/crio-b95cc20a2c7c9f48708422527e895a2edcff834b335987c665d6f330cdf9d031 WatchSource:0}: Error finding container b95cc20a2c7c9f48708422527e895a2edcff834b335987c665d6f330cdf9d031: Status 404 returned error can't find the container with id b95cc20a2c7c9f48708422527e895a2edcff834b335987c665d6f330cdf9d031 Jul 24 00:58:49.662544 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:49.662507 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" event={"ID":"033aaab4-768a-472a-acbd-8b0122689490","Type":"ContainerStarted","Data":"5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e"} Jul 24 00:58:49.662985 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:49.662562 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" event={"ID":"033aaab4-768a-472a-acbd-8b0122689490","Type":"ContainerStarted","Data":"b95cc20a2c7c9f48708422527e895a2edcff834b335987c665d6f330cdf9d031"} Jul 24 00:58:49.662985 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:49.662628 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" Jul 24 00:58:49.678655 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:49.678606 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" podStartSLOduration=1.67859216 podStartE2EDuration="1.67859216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:58:49.67763421 +0000 UTC m=+2690.681193557" watchObservedRunningTime="2026-07-24 00:58:49.67859216 +0000 UTC m=+2690.682151506" Jul 24 00:58:52.120131 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:58:52.120030 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:59:00.669496 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:00.669465 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" Jul 24 00:59:09.544785 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:09.544738 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52_033aaab4-768a-472a-acbd-8b0122689490/payload-processing/0.log" Jul 24 00:59:22.340253 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:22.340215 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:59:22.440283 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:22.440250 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:59:33.731825 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:33.731766 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:59:33.783558 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:33.783509 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:59:39.302566 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.302525 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49"] Jul 24 00:59:39.306232 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.306209 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.309659 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.309636 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-a3cf0e\"/\"default-dockercfg-t8t7s\"" Jul 24 00:59:39.309804 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.309636 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-a3cf0e\"/\"openshift-service-ca.crt\"" Jul 24 00:59:39.309804 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.309695 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-a3cf0e\"/\"kube-root-ca.crt\"" Jul 24 00:59:39.309804 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.309635 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-a3cf0e\"/\"ipp-route-a3cf0e-kserve-self-signed-certs\"" Jul 24 00:59:39.314247 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.314225 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49"] Jul 24 00:59:39.332299 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.332269 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 00:59:39.394036 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.394000 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86qfp\" (UniqueName: \"kubernetes.io/projected/97037e72-304e-4c8c-8e18-39015b9426cd-kube-api-access-86qfp\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.394242 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.394058 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-model-cache\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.394242 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.394125 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-tmp-dir\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.394242 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.394146 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97037e72-304e-4c8c-8e18-39015b9426cd-tls-certs\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.394242 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.394165 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-home\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.394415 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.394251 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-dshm\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.494894 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.494862 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-model-cache\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.495069 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.494909 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-tmp-dir\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.495069 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.494944 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97037e72-304e-4c8c-8e18-39015b9426cd-tls-certs\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.495069 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.494967 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-home\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.495069 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.494989 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-dshm\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.495069 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.495066 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86qfp\" (UniqueName: \"kubernetes.io/projected/97037e72-304e-4c8c-8e18-39015b9426cd-kube-api-access-86qfp\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.495369 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.495292 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-tmp-dir\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.495369 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.495312 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-model-cache\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.495482 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.495378 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-home\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.497372 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.497352 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-dshm\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.497566 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.497547 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97037e72-304e-4c8c-8e18-39015b9426cd-tls-certs\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.503331 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.503309 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86qfp\" (UniqueName: \"kubernetes.io/projected/97037e72-304e-4c8c-8e18-39015b9426cd-kube-api-access-86qfp\") pod \"ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.618628 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.618587 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:39.753253 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.753225 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49"] Jul 24 00:59:39.754840 ip-10-0-130-20 kubenswrapper[2588]: W0724 00:59:39.754813 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97037e72_304e_4c8c_8e18_39015b9426cd.slice/crio-503594d06e9ad5e52ced99a71f44ebe28742a5a9a4c76ac6c0386b4110313473 WatchSource:0}: Error finding container 503594d06e9ad5e52ced99a71f44ebe28742a5a9a4c76ac6c0386b4110313473: Status 404 returned error can't find the container with id 503594d06e9ad5e52ced99a71f44ebe28742a5a9a4c76ac6c0386b4110313473 Jul 24 00:59:39.917714 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.917622 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" event={"ID":"97037e72-304e-4c8c-8e18-39015b9426cd","Type":"ContainerStarted","Data":"366655be58b136c00e0e8f05439845c8f2139286b00be4ca118e982a6f01c4cc"} Jul 24 00:59:39.917714 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.917664 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" event={"ID":"97037e72-304e-4c8c-8e18-39015b9426cd","Type":"ContainerStarted","Data":"503594d06e9ad5e52ced99a71f44ebe28742a5a9a4c76ac6c0386b4110313473"} Jul 24 00:59:39.935484 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:39.935435 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" podStartSLOduration=0.935419095 podStartE2EDuration="935.419095ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 00:59:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 00:59:39.933002795 +0000 UTC m=+2740.936562141" watchObservedRunningTime="2026-07-24 00:59:39.935419095 +0000 UTC m=+2740.938978442" Jul 24 00:59:49.619241 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:49.619210 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:49.619657 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:49.619263 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:49.632909 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:49.632881 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 00:59:49.981925 ip-10-0-130-20 kubenswrapper[2588]: I0724 00:59:49.981843 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 01:00:00.141475 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:00.141439 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747580-npmrk"] Jul 24 01:00:00.145355 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:00.145331 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747580-npmrk" Jul 24 01:00:00.148483 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:00.148459 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rz5kk\"" Jul 24 01:00:00.157425 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:00.157393 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747580-npmrk"] Jul 24 01:00:00.158639 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:00.158609 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747580-npmrk" Jul 24 01:00:00.297430 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:00.297399 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747580-npmrk"] Jul 24 01:00:00.301880 ip-10-0-130-20 kubenswrapper[2588]: W0724 01:00:00.301853 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8b5d46_3577_4cb1_912c_4dd754920ebc.slice/crio-a1f24f516233d2b39b30d0417c5fa5e6d77b4ac77c43761b83f933bb29e8b8f1 WatchSource:0}: Error finding container a1f24f516233d2b39b30d0417c5fa5e6d77b4ac77c43761b83f933bb29e8b8f1: Status 404 returned error can't find the container with id a1f24f516233d2b39b30d0417c5fa5e6d77b4ac77c43761b83f933bb29e8b8f1 Jul 24 01:00:01.025899 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:01.025861 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747580-npmrk" event={"ID":"de8b5d46-3577-4cb1-912c-4dd754920ebc","Type":"ContainerStarted","Data":"f4d25d346fbdc48df8b7914f24a7bfa71e36562a666eeb86ea5b11210f5e3083"} Jul 24 01:00:01.026176 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:01.025923 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747580-npmrk" event={"ID":"de8b5d46-3577-4cb1-912c-4dd754920ebc","Type":"ContainerStarted","Data":"a1f24f516233d2b39b30d0417c5fa5e6d77b4ac77c43761b83f933bb29e8b8f1"} Jul 24 01:00:01.042309 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:01.042258 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747580-npmrk" podStartSLOduration=1.042242632 podStartE2EDuration="1.042242632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:00:01.040192659 +0000 UTC m=+2762.043752011" watchObservedRunningTime="2026-07-24 01:00:01.042242632 +0000 UTC m=+2762.045802008" Jul 24 01:00:02.033105 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:02.033051 2588 generic.go:356] "Generic (PLEG): container finished" podID="de8b5d46-3577-4cb1-912c-4dd754920ebc" containerID="f4d25d346fbdc48df8b7914f24a7bfa71e36562a666eeb86ea5b11210f5e3083" exitCode=0 Jul 24 01:00:02.033560 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:02.033145 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747580-npmrk" event={"ID":"de8b5d46-3577-4cb1-912c-4dd754920ebc","Type":"ContainerDied","Data":"f4d25d346fbdc48df8b7914f24a7bfa71e36562a666eeb86ea5b11210f5e3083"} Jul 24 01:00:03.183170 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:03.183146 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747580-npmrk" Jul 24 01:00:04.044149 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:04.044115 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747580-npmrk" Jul 24 01:00:04.044149 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:04.044129 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747580-npmrk" event={"ID":"de8b5d46-3577-4cb1-912c-4dd754920ebc","Type":"ContainerDied","Data":"a1f24f516233d2b39b30d0417c5fa5e6d77b4ac77c43761b83f933bb29e8b8f1"} Jul 24 01:00:04.044407 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:04.044175 2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1f24f516233d2b39b30d0417c5fa5e6d77b4ac77c43761b83f933bb29e8b8f1" Jul 24 01:00:04.616293 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:04.616263 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4_460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0/payload-processing/0.log" Jul 24 01:00:04.856981 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:04.856952 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52_033aaab4-768a-472a-acbd-8b0122689490/payload-processing/0.log" Jul 24 01:00:05.136330 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:05.136290 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:05.468826 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:05.468741 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:06.036047 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:06.036011 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:08.048337 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:08.048301 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:08.146853 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:08.146821 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:08.408951 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:08.408912 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:08.669941 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:08.669847 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:09.043730 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:09.043641 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:09.139029 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:09.138993 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:13.387276 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:13.387239 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:23.514707 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.514618 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8"] Jul 24 01:00:23.515171 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.515155 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de8b5d46-3577-4cb1-912c-4dd754920ebc" containerName="cleanup" Jul 24 01:00:23.515225 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.515174 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="de8b5d46-3577-4cb1-912c-4dd754920ebc" containerName="cleanup" Jul 24 01:00:23.515264 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.515244 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="de8b5d46-3577-4cb1-912c-4dd754920ebc" containerName="cleanup" Jul 24 01:00:23.518342 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.518323 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8" Jul 24 01:00:23.520435 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.520419 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 01:00:23.520566 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.520431 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rz5kk\"" Jul 24 01:00:23.524440 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.524415 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8"] Jul 24 01:00:23.627064 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.627028 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8762af4-1aa2-4079-9041-f51c921f49c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8\" (UID: \"a8762af4-1aa2-4079-9041-f51c921f49c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8" Jul 24 01:00:23.728360 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.728317 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8762af4-1aa2-4079-9041-f51c921f49c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8\" (UID: \"a8762af4-1aa2-4079-9041-f51c921f49c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8" Jul 24 01:00:23.728950 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.728928 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8762af4-1aa2-4079-9041-f51c921f49c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8\" (UID: \"a8762af4-1aa2-4079-9041-f51c921f49c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8" Jul 24 01:00:23.838318 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.838283 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8" Jul 24 01:00:23.976262 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:23.976228 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8"] Jul 24 01:00:23.978380 ip-10-0-130-20 kubenswrapper[2588]: W0724 01:00:23.978353 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8762af4_1aa2_4079_9041_f51c921f49c5.slice/crio-e71690f20a764e9182b6da8c50f140b9da11c99e77a56ccb71bb94c56761b1af WatchSource:0}: Error finding container e71690f20a764e9182b6da8c50f140b9da11c99e77a56ccb71bb94c56761b1af: Status 404 returned error can't find the container with id e71690f20a764e9182b6da8c50f140b9da11c99e77a56ccb71bb94c56761b1af Jul 24 01:00:24.155957 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:24.155927 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8" event={"ID":"a8762af4-1aa2-4079-9041-f51c921f49c5","Type":"ContainerStarted","Data":"e71690f20a764e9182b6da8c50f140b9da11c99e77a56ccb71bb94c56761b1af"} Jul 24 01:00:25.162962 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:25.162929 2588 generic.go:356] "Generic (PLEG): container finished" podID="a8762af4-1aa2-4079-9041-f51c921f49c5" containerID="7882eced44475e68f227c5b5da5febe4aaed08553d2c8b0ec8265af92ac7cce3" exitCode=0 Jul 24 01:00:25.163363 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:25.163013 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8" event={"ID":"a8762af4-1aa2-4079-9041-f51c921f49c5","Type":"ContainerDied","Data":"7882eced44475e68f227c5b5da5febe4aaed08553d2c8b0ec8265af92ac7cce3"} Jul 24 01:00:26.300233 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:26.300206 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8" Jul 24 01:00:26.354837 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:26.354809 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8762af4-1aa2-4079-9041-f51c921f49c5-maas-api-service-ca\") pod \"a8762af4-1aa2-4079-9041-f51c921f49c5\" (UID: \"a8762af4-1aa2-4079-9041-f51c921f49c5\") " Jul 24 01:00:26.355189 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:26.355168 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8762af4-1aa2-4079-9041-f51c921f49c5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a8762af4-1aa2-4079-9041-f51c921f49c5" (UID: "a8762af4-1aa2-4079-9041-f51c921f49c5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 01:00:26.455954 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:26.455870 2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8762af4-1aa2-4079-9041-f51c921f49c5-maas-api-service-ca\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:00:27.174114 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:27.174057 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8" event={"ID":"a8762af4-1aa2-4079-9041-f51c921f49c5","Type":"ContainerDied","Data":"e71690f20a764e9182b6da8c50f140b9da11c99e77a56ccb71bb94c56761b1af"} Jul 24 01:00:27.174291 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:27.174131 2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e71690f20a764e9182b6da8c50f140b9da11c99e77a56ccb71bb94c56761b1af" Jul 24 01:00:27.174291 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:27.174098 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8" Jul 24 01:00:34.092191 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:34.092157 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:34.165441 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:34.165402 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:34.223963 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:34.223930 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:34.608974 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:34.608945 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:38.596844 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:38.596811 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:38.597488 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:38.597472 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8"] Jul 24 01:00:38.599432 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:38.599410 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e040d3-zsfh8"] Jul 24 01:00:38.978008 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:38.977912 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:39.479270 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:39.479237 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8762af4-1aa2-4079-9041-f51c921f49c5" path="/var/lib/kubelet/pods/a8762af4-1aa2-4079-9041-f51c921f49c5/volumes" Jul 24 01:00:44.837585 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:44.837547 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:44.938388 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:44.938348 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:45.116202 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:45.116105 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:00:45.353550 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:00:45.353512 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:04.417038 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.416997 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:04.447780 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.447749 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4"] Jul 24 01:01:04.447969 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.447944 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" podUID="460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0" containerName="payload-processing" containerID="cri-o://a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2" gracePeriod=30 Jul 24 01:01:04.463127 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.463093 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj"] Jul 24 01:01:04.463365 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.463340 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" podUID="a6b0c688-032c-4d75-ae20-581011661e02" containerName="payload-pre-processing" containerID="cri-o://391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6" gracePeriod=30 Jul 24 01:01:04.504064 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.504018 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:04.604235 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.604172 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:04.718631 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.718601 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" Jul 24 01:01:04.733561 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.733538 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" Jul 24 01:01:04.835193 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.835163 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn5qs\" (UniqueName: \"kubernetes.io/projected/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0-kube-api-access-cn5qs\") pod \"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0\" (UID: \"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0\") " Jul 24 01:01:04.835381 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.835224 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0-plugins-config-volume\") pod \"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0\" (UID: \"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0\") " Jul 24 01:01:04.835381 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.835298 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkrq5\" (UniqueName: \"kubernetes.io/projected/a6b0c688-032c-4d75-ae20-581011661e02-kube-api-access-pkrq5\") pod \"a6b0c688-032c-4d75-ae20-581011661e02\" (UID: \"a6b0c688-032c-4d75-ae20-581011661e02\") " Jul 24 01:01:04.835381 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.835347 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b0c688-032c-4d75-ae20-581011661e02-plugins-config-volume\") pod \"a6b0c688-032c-4d75-ae20-581011661e02\" (UID: \"a6b0c688-032c-4d75-ae20-581011661e02\") " Jul 24 01:01:04.835750 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.835714 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0" (UID: "460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 01:01:04.835891 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.835815 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6b0c688-032c-4d75-ae20-581011661e02-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6b0c688-032c-4d75-ae20-581011661e02" (UID: "a6b0c688-032c-4d75-ae20-581011661e02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 01:01:04.837482 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.837462 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6b0c688-032c-4d75-ae20-581011661e02-kube-api-access-pkrq5" (OuterVolumeSpecName: "kube-api-access-pkrq5") pod "a6b0c688-032c-4d75-ae20-581011661e02" (UID: "a6b0c688-032c-4d75-ae20-581011661e02"). InnerVolumeSpecName "kube-api-access-pkrq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 01:01:04.837572 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.837528 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0-kube-api-access-cn5qs" (OuterVolumeSpecName: "kube-api-access-cn5qs") pod "460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0" (UID: "460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0"). InnerVolumeSpecName "kube-api-access-cn5qs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 01:01:04.936785 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.936749 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkrq5\" (UniqueName: \"kubernetes.io/projected/a6b0c688-032c-4d75-ae20-581011661e02-kube-api-access-pkrq5\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:01:04.936785 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.936774 2588 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b0c688-032c-4d75-ae20-581011661e02-plugins-config-volume\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:01:04.936785 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.936784 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn5qs\" (UniqueName: \"kubernetes.io/projected/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0-kube-api-access-cn5qs\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:01:04.936785 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:04.936793 2588 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0-plugins-config-volume\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:01:05.375015 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.374980 2588 generic.go:356] "Generic (PLEG): container finished" podID="a6b0c688-032c-4d75-ae20-581011661e02" containerID="391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6" exitCode=0 Jul 24 01:01:05.375244 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.375022 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" Jul 24 01:01:05.375244 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.375066 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" event={"ID":"a6b0c688-032c-4d75-ae20-581011661e02","Type":"ContainerDied","Data":"391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6"} Jul 24 01:01:05.375244 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.375145 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj" event={"ID":"a6b0c688-032c-4d75-ae20-581011661e02","Type":"ContainerDied","Data":"0e264f0b488c23288cec3c0903b6c1f2b72c89f35678bdc8c2657ad186aea0da"} Jul 24 01:01:05.375244 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.375179 2588 scope.go:117] "RemoveContainer" containerID="391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6" Jul 24 01:01:05.376374 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.376353 2588 generic.go:356] "Generic (PLEG): container finished" podID="460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0" containerID="a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2" exitCode=0 Jul 24 01:01:05.376442 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.376387 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" event={"ID":"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0","Type":"ContainerDied","Data":"a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2"} Jul 24 01:01:05.376442 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.376390 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" Jul 24 01:01:05.376442 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.376421 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4" event={"ID":"460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0","Type":"ContainerDied","Data":"804653a0773632839b10296e8f356e0e868233ffe05c9f8a90677b2dccd5066a"} Jul 24 01:01:05.384688 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.384672 2588 scope.go:117] "RemoveContainer" containerID="391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6" Jul 24 01:01:05.384948 ip-10-0-130-20 kubenswrapper[2588]: E0724 01:01:05.384932 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6\": container with ID starting with 391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6 not found: ID does not exist" containerID="391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6" Jul 24 01:01:05.384998 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.384957 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6"} err="failed to get container status \"391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6\": rpc error: code = NotFound desc = could not find container \"391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6\": container with ID starting with 391142dbad8aa7dd5915e47d1e9f676c9c3159209c6fcf8d9f5baf4b513feeb6 not found: ID does not exist" Jul 24 01:01:05.384998 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.384972 2588 scope.go:117] "RemoveContainer" containerID="a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2" Jul 24 01:01:05.393065 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.393045 2588 scope.go:117] "RemoveContainer" containerID="a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2" Jul 24 01:01:05.393358 ip-10-0-130-20 kubenswrapper[2588]: E0724 01:01:05.393340 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2\": container with ID starting with a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2 not found: ID does not exist" containerID="a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2" Jul 24 01:01:05.393416 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.393366 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2"} err="failed to get container status \"a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2\": rpc error: code = NotFound desc = could not find container \"a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2\": container with ID starting with a19dbe5f543720de69be72f9d24bfdf672c529ecc1943112e437fbf9e69d08a2 not found: ID does not exist" Jul 24 01:01:05.399145 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.399124 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4"] Jul 24 01:01:05.402665 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.402644 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a3cf0e-cc5fbfc66-lw4t4"] Jul 24 01:01:05.412999 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.412977 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj"] Jul 24 01:01:05.417124 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.417104 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a3cf0e-67cc9c744d-btnhj"] Jul 24 01:01:05.477564 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.477536 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0" path="/var/lib/kubelet/pods/460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0/volumes" Jul 24 01:01:05.478005 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:05.477985 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6b0c688-032c-4d75-ae20-581011661e02" path="/var/lib/kubelet/pods/a6b0c688-032c-4d75-ae20-581011661e02/volumes" Jul 24 01:01:08.955771 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:08.955728 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:11.567986 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:11.567942 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:14.323837 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:14.323799 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49"] Jul 24 01:01:14.390150 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:14.390114 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:29.343624 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.343577 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" podUID="97037e72-304e-4c8c-8e18-39015b9426cd" containerName="main" containerID="cri-o://366655be58b136c00e0e8f05439845c8f2139286b00be4ca118e982a6f01c4cc" gracePeriod=45 Jul 24 01:01:29.504275 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.504236 2588 generic.go:356] "Generic (PLEG): container finished" podID="97037e72-304e-4c8c-8e18-39015b9426cd" containerID="366655be58b136c00e0e8f05439845c8f2139286b00be4ca118e982a6f01c4cc" exitCode=0 Jul 24 01:01:29.504435 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.504279 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" event={"ID":"97037e72-304e-4c8c-8e18-39015b9426cd","Type":"ContainerDied","Data":"366655be58b136c00e0e8f05439845c8f2139286b00be4ca118e982a6f01c4cc"} Jul 24 01:01:29.607393 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.607327 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 01:01:29.678267 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.678234 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-home\") pod \"97037e72-304e-4c8c-8e18-39015b9426cd\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " Jul 24 01:01:29.678429 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.678330 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-model-cache\") pod \"97037e72-304e-4c8c-8e18-39015b9426cd\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " Jul 24 01:01:29.678429 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.678370 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86qfp\" (UniqueName: \"kubernetes.io/projected/97037e72-304e-4c8c-8e18-39015b9426cd-kube-api-access-86qfp\") pod \"97037e72-304e-4c8c-8e18-39015b9426cd\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " Jul 24 01:01:29.678429 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.678408 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-tmp-dir\") pod \"97037e72-304e-4c8c-8e18-39015b9426cd\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " Jul 24 01:01:29.678602 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.678439 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-dshm\") pod \"97037e72-304e-4c8c-8e18-39015b9426cd\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " Jul 24 01:01:29.678602 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.678485 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97037e72-304e-4c8c-8e18-39015b9426cd-tls-certs\") pod \"97037e72-304e-4c8c-8e18-39015b9426cd\" (UID: \"97037e72-304e-4c8c-8e18-39015b9426cd\") " Jul 24 01:01:29.678602 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.678522 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-home" (OuterVolumeSpecName: "home") pod "97037e72-304e-4c8c-8e18-39015b9426cd" (UID: "97037e72-304e-4c8c-8e18-39015b9426cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 01:01:29.678759 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.678645 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-model-cache" (OuterVolumeSpecName: "model-cache") pod "97037e72-304e-4c8c-8e18-39015b9426cd" (UID: "97037e72-304e-4c8c-8e18-39015b9426cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 01:01:29.678759 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.678662 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "97037e72-304e-4c8c-8e18-39015b9426cd" (UID: "97037e72-304e-4c8c-8e18-39015b9426cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 01:01:29.678875 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.678814 2588 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-home\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:01:29.678875 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.678834 2588 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-model-cache\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:01:29.678875 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.678848 2588 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-tmp-dir\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:01:29.680678 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.680653 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-dshm" (OuterVolumeSpecName: "dshm") pod "97037e72-304e-4c8c-8e18-39015b9426cd" (UID: "97037e72-304e-4c8c-8e18-39015b9426cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 01:01:29.680796 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.680699 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97037e72-304e-4c8c-8e18-39015b9426cd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "97037e72-304e-4c8c-8e18-39015b9426cd" (UID: "97037e72-304e-4c8c-8e18-39015b9426cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 01:01:29.680796 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.680754 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97037e72-304e-4c8c-8e18-39015b9426cd-kube-api-access-86qfp" (OuterVolumeSpecName: "kube-api-access-86qfp") pod "97037e72-304e-4c8c-8e18-39015b9426cd" (UID: "97037e72-304e-4c8c-8e18-39015b9426cd"). InnerVolumeSpecName "kube-api-access-86qfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 01:01:29.779768 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.779738 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86qfp\" (UniqueName: \"kubernetes.io/projected/97037e72-304e-4c8c-8e18-39015b9426cd-kube-api-access-86qfp\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:01:29.779768 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.779764 2588 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97037e72-304e-4c8c-8e18-39015b9426cd-dshm\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:01:29.779768 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:29.779773 2588 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97037e72-304e-4c8c-8e18-39015b9426cd-tls-certs\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:01:30.510552 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:30.510515 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" Jul 24 01:01:30.511015 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:30.510569 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49" event={"ID":"97037e72-304e-4c8c-8e18-39015b9426cd","Type":"ContainerDied","Data":"503594d06e9ad5e52ced99a71f44ebe28742a5a9a4c76ac6c0386b4110313473"} Jul 24 01:01:30.511015 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:30.510620 2588 scope.go:117] "RemoveContainer" containerID="366655be58b136c00e0e8f05439845c8f2139286b00be4ca118e982a6f01c4cc" Jul 24 01:01:30.532390 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:30.532362 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49"] Jul 24 01:01:30.534302 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:30.534284 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-a3cf0e/ipp-route-a3cf0e-kserve-588f5dd7dc-hnw49"] Jul 24 01:01:31.482062 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:31.482026 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97037e72-304e-4c8c-8e18-39015b9426cd" path="/var/lib/kubelet/pods/97037e72-304e-4c8c-8e18-39015b9426cd/volumes" Jul 24 01:01:50.626853 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:50.626815 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:51.437475 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:51.437382 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:57.158339 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.158299 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:57.227304 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.227270 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:57.444575 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.444497 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:57.682641 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.682608 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:01:57.849300 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849268 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5"] Jul 24 01:01:57.849675 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849663 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6b0c688-032c-4d75-ae20-581011661e02" containerName="payload-pre-processing" Jul 24 01:01:57.849734 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849677 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6b0c688-032c-4d75-ae20-581011661e02" containerName="payload-pre-processing" Jul 24 01:01:57.849734 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849686 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0" containerName="payload-processing" Jul 24 01:01:57.849734 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849703 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0" containerName="payload-processing" Jul 24 01:01:57.849734 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849714 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8762af4-1aa2-4079-9041-f51c921f49c5" containerName="revoke-keys" Jul 24 01:01:57.849734 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849720 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8762af4-1aa2-4079-9041-f51c921f49c5" containerName="revoke-keys" Jul 24 01:01:57.849734 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849728 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97037e72-304e-4c8c-8e18-39015b9426cd" containerName="main" Jul 24 01:01:57.849734 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849733 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="97037e72-304e-4c8c-8e18-39015b9426cd" containerName="main" Jul 24 01:01:57.849948 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849815 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6b0c688-032c-4d75-ae20-581011661e02" containerName="payload-pre-processing" Jul 24 01:01:57.849948 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849822 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="460ac5c8-c4cf-4fc5-b1fc-05c1d6de85a0" containerName="payload-processing" Jul 24 01:01:57.849948 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849828 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="97037e72-304e-4c8c-8e18-39015b9426cd" containerName="main" Jul 24 01:01:57.849948 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.849836 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8762af4-1aa2-4079-9041-f51c921f49c5" containerName="revoke-keys" Jul 24 01:01:57.852916 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.852901 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5" Jul 24 01:01:57.855445 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.855421 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 01:01:57.855578 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.855514 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rz5kk\"" Jul 24 01:01:57.867443 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.864406 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5"] Jul 24 01:01:57.948223 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:57.948184 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b04e83-1f31-4490-883f-42655ecc5bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5\" (UID: \"a1b04e83-1f31-4490-883f-42655ecc5bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5" Jul 24 01:01:58.049971 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:58.049931 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b04e83-1f31-4490-883f-42655ecc5bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5\" (UID: \"a1b04e83-1f31-4490-883f-42655ecc5bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5" Jul 24 01:01:58.050638 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:58.050615 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b04e83-1f31-4490-883f-42655ecc5bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5\" (UID: \"a1b04e83-1f31-4490-883f-42655ecc5bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5" Jul 24 01:01:58.165115 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:58.165026 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5" Jul 24 01:01:58.299968 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:58.299942 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5"] Jul 24 01:01:58.303659 ip-10-0-130-20 kubenswrapper[2588]: W0724 01:01:58.303634 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b04e83_1f31_4490_883f_42655ecc5bd5.slice/crio-f14d128f3f7773a3afb539de9d5bda6d4c3530579952e1601960435e5d52f4d4 WatchSource:0}: Error finding container f14d128f3f7773a3afb539de9d5bda6d4c3530579952e1601960435e5d52f4d4: Status 404 returned error can't find the container with id f14d128f3f7773a3afb539de9d5bda6d4c3530579952e1601960435e5d52f4d4 Jul 24 01:01:58.665224 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:58.665188 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5" event={"ID":"a1b04e83-1f31-4490-883f-42655ecc5bd5","Type":"ContainerStarted","Data":"c027501f45c0c5999bf40c0d26e4041e59262aaf408f5bd88d4132cd36ac34d3"} Jul 24 01:01:58.665395 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:58.665238 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5" event={"ID":"a1b04e83-1f31-4490-883f-42655ecc5bd5","Type":"ContainerStarted","Data":"f14d128f3f7773a3afb539de9d5bda6d4c3530579952e1601960435e5d52f4d4"} Jul 24 01:01:58.679588 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:58.679533 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5" podStartSLOduration=1.679512728 podStartE2EDuration="1.679512728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:01:58.678833343 +0000 UTC m=+2879.682392690" watchObservedRunningTime="2026-07-24 01:01:58.679512728 +0000 UTC m=+2879.683072080" Jul 24 01:01:59.671914 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:59.671879 2588 generic.go:356] "Generic (PLEG): container finished" podID="a1b04e83-1f31-4490-883f-42655ecc5bd5" containerID="c027501f45c0c5999bf40c0d26e4041e59262aaf408f5bd88d4132cd36ac34d3" exitCode=0 Jul 24 01:01:59.672378 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:01:59.671967 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5" event={"ID":"a1b04e83-1f31-4490-883f-42655ecc5bd5","Type":"ContainerDied","Data":"c027501f45c0c5999bf40c0d26e4041e59262aaf408f5bd88d4132cd36ac34d3"} Jul 24 01:02:00.811122 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:00.811094 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5" Jul 24 01:02:00.977239 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:00.977155 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b04e83-1f31-4490-883f-42655ecc5bd5-maas-api-service-ca\") pod \"a1b04e83-1f31-4490-883f-42655ecc5bd5\" (UID: \"a1b04e83-1f31-4490-883f-42655ecc5bd5\") " Jul 24 01:02:00.977497 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:00.977473 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1b04e83-1f31-4490-883f-42655ecc5bd5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1b04e83-1f31-4490-883f-42655ecc5bd5" (UID: "a1b04e83-1f31-4490-883f-42655ecc5bd5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 01:02:01.078224 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:01.078194 2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b04e83-1f31-4490-883f-42655ecc5bd5-maas-api-service-ca\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:02:01.682436 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:01.682403 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5" event={"ID":"a1b04e83-1f31-4490-883f-42655ecc5bd5","Type":"ContainerDied","Data":"f14d128f3f7773a3afb539de9d5bda6d4c3530579952e1601960435e5d52f4d4"} Jul 24 01:02:01.682609 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:01.682451 2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f14d128f3f7773a3afb539de9d5bda6d4c3530579952e1601960435e5d52f4d4" Jul 24 01:02:01.682609 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:01.682417 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5" Jul 24 01:02:08.290545 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.290511 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:08.323584 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.323551 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52"] Jul 24 01:02:08.323824 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.323766 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" podUID="033aaab4-768a-472a-acbd-8b0122689490" containerName="payload-processing" containerID="cri-o://5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e" gracePeriod=30 Jul 24 01:02:08.390472 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.390437 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:08.492750 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.492667 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:08.576035 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.576009 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" Jul 24 01:02:08.645716 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.645685 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nzjm\" (UniqueName: \"kubernetes.io/projected/033aaab4-768a-472a-acbd-8b0122689490-kube-api-access-6nzjm\") pod \"033aaab4-768a-472a-acbd-8b0122689490\" (UID: \"033aaab4-768a-472a-acbd-8b0122689490\") " Jul 24 01:02:08.645888 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.645758 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/033aaab4-768a-472a-acbd-8b0122689490-plugins-config-volume\") pod \"033aaab4-768a-472a-acbd-8b0122689490\" (UID: \"033aaab4-768a-472a-acbd-8b0122689490\") " Jul 24 01:02:08.646172 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.646150 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/033aaab4-768a-472a-acbd-8b0122689490-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "033aaab4-768a-472a-acbd-8b0122689490" (UID: "033aaab4-768a-472a-acbd-8b0122689490"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 01:02:08.647759 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.647740 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/033aaab4-768a-472a-acbd-8b0122689490-kube-api-access-6nzjm" (OuterVolumeSpecName: "kube-api-access-6nzjm") pod "033aaab4-768a-472a-acbd-8b0122689490" (UID: "033aaab4-768a-472a-acbd-8b0122689490"). InnerVolumeSpecName "kube-api-access-6nzjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 01:02:08.719182 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.719144 2588 generic.go:356] "Generic (PLEG): container finished" podID="033aaab4-768a-472a-acbd-8b0122689490" containerID="5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e" exitCode=0 Jul 24 01:02:08.719335 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.719208 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" Jul 24 01:02:08.719335 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.719233 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" event={"ID":"033aaab4-768a-472a-acbd-8b0122689490","Type":"ContainerDied","Data":"5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e"} Jul 24 01:02:08.719335 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.719306 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52" event={"ID":"033aaab4-768a-472a-acbd-8b0122689490","Type":"ContainerDied","Data":"b95cc20a2c7c9f48708422527e895a2edcff834b335987c665d6f330cdf9d031"} Jul 24 01:02:08.719335 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.719328 2588 scope.go:117] "RemoveContainer" containerID="5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e" Jul 24 01:02:08.728793 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.728775 2588 scope.go:117] "RemoveContainer" containerID="5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e" Jul 24 01:02:08.729060 ip-10-0-130-20 kubenswrapper[2588]: E0724 01:02:08.729041 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e\": container with ID starting with 5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e not found: ID does not exist" containerID="5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e" Jul 24 01:02:08.729196 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.729071 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e"} err="failed to get container status \"5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e\": rpc error: code = NotFound desc = could not find container \"5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e\": container with ID starting with 5de41c825364c1faa0b968f4294685866464411e7bd4418c8d5a44219768a48e not found: ID does not exist" Jul 24 01:02:08.739634 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.739610 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52"] Jul 24 01:02:08.742606 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.742580 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-86b8da-5b875f48bb-2nl52"] Jul 24 01:02:08.746711 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.746686 2588 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/033aaab4-768a-472a-acbd-8b0122689490-plugins-config-volume\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:02:08.746711 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:08.746709 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nzjm\" (UniqueName: \"kubernetes.io/projected/033aaab4-768a-472a-acbd-8b0122689490-kube-api-access-6nzjm\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:02:09.477371 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:09.477341 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="033aaab4-768a-472a-acbd-8b0122689490" path="/var/lib/kubelet/pods/033aaab4-768a-472a-acbd-8b0122689490/volumes" Jul 24 01:02:12.910622 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:12.910588 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:12.911858 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:12.911833 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5"] Jul 24 01:02:12.913623 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:12.913597 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-86b8da-fz8s5"] Jul 24 01:02:13.310320 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:13.310234 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:13.477944 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:13.477911 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b04e83-1f31-4490-883f-42655ecc5bd5" path="/var/lib/kubelet/pods/a1b04e83-1f31-4490-883f-42655ecc5bd5/volumes" Jul 24 01:02:17.136188 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:17.136139 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:19.191176 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.191143 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:19.291885 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.291853 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:19.545252 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.545173 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:19.707443 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.707393 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:19.852537 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.852500 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg"] Jul 24 01:02:19.852992 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.852973 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033aaab4-768a-472a-acbd-8b0122689490" containerName="payload-processing" Jul 24 01:02:19.853108 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.852994 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="033aaab4-768a-472a-acbd-8b0122689490" containerName="payload-processing" Jul 24 01:02:19.853108 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.853009 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b04e83-1f31-4490-883f-42655ecc5bd5" containerName="revoke-keys" Jul 24 01:02:19.853108 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.853018 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b04e83-1f31-4490-883f-42655ecc5bd5" containerName="revoke-keys" Jul 24 01:02:19.853284 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.853124 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="033aaab4-768a-472a-acbd-8b0122689490" containerName="payload-processing" Jul 24 01:02:19.853284 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.853142 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b04e83-1f31-4490-883f-42655ecc5bd5" containerName="revoke-keys" Jul 24 01:02:19.857861 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.857841 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg" Jul 24 01:02:19.863115 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.862961 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 01:02:19.864112 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.864063 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rz5kk\"" Jul 24 01:02:19.866687 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.866660 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg"] Jul 24 01:02:19.939505 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:19.939467 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/697288a6-7208-4d84-a577-4d615cb22307-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg\" (UID: \"697288a6-7208-4d84-a577-4d615cb22307\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg" Jul 24 01:02:20.040565 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:20.040530 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/697288a6-7208-4d84-a577-4d615cb22307-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg\" (UID: \"697288a6-7208-4d84-a577-4d615cb22307\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg" Jul 24 01:02:20.041212 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:20.041187 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/697288a6-7208-4d84-a577-4d615cb22307-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg\" (UID: \"697288a6-7208-4d84-a577-4d615cb22307\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg" Jul 24 01:02:20.169156 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:20.169020 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg" Jul 24 01:02:20.305887 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:20.305857 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg"] Jul 24 01:02:20.308009 ip-10-0-130-20 kubenswrapper[2588]: W0724 01:02:20.307983 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697288a6_7208_4d84_a577_4d615cb22307.slice/crio-ec58b8e3ccd821f63fb975f66db7380347bd239d47b92ab6572c7f0c8e9a2e23 WatchSource:0}: Error finding container ec58b8e3ccd821f63fb975f66db7380347bd239d47b92ab6572c7f0c8e9a2e23: Status 404 returned error can't find the container with id ec58b8e3ccd821f63fb975f66db7380347bd239d47b92ab6572c7f0c8e9a2e23 Jul 24 01:02:20.789216 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:20.789177 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg" event={"ID":"697288a6-7208-4d84-a577-4d615cb22307","Type":"ContainerStarted","Data":"0b48ab25e0d1501537156516b184412700ad00cb74c1d8191a5663a6d8e4bbd2"} Jul 24 01:02:20.789387 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:20.789235 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg" event={"ID":"697288a6-7208-4d84-a577-4d615cb22307","Type":"ContainerStarted","Data":"ec58b8e3ccd821f63fb975f66db7380347bd239d47b92ab6572c7f0c8e9a2e23"} Jul 24 01:02:20.804489 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:20.804397 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg" podStartSLOduration=1.8043808220000002 podStartE2EDuration="1.804380822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:02:20.803282814 +0000 UTC m=+2901.806842173" watchObservedRunningTime="2026-07-24 01:02:20.804380822 +0000 UTC m=+2901.807940169" Jul 24 01:02:21.795827 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:21.795792 2588 generic.go:356] "Generic (PLEG): container finished" podID="697288a6-7208-4d84-a577-4d615cb22307" containerID="0b48ab25e0d1501537156516b184412700ad00cb74c1d8191a5663a6d8e4bbd2" exitCode=0 Jul 24 01:02:21.796311 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:21.795865 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg" event={"ID":"697288a6-7208-4d84-a577-4d615cb22307","Type":"ContainerDied","Data":"0b48ab25e0d1501537156516b184412700ad00cb74c1d8191a5663a6d8e4bbd2"} Jul 24 01:02:22.933401 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:22.933377 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg" Jul 24 01:02:22.968265 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:22.968235 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/697288a6-7208-4d84-a577-4d615cb22307-maas-api-service-ca\") pod \"697288a6-7208-4d84-a577-4d615cb22307\" (UID: \"697288a6-7208-4d84-a577-4d615cb22307\") " Jul 24 01:02:22.968552 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:22.968529 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/697288a6-7208-4d84-a577-4d615cb22307-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "697288a6-7208-4d84-a577-4d615cb22307" (UID: "697288a6-7208-4d84-a577-4d615cb22307"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 01:02:23.069282 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:23.069206 2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/697288a6-7208-4d84-a577-4d615cb22307-maas-api-service-ca\") on node \"ip-10-0-130-20.ec2.internal\" DevicePath \"\"" Jul 24 01:02:23.806453 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:23.806364 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg" Jul 24 01:02:23.806453 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:23.806398 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg" event={"ID":"697288a6-7208-4d84-a577-4d615cb22307","Type":"ContainerDied","Data":"ec58b8e3ccd821f63fb975f66db7380347bd239d47b92ab6572c7f0c8e9a2e23"} Jul 24 01:02:23.806453 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:23.806445 2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec58b8e3ccd821f63fb975f66db7380347bd239d47b92ab6572c7f0c8e9a2e23" Jul 24 01:02:30.352022 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:30.351987 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:30.422961 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:30.422928 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:30.485270 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:30.485236 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:34.938491 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:34.938450 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:34.942786 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:34.942759 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg"] Jul 24 01:02:34.949349 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:34.949325 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-38da25-dx9rg"] Jul 24 01:02:35.422799 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:35.422757 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:35.477340 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:35.477308 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="697288a6-7208-4d84-a577-4d615cb22307" path="/var/lib/kubelet/pods/697288a6-7208-4d84-a577-4d615cb22307/volumes" Jul 24 01:02:41.500668 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:41.500633 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:41.599915 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:41.599871 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:41.789428 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:41.789342 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:42.013202 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:42.013164 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:55.554437 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:55.554399 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:55.655034 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:55.655005 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:57.211910 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:57.211878 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:02:57.619347 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:02:57.619306 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:03:03.469105 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:03.469047 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:03:03.532335 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:03.532299 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:03:03.746969 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:03.746866 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:03:03.971117 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:03.971076 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:03:08.043811 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:08.043772 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:03:10.620071 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:10.620043 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cff767bd6-65nhc_32212fd4-a8fe-4762-886a-dfdf691b2e44/copy-manifests/0.log" Jul 24 01:03:10.627215 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:10.627183 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cff767bd6-65nhc_32212fd4-a8fe-4762-886a-dfdf691b2e44/manager/0.log" Jul 24 01:03:11.630291 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:11.630260 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747580-npmrk_de8b5d46-3577-4cb1-912c-4dd754920ebc/cleanup/0.log" Jul 24 01:03:13.433724 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:13.433698 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-g86sb_273a0188-f338-4eae-9d8d-7f6764169005/kuadrant-console-plugin/0.log" Jul 24 01:03:13.675845 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:13.675811 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-p4hw5_f743ce96-d16c-4bc8-b67e-d017e31ae10d/manager/0.log" Jul 24 01:03:14.624799 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:14.624768 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c994f5cd9-fzvrg_682e1a15-b52a-443b-bf2f-54a0e3ada196/kube-auth-proxy/0.log" Jul 24 01:03:14.879060 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:14.878979 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-78hzn_66d99f9c-2622-44c8-91e2-9f764c43ed1c/payload-pre-processing/0.log" Jul 24 01:03:15.477373 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:15.477328 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-qzbc8_b2987c00-28b1-401f-ab90-d58c58f8c60f/main/0.log" Jul 24 01:03:15.828303 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:15.828264 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fb7ddz_5c01f868-ec0a-4d55-8966-fa39b98e2de4/main/0.log" Jul 24 01:03:15.936336 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:15.936307 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zxbjq_d35ab260-405d-4993-9962-c58c82785b16/main/0.log" Jul 24 01:03:16.043342 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:16.043307 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-tgbf8_c5031836-522b-49be-9d90-48482a590df4/main/0.log" Jul 24 01:03:21.956241 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:21.956148 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:03:22.028575 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:22.028543 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:03:27.669974 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:27.669941 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jnljx_4dda38d3-0c29-499b-93bd-b9accf7c4cb3/global-pull-secret-syncer/0.log" Jul 24 01:03:27.808504 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:27.808474 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" Jul 24 01:03:27.907536 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:27.907507 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-20.ec2.internal_37633424d4f98b6e44a2f77092ebb963/haproxy/0.log" Jul 24 01:03:33.526950 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:33.526922 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-g86sb_273a0188-f338-4eae-9d8d-7f6764169005/kuadrant-console-plugin/0.log" Jul 24 01:03:33.786471 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:33.786391 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-p4hw5_f743ce96-d16c-4bc8-b67e-d017e31ae10d/manager/0.log" Jul 24 01:03:35.000197 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.000165 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zcbw_b7d8694d-a56d-416e-9fcb-174284b8afc1/konnectivity-agent/0.log" limit=1024 Jul 24 01:03:35.632324 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.632290 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22245d2c-887b-43a5-8abb-6d728fc06241/alertmanager/0.log" Jul 24 01:03:35.656132 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.656032 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22245d2c-887b-43a5-8abb-6d728fc06241/config-reloader/0.log" Jul 24 01:03:35.681763 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.681738 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22245d2c-887b-43a5-8abb-6d728fc06241/kube-rbac-proxy-web/0.log" Jul 24 01:03:35.705617 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.705595 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22245d2c-887b-43a5-8abb-6d728fc06241/kube-rbac-proxy/0.log" Jul 24 01:03:35.726517 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.726491 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22245d2c-887b-43a5-8abb-6d728fc06241/kube-rbac-proxy-metric/0.log" Jul 24 01:03:35.746477 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.746450 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22245d2c-887b-43a5-8abb-6d728fc06241/prom-label-proxy/0.log" Jul 24 01:03:35.766700 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.766675 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22245d2c-887b-43a5-8abb-6d728fc06241/init-config-reloader/0.log" Jul 24 01:03:35.851327 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.851297 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xjkpr_a20a907e-7212-4580-a1c5-3156eb4e13d7/kube-state-metrics/0.log" Jul 24 01:03:35.867936 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.867904 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xjkpr_a20a907e-7212-4580-a1c5-3156eb4e13d7/kube-rbac-proxy-main/0.log" Jul 24 01:03:35.890809 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.890782 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xjkpr_a20a907e-7212-4580-a1c5-3156eb4e13d7/kube-rbac-proxy-self/0.log" Jul 24 01:03:35.916532 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.916457 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85f4f676b8-s5kvz_657f86fc-93b4-468a-a270-c4ef782b65c3/metrics-server/0.log" Jul 24 01:03:35.939795 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:35.939773 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-874pg_16ed121a-0e76-44e0-9a17-cd3cada5bf52/monitoring-plugin/0.log" Jul 24 01:03:36.045617 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.045588 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8fn9_882f5d53-0541-446b-96ef-13a33895c1b8/node-exporter/0.log" Jul 24 01:03:36.064933 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.064910 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8fn9_882f5d53-0541-446b-96ef-13a33895c1b8/kube-rbac-proxy/0.log" Jul 24 01:03:36.088223 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.088196 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8fn9_882f5d53-0541-446b-96ef-13a33895c1b8/init-textfile/0.log" Jul 24 01:03:36.197449 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.197371 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-thczl_be65a5f1-be44-4fdd-8632-6385dbee64b0/kube-rbac-proxy-main/0.log" Jul 24 01:03:36.218300 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.218258 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-thczl_be65a5f1-be44-4fdd-8632-6385dbee64b0/kube-rbac-proxy-self/0.log" Jul 24 01:03:36.241700 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.241674 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-thczl_be65a5f1-be44-4fdd-8632-6385dbee64b0/openshift-state-metrics/0.log" Jul 24 01:03:36.281701 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.281637 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_475ca8cb-3bb0-4442-8445-5356e6488502/prometheus/0.log" Jul 24 01:03:36.301347 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.301320 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_475ca8cb-3bb0-4442-8445-5356e6488502/config-reloader/0.log" Jul 24 01:03:36.322330 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.322301 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_475ca8cb-3bb0-4442-8445-5356e6488502/thanos-sidecar/0.log" Jul 24 01:03:36.344625 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.344600 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_475ca8cb-3bb0-4442-8445-5356e6488502/kube-rbac-proxy-web/0.log" Jul 24 01:03:36.365728 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.365699 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_475ca8cb-3bb0-4442-8445-5356e6488502/kube-rbac-proxy/0.log" Jul 24 01:03:36.387862 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.387838 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_475ca8cb-3bb0-4442-8445-5356e6488502/kube-rbac-proxy-thanos/0.log" Jul 24 01:03:36.408057 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.408025 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_475ca8cb-3bb0-4442-8445-5356e6488502/init-config-reloader/0.log" Jul 24 01:03:36.437055 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.437022 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-pxfgc_40c29daa-314d-451c-a4fc-76bb976ca837/prometheus-operator/0.log" Jul 24 01:03:36.454401 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.454324 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-pxfgc_40c29daa-314d-451c-a4fc-76bb976ca837/kube-rbac-proxy/0.log" Jul 24 01:03:36.478517 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.478489 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-2tbq8_178bd686-b849-4054-8c58-d67e3b77e3b3/prometheus-operator-admission-webhook/0.log" Jul 24 01:03:36.580816 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.580792 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6996659587-b68bm_31f5cd38-b590-4deb-a01a-59add4fee045/thanos-query/0.log" Jul 24 01:03:36.607885 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.607863 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6996659587-b68bm_31f5cd38-b590-4deb-a01a-59add4fee045/kube-rbac-proxy-web/0.log" Jul 24 01:03:36.631014 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.630983 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6996659587-b68bm_31f5cd38-b590-4deb-a01a-59add4fee045/kube-rbac-proxy/0.log" Jul 24 01:03:36.651191 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.651167 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6996659587-b68bm_31f5cd38-b590-4deb-a01a-59add4fee045/prom-label-proxy/0.log" Jul 24 01:03:36.672835 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.672811 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6996659587-b68bm_31f5cd38-b590-4deb-a01a-59add4fee045/kube-rbac-proxy-rules/0.log" Jul 24 01:03:36.692378 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:36.692342 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6996659587-b68bm_31f5cd38-b590-4deb-a01a-59add4fee045/kube-rbac-proxy-metrics/0.log" Jul 24 01:03:37.925921 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:37.925886 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x"] Jul 24 01:03:37.926505 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:37.926485 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="697288a6-7208-4d84-a577-4d615cb22307" containerName="revoke-keys" Jul 24 01:03:37.926596 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:37.926508 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="697288a6-7208-4d84-a577-4d615cb22307" containerName="revoke-keys" Jul 24 01:03:37.926675 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:37.926663 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="697288a6-7208-4d84-a577-4d615cb22307" containerName="revoke-keys" Jul 24 01:03:37.930093 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:37.930058 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:37.932501 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:37.932483 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sslln\"/\"openshift-service-ca.crt\"" Jul 24 01:03:37.933924 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:37.933905 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sslln\"/\"kube-root-ca.crt\"" Jul 24 01:03:37.934451 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:37.934419 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sslln\"/\"default-dockercfg-qwwxr\"" Jul 24 01:03:37.940281 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:37.940252 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x"] Jul 24 01:03:38.005571 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.005531 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9pk\" (UniqueName: \"kubernetes.io/projected/b17cc4a7-e0e9-457e-afb1-487c425d6cff-kube-api-access-jz9pk\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.005756 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.005594 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b17cc4a7-e0e9-457e-afb1-487c425d6cff-sys\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.005756 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.005624 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b17cc4a7-e0e9-457e-afb1-487c425d6cff-lib-modules\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.005756 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.005653 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b17cc4a7-e0e9-457e-afb1-487c425d6cff-proc\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.005897 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.005796 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b17cc4a7-e0e9-457e-afb1-487c425d6cff-podres\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.106501 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.106456 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b17cc4a7-e0e9-457e-afb1-487c425d6cff-lib-modules\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.106667 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.106514 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b17cc4a7-e0e9-457e-afb1-487c425d6cff-proc\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.106667 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.106597 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b17cc4a7-e0e9-457e-afb1-487c425d6cff-podres\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.106667 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.106609 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b17cc4a7-e0e9-457e-afb1-487c425d6cff-proc\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.106667 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.106640 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b17cc4a7-e0e9-457e-afb1-487c425d6cff-lib-modules\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.106819 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.106682 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9pk\" (UniqueName: \"kubernetes.io/projected/b17cc4a7-e0e9-457e-afb1-487c425d6cff-kube-api-access-jz9pk\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.106819 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.106716 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b17cc4a7-e0e9-457e-afb1-487c425d6cff-podres\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.106819 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.106769 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b17cc4a7-e0e9-457e-afb1-487c425d6cff-sys\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.106919 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.106828 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b17cc4a7-e0e9-457e-afb1-487c425d6cff-sys\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.117388 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.117357 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9pk\" (UniqueName: \"kubernetes.io/projected/b17cc4a7-e0e9-457e-afb1-487c425d6cff-kube-api-access-jz9pk\") pod \"perf-node-gather-daemonset-zl86x\" (UID: \"b17cc4a7-e0e9-457e-afb1-487c425d6cff\") " pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.259746 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.259660 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:38.391762 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:38.391737 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x"] Jul 24 01:03:38.394003 ip-10-0-130-20 kubenswrapper[2588]: W0724 01:03:38.393976 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb17cc4a7_e0e9_457e_afb1_487c425d6cff.slice/crio-b9b27165286b53f636fe88e30a8f801ab042a8809ae5e096ef5edd2d79cd2b73 WatchSource:0}: Error finding container b9b27165286b53f636fe88e30a8f801ab042a8809ae5e096ef5edd2d79cd2b73: Status 404 returned error can't find the container with id b9b27165286b53f636fe88e30a8f801ab042a8809ae5e096ef5edd2d79cd2b73 Jul 24 01:03:39.030446 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:39.030416 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d784cbff4-j7hqr_f0530d03-2c76-4b89-97d3-27847eae96d1/console/0.log" Jul 24 01:03:39.199698 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:39.199660 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" event={"ID":"b17cc4a7-e0e9-457e-afb1-487c425d6cff","Type":"ContainerStarted","Data":"ba16088059de6c9b9004bd7ed7476d82029789578d03f8c3cc5b8f1026f55e68"} Jul 24 01:03:39.199876 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:39.199721 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" event={"ID":"b17cc4a7-e0e9-457e-afb1-487c425d6cff","Type":"ContainerStarted","Data":"b9b27165286b53f636fe88e30a8f801ab042a8809ae5e096ef5edd2d79cd2b73"} Jul 24 01:03:39.199876 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:39.199855 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:39.236451 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:39.236405 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" podStartSLOduration=2.236389362 podStartE2EDuration="2.236389362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:03:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:03:39.235424177 +0000 UTC m=+2980.238983524" watchObservedRunningTime="2026-07-24 01:03:39.236389362 +0000 UTC m=+2980.239948709" Jul 24 01:03:40.827771 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:40.827744 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qt8k5_ce0c13fa-1239-4b6c-92d0-bf1475b1ca64/dns/0.log" Jul 24 01:03:40.849709 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:40.849691 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qt8k5_ce0c13fa-1239-4b6c-92d0-bf1475b1ca64/kube-rbac-proxy/0.log" Jul 24 01:03:40.895062 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:40.895036 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b2mj5_ff5b60fa-0e53-444d-935f-7aaae67eee3e/dns-node-resolver/0.log" Jul 24 01:03:41.561429 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:41.561398 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p45bc_c680d364-22c9-4026-8364-19ad2fa7a6c7/node-ca/0.log" Jul 24 01:03:42.718659 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:42.718629 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c994f5cd9-fzvrg_682e1a15-b52a-443b-bf2f-54a0e3ada196/kube-auth-proxy/0.log" Jul 24 01:03:42.826578 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:42.826548 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-78hzn_66d99f9c-2622-44c8-91e2-9f764c43ed1c/payload-pre-processing/0.log" Jul 24 01:03:43.716266 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:43.716228 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fn7qt_63bc5548-6bb1-4ce7-8fc4-a032536cfaa3/serve-healthcheck-canary/0.log" Jul 24 01:03:44.230318 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:44.230285 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8cwl2_c700810b-d686-448a-adf3-c8d334aa2f01/kube-rbac-proxy/0.log" Jul 24 01:03:44.249678 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:44.249640 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8cwl2_c700810b-d686-448a-adf3-c8d334aa2f01/exporter/0.log" Jul 24 01:03:44.270974 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:44.270948 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8cwl2_c700810b-d686-448a-adf3-c8d334aa2f01/extractor/0.log" Jul 24 01:03:45.214471 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:45.214445 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sslln/perf-node-gather-daemonset-zl86x" Jul 24 01:03:47.343126 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:47.343100 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cff767bd6-65nhc_32212fd4-a8fe-4762-886a-dfdf691b2e44/manager/0.log" Jul 24 01:03:47.366966 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:47.366941 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cff767bd6-65nhc_32212fd4-a8fe-4762-886a-dfdf691b2e44/copy-manifests/0.log" Jul 24 01:03:48.660230 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:48.660202 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c994f5cd9-fzvrg_682e1a15-b52a-443b-bf2f-54a0e3ada196/kube-auth-proxy/0.log" Jul 24 01:03:48.744410 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:48.744376 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-78hzn_66d99f9c-2622-44c8-91e2-9f764c43ed1c/payload-pre-processing/0.log" Jul 24 01:03:48.792259 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:48.792230 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b84c6bc85-7x8nh_0e0bacb1-56f8-4038-96c0-b3f7aac5e500/manager/0.log" Jul 24 01:03:50.437358 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:50.437326 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c994f5cd9-fzvrg_682e1a15-b52a-443b-bf2f-54a0e3ada196/kube-auth-proxy/0.log" Jul 24 01:03:50.521564 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:50.521537 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-78hzn_66d99f9c-2622-44c8-91e2-9f764c43ed1c/payload-pre-processing/0.log" Jul 24 01:03:55.250214 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:55.250183 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b9tv_f96ed08f-e197-4605-9703-822195dec9c7/kube-multus-additional-cni-plugins/0.log" Jul 24 01:03:55.274611 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:55.274592 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b9tv_f96ed08f-e197-4605-9703-822195dec9c7/egress-router-binary-copy/0.log" Jul 24 01:03:55.295479 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:55.295452 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b9tv_f96ed08f-e197-4605-9703-822195dec9c7/cni-plugins/0.log" Jul 24 01:03:55.315848 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:55.315826 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b9tv_f96ed08f-e197-4605-9703-822195dec9c7/bond-cni-plugin/0.log" Jul 24 01:03:55.337208 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:55.337186 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b9tv_f96ed08f-e197-4605-9703-822195dec9c7/routeoverride-cni/0.log" Jul 24 01:03:55.356835 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:55.356812 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b9tv_f96ed08f-e197-4605-9703-822195dec9c7/whereabouts-cni-bincopy/0.log" Jul 24 01:03:55.377018 ip-10-0-130-20 kubenswrapper[2588]: I0724 01:03:55.376997 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b9tv_f96ed08f-e197-4605-9703-822195dec9c7/whereabouts-cni/0.log"